Merge requests · repos / data-engineering / Airflow DAGs

Add DAG to load MediaWiki snapshot config to Cassandra

!577 · created Jan 10, 2024 by Mforns
- Merged
- 14
- Approved
updated Jan 31, 2024
Don't retry convert_history_xml_to_parquet.

!595 · created Jan 26, 2024 by Xcollazo
- Merged
- 1
- Approved
updated Jan 29, 2024
webrequest: analyzer: don't trigger alerts check.

!586 · created Jan 19, 2024 by Gmodena
- Merged
- 6
- Approved
updated Jan 29, 2024
Update browser_general dag to generate iceberg table

!576 · created Jan 09, 2024 by Snwachukwu
- Merged
- 14
- 1
- Approved
updated Jan 26, 2024
Risk observatory batching

!593 · created Jan 24, 2024 by Fabian Kaelin
- Merged
updated Jan 25, 2024
Fix Refine webrequest to include bug fix in new jar version

!592 · created Jan 24, 2024 by Aqu
- Merged
- Approved
updated Jan 24, 2024
Wikidiff updates

!589 · created Jan 23, 2024 by Fabian Kaelin
- Merged
- 13
updated Jan 24, 2024
Bump image-suggestions to 0.17.0-v0.17.0.

!585 · created Jan 18, 2024 by Ghost User
- Merged
- Approved
updated Jan 24, 2024
Fix Refine webrequest to include bugfix in new jar version

!591 · created Jan 24, 2024 by Aqu
- Merged
updated Jan 24, 2024
Add iceberg version of aqs_hourly dag

!569 · created Dec 20, 2023 by TChin
- Merged
- Approved
updated Jan 24, 2024
Feed Druid unique devices dataset from Iceberg table

!582 · created Jan 16, 2024 by Aqu
- Merged
- 4
- Approved
updated Jan 24, 2024
search: bump feature selection spark.driver.maxResultSize to 3g

!588 · created Jan 22, 2024 by DCausse
- Merged
- Approved
updated Jan 22, 2024
Webrequest: add metrics generation and quality check alerting dag.

!550 · created Dec 01, 2023 by Gmodena
- Merged
- 16
- Approved
updated Jan 19, 2024
Risk observatory & wikidiff dag

!580 · created Jan 11, 2024 by Fabian Kaelin
- Merged
- 16
- Approved
updated Jan 12, 2024
Updates to country_project_page (re: 14 Dec 2023 bug)

!579 · created Jan 11, 2024 by Htriedman
- Merged
updated Jan 11, 2024
Make global confs immutable.

!572 · created Dec 21, 2023 by Xcollazo
- Merged
- 20
- 1
- Approved
updated Jan 08, 2024
Always depend on datacenter prepartitions.

!575 · created Jan 02, 2024 by Xcollazo
- Merged
- 1
- Approved
updated Jan 03, 2024
Don't StackOverflow on executors when doing dumps MERGE.

!574 · created Jan 02, 2024 by Xcollazo
- Merged
- 1
- Approved
updated Jan 02, 2024
Fix analytics druid load pageview daily agg monthly

!573 · created Jan 01, 2024 by Joal
- Merged
- 1
- Approved
updated Jan 01, 2024
Upgrade image-suggestions to Spark3. Take two.

!193 · created Dec 08, 2022 by Xcollazo
- Merged
- 10
- Approved
updated Dec 21, 2023

Admin message

Admin message

Admin message