Merge requests · repos / data-engineering / Airflow DAGs

Mitigate refine Webrequest concurrency problem

!868 · created Oct 10, 2024 by Aqu
- Merged
- Approved
updated Oct 10, 2024
Optimization for Refine on staging

!867 · created Oct 10, 2024 by Aqu
- Merged
- 15
- Approved
updated Oct 14, 2024
Automoderator potential vandalism reverted DAG

!866 · created Oct 10, 2024 by KCVelaga
- Merged
- 3
- Approved
updated Oct 11, 2024
T370851 T371258 T349285 New WD, WDQS and WD REST API DAGs 10 of 10 checklist items completed

!865 · created Oct 10, 2024 by Andrew McAllister (WMDE)
- Merged
- 2
updated Oct 10, 2024
Consolidate section alignment image suggestions

!864 · created Oct 09, 2024 by Marco Fossati
- Merged
- Approved
updated Nov 06, 2024
Update Automoderator daily dag conda env to v3

!863 · created Oct 09, 2024 by KCVelaga
- Merged
- Approved
updated Oct 09, 2024
test_k8s: add a DAG that fails on purpose to test email configuration

!862 · created Oct 08, 2024 by Brouberol
- Merged
- 2
- Approved
updated Oct 08, 2024
Draft: Adding support for "produced_by" configuration of datasets

!861 · created Oct 07, 2024 by Aleksandar Mastilovic
- 49
updated Oct 10, 2024
Work/conniecc/commons uploads dag

!860 · created Oct 05, 2024 by Conniecc1
- 5
updated Oct 28, 2024
Automoderator monthly snapshot DAG

!859 · created Oct 04, 2024 by KCVelaga
- Merged
- 1
- Approved
updated Oct 14, 2024
search: Include virtualpageview in search metrics

!858 · created Oct 03, 2024 by Ebernhardson
- Merged
updated Oct 28, 2024
Fixes following staging of Refine to Airflow

!857 · created Oct 03, 2024 by Aqu
- Merged
updated Oct 07, 2024
Fix jar path for mediawiki-jdbc source

!856 · created Oct 02, 2024 by KCVelaga
- Merged
- 5
- Approved
updated Oct 03, 2024
Fix missing package version change in Dockerfile

!855 · created Oct 02, 2024 by Brouberol
- Merged
- Approved
updated Oct 02, 2024
Upgrade airflow to 2.10.2

!854 · created Oct 02, 2024 by Brouberol
- Merged
- Approved
updated Oct 02, 2024
Disable catchup for flagged revisions DAG

!853 · created Oct 02, 2024 by KCVelaga
- Merged
- Approved
updated Oct 02, 2024
Prefix discovery tables for Datahub ingestion

!852 · created Oct 02, 2024 by TChin
- Merged
- 1
- Approved
updated Oct 03, 2024
Reduce concurrency for product analytics skein jobs (temporarily)

!851 · created Oct 01, 2024 by KCVelaga
- Merged
- Approved
updated Oct 02, 2024
Define a maintenance DAG to prune old data from the airflow DB

!850 · created Sep 30, 2024 by Brouberol
- Merged
- Approved
updated Oct 03, 2024
Add support for Iceberg's rewrite_data_files().

!849 · created Sep 28, 2024 by Xcollazo
- Merged
- 17
- Approved
updated Oct 09, 2024

Admin message

Admin message

Admin message