Merge requests · repos / data-engineering / Airflow DAGs

Update cassandra_load_pageview_top_articles_dag

!908 · created Nov 05, 2024 by Joal
- Merged
- 1
- Approved
updated Nov 05, 2024
Fix sensor and modify time window of dumps_reconcile_wikitext_raw_daily_dag.

!907 · created Nov 01, 2024 by Xcollazo
- Merged
- 1
- Approved
updated Nov 06, 2024
Sync up DagProperties of dumps_merge_events_to_wikitext_raw_daily with overrides.

!906 · created Nov 01, 2024 by Xcollazo
- Merged
- 1
- Approved
updated Nov 06, 2024
search: add graph_name filtering

!905 · created Oct 31, 2024 by DCausse
- 1
updated Oct 31, 2024
Pickup 'Workaround blank rev_timestamps when doing consistency check'

!904 · created Oct 31, 2024 by Xcollazo
- Merged
- Approved
updated Oct 31, 2024
wmf_aiflow_common: handle hourly partitions

!903 · created Oct 31, 2024 by Gmodena
- Merged
- 1
- Approved
updated Nov 01, 2024
Add weekly rewrite_data_files() maintenance for wikitext_inconsistent_rows.

!902 · created Oct 30, 2024 by Xcollazo
- Merged
- 2
- Approved
updated Oct 31, 2024
T377767 Create Edit Hourly New DAG

!901 · created Oct 30, 2024 by Jennifer Ebe
- 1
updated Nov 14, 2024
analytics: dumps: add reconciliation consumer

!900 · created Oct 30, 2024 by Gmodena
- Merged
- 4
- Approved
updated Nov 13, 2024
Use new coeditors_metrics hql file

!899 · created Oct 30, 2024 by Snwachukwu
- 8
updated Nov 07, 2024
Add cu_log table to list of mediawiki sqoop tables to be loaded.

!898 · created Oct 29, 2024 by Snwachukwu
- Merged
- 1
- Approved
updated Oct 30, 2024
T371258 Convert device type edits to monthly + add mobile metrics 5 of 5 checklist items completed

!897 · created Oct 29, 2024 by Andrew McAllister (WMDE)
- Merged
- 1
updated Oct 30, 2024
T371258 Convert device type edits to monthly + add mobile metrics 3 of 5 checklist items completed

!896 · created Oct 29, 2024 by Andrew McAllister (WMDE)
- Closed
updated Oct 29, 2024
search: Add missing comma in sql statement

!895 · created Oct 28, 2024 by Ebernhardson
- Merged
updated Oct 28, 2024
Pickup 'Push down earliest rev_dt per wiki on the revision level MERGE INTO'

!894 · created Oct 28, 2024 by Xcollazo
- Merged
- 5
- Approved
updated Oct 29, 2024
Fix broken tests in main branch.

!893 · created Oct 28, 2024 by Xcollazo
- Merged
- 1
- 1
- Approved
updated Oct 28, 2024
Draft: add a staging airflow dag for webrequest_frontend refinement

!892 · created Oct 28, 2024 by Gmodena
- 6
updated Nov 01, 2024
Allow spark_kwargs to be passed to all table maintenance tasks.

!891 · created Oct 25, 2024 by Xcollazo
- Merged
- 5
- Approved
updated Oct 28, 2024
Decouple ALIS from SLIS

!890 · created Oct 25, 2024 by Marco Fossati
- Merged
- Approved
updated Nov 14, 2024
Refine staging: Skip _IMPORTED flag check

!889 · created Oct 25, 2024 by Aqu
- Merged
- 2
updated Nov 13, 2024

Admin message

Admin message

Admin message