Merge requests · repos / data-engineering / Airflow DAGs

Fix session metrics schedule to start on Sunday

!61 · created May 23, 2022 by Mforns
- Merged
- Approved
updated May 23, 2022
T295072 spark 3 from airflow venv pyspark

!54 · created May 12, 2022 by Aqu
- Merged
- 10
- Approved
updated May 23, 2022
Migrate the clickstream job to Airflow

!52 · created May 09, 2022 by Aqu
- Merged
- 22
- 1
- Approved
updated May 23, 2022
Rename artifacts, these are now cached by name, so use apporpriate file ext

!58 · created May 19, 2022 by Ottomata
- Merged
- 2
updated May 19, 2022
Fix kerberos credentials when specifying production config

!57 · created May 18, 2022 by Mforns
- Merged
- Approved
updated May 18, 2022
Update dag config with wmf-env and production queue for analytics

!56 · created May 17, 2022 by Joal
- Merged
- 5
updated May 18, 2022
Update spark configuration

!55 · created May 13, 2022 by Joal
- Merged
- 4
- Approved
updated May 17, 2022
Create Coeditors_metric dag

!53 · created May 10, 2022 by Snwachukwu
- Merged
- 17
- Approved
updated May 11, 2022
Create API metric dag

!51 · created May 04, 2022 by Snwachukwu
- Merged
- 7
- Approved
updated May 05, 2022
Fix artifact config loading of research airflow instance

!50 · created May 02, 2022 by Ottomata
- Merged
updated May 02, 2022
session metrics

!49 · created Apr 26, 2022 by NOkafor
- Merged
- 2
- Approved
updated Apr 27, 2022
interlanguage_dag oozie to airflow

!42 · created Mar 31, 2022 by NOkafor
- Merged
- 29
- Approved
updated Apr 21, 2022
browser_general oozie to airflow migration [WIP]

!44 · created Apr 06, 2022 by NOkafor
- Merged
- 26
updated Apr 21, 2022
CI Pipeline fixes

!46 · created Apr 12, 2022 by Ottomata
- Merged
- 2
updated Apr 13, 2022
Make wmf_airflow_common installable.

!45 · created Apr 12, 2022 by Gmodena
- Merged
- 4
updated Apr 12, 2022
Setup tox and gitlab ci

!43 · created Apr 05, 2022 by Ottomata
- Merged
- 17
updated Apr 11, 2022
Create operator to run HDFSArchiver

!40 · created Mar 28, 2022 by Aqu
- Merged
- 13
updated Apr 11, 2022
Migrate mediarequest hourly from Oozie to Airflow

!41 · created Mar 30, 2022 by Aqu
- Merged
- 14
updated Apr 11, 2022
Remove spark dag factories

!38 · created Mar 15, 2022 by Mforns
- Merged
- 59
- Approved
updated Apr 06, 2022
Migrate session_length/daily from Oozie to Airflow

!33 · created Mar 09, 2022 by Aqu
- Merged
- 9
updated Mar 16, 2022

Admin message

Admin message

Admin message