Merge requests · repos / data-engineering / Airflow DAGs

Daily DP pageviews OOM bug

!559 · created Dec 15, 2023 by Htriedman
- Merged
- 3
updated Dec 21, 2023
Fine tune Dumps 2.0 backfill and event ingestion.

!558 · created Dec 14, 2023 by Xcollazo
- Merged
- 3
- Approved
updated Dec 15, 2023
Bump seal to 0.2.0-v0.2.0.

!557 · created Dec 14, 2023 by Ghost User
- Merged
- 1
- Approved
updated Dec 14, 2023
Use Spark 3.3 Shuffler for Dumps 2.0 pipelines.

!556 · created Dec 06, 2023 by Xcollazo
- Merged
- 3
- Approved
updated Dec 07, 2023
Update where we look for the linktarget table

!555 · created Dec 06, 2023 by Milimetric
- Merged
- 1
- Approved
updated Dec 07, 2023
Fix local docker run example on README.md

!554 · created Dec 06, 2023 by Xcollazo
- Merged
- 1
updated Dec 06, 2023
Fix CI pipelines by updating Miniconda

!553 · created Dec 04, 2023 by Aqu
- Merged
updated Dec 04, 2023
Test CI build

!552 · created Dec 04, 2023 by Xcollazo
- Closed
updated Dec 05, 2023
Draft: Xcollazo test branch

!551 · created Dec 04, 2023 by Xcollazo
- Closed
updated Dec 04, 2023
Webrequest: add metrics generation and quality check alerting dag.

!550 · created Dec 01, 2023 by Gmodena
- Merged
- 16
- Approved
updated Jan 19, 2024
Provide Airflow metrics development environment

!549 · created Nov 30, 2023 by Aqu
- Merged
- Approved
updated Dec 06, 2023
Add the sasl module to the pip environment

!548 · created Nov 27, 2023 by Btullis
- Closed
- 3
- Approved
updated May 09, 2024
Update to airflow-2.7.3 and install statsd support

!547 · created Nov 20, 2023 by Btullis
- Closed
updated Dec 05, 2023
Add wmf_readership hive table to datahub ingestion

!546 · created Nov 17, 2023 by Joal
- Merged
- Approved
updated Nov 17, 2023
switch druid host to index to the druid-public cluster and datahub injestion.

!544 · created Nov 17, 2023 by Stevemunene
- Merged
- Approved
updated Nov 22, 2023
Replace an-druid1001 by an-druid1002 in druid connection strings

!543 · created Nov 17, 2023 by Brouberol
- Merged
- Approved
updated Nov 17, 2023
Add brokers to the connection string and disable stateful ingestion

!542 · created Nov 17, 2023 by Brouberol
- Merged
- 1
- Approved
updated Nov 17, 2023
Allow datasets.yaml files to be empty

!541 · created Nov 10, 2023 by Mforns
- Merged
- Approved
updated Nov 14, 2023
search: clean wcqs revision map

!540 · created Nov 10, 2023 by DCausse
- Merged
- 1
updated Nov 14, 2023
search: Set group ownership of processed sparql queries

!539 · created Nov 08, 2023 by Ebernhardson
- Merged
- 2
updated Nov 08, 2023

Admin message

Admin message

Admin message