Merge requests · repos / data-engineering / Airflow DAGs · GitLab

How to register an account on GitLab. Due to spam, new accounts are locked until approved by an admin or the approver bot. Your GitLab account gets automatically approved within one hour if you are a member of Trusted Contributors in Gerrit, or a member of the Trusted-Contributors group in Phabricator and linked your Developer account to your Phabricator account. If none of these apply, you can file an unlock request to expedite access.

Support: mw:GitLab, how to host a project on GitLab, #wikimedia-gitlab on libera.chat, #GitLab on Phabricator.

🚨THIS IS A REPLICA🚨 -- You probably want to use the production gitlab, https://gitlab.wikimedia.org. Data on this instance is likely to be overwritten at short notice. Login with hardware 2FA key does not work, please use one-time passwords.

operator/datahub: set REQUESTS_CA_BUNDLE to include our custom CA cert bundle

!763 · created Jul 18, 2024 by Brouberol
- Merged
- 3
- Approved
updated Jul 18, 2024
Update the canary_events DAG to use an updated refinery version

!762 · created Jul 17, 2024 by Btullis
- Merged
- 1
updated Jul 17, 2024
Update commons_category_allow_list.tsv

!760 · created Jul 16, 2024 by GFontenelle
- Merged
- Approved
updated Jul 16, 2024
editor_month: Switch to new SQL query

!751 · created Jul 05, 2024 by Neil Shah-Quinn (WMF)
- Merged
- 1
updated Jul 15, 2024
research:article-topics: drop old snapshots eventually

!758 · created Jul 12, 2024 by Muniza
- Merged
- 2
- Approved
updated Jul 15, 2024
analytics: datahub: update api endpoint.

!757 · created Jul 11, 2024 by Gmodena
- Merged
- Approved
updated Jul 11, 2024
search: stop using api-ro.discovery.wmnet

!756 · created Jul 11, 2024 by DCausse
- Merged
updated Jul 11, 2024
research:article-topics: update model url and create table if not exists

!749 · created Jul 04, 2024 by Muniza
- Merged
- 2
- Approved
updated Jul 10, 2024
Bump image-suggestions to 0.19.0-v0.19.0.

!753 · created Jul 08, 2024 by Ghost User
- Merged
updated Jul 08, 2024
Bump mediacounts_archive_daily executor RAM from 4GB to 6GB

!752 · created Jul 08, 2024 by Btullis
- Merged
- 2
- Approved
updated Jul 08, 2024
Publish survey folder

!748 · created Jul 03, 2024 by Fabian Kaelin
- Merged
updated Jul 05, 2024
Change the DAGs to run on /tmp/wmde in production instead of /wmf/tmp 7 of 7 checklist items completed

!750 · created Jul 05, 2024 by Andrew McAllister (WMDE)
- Merged
- 1
updated Jul 05, 2024
WD sitelink segments dag + add published datasets to output targets 7 of 7 checklist items completed

!700 · created May 17, 2024 by Andrew McAllister (WMDE)
- Merged
- 4
updated Jul 05, 2024
Set sensor timeout to 14 days for mediawiki_wikitext_current

!741 · created Jun 26, 2024 by Xcollazo
- Merged
- Approved
updated Jun 27, 2024
Use refinery job jar v0.2.43 containing fix for MediawwikiHistory duplicate checker

!744 · created Jun 27, 2024 by Snwachukwu
updated Jun 27, 2024
Update instructions for setting up environment on Macs

!698 · created May 16, 2024 by Bearloga
- Merged
- 1
- Approved
updated Jun 26, 2024
Use a temporary folder inside the temporary Airflow home folder

!740 · created Jun 25, 2024 by Aleksandar Mastilovic
- Merged
- 7
- Approved
updated Jun 26, 2024
Update mediawiki checker to use refinery job jar v0.2.43

!739 · created Jun 24, 2024 by Snwachukwu
- Merged
- 1
updated Jun 26, 2024
research: switch DAGs over to using pydantic models for pipeline args

!737 · created Jun 20, 2024 by Muniza
- Merged
- 9
- Approved
updated Jun 25, 2024
datahub: rely on the datahub GMS discovery URL

!736 · created Jun 19, 2024 by Brouberol
- Merged
- Approved
updated Jun 19, 2024

Prev
1
…
5
6
7
8
9
10
11
12
13
…
43
Next