Skip to content

Move anomaly_detection jobs to spark3

Joal requested to merge spark3_anomaly_detection into main
  • Update factory to differenciate between dag_id and processed dataset
  • Move DAG factory to the DAG folder as it is not reused
  • Use spark3 default_args in dags
  • Use refinery-job v0.2.1 in dags
  • Add minimal test for each dag
Edited by Joal

Merge request reports