Package config files / tests / use CI built conda env
- merges !9 (merged) with main
- adds the configuration files as
package_data
and helper methods to load them viaimport_lib
- tests for loading configuration files
I manually triggered the conda env CI which produced https://gitlab.wikimedia.org/repos/research/knowledge-gaps/-/package_files/549/download, and I tested using this url directly as archives
argument in the spark-submit
command, which seems to work. See the commands in the readme.
@aikochou, there are no functional changes in this MR; there might be a regression on the code path reading the config files in content_features.py
, but the config loading itself works as intended. Note that this MR is against your branch, not main; feel free to merge it at your leisure.