Skip to content
This repository has been archived by the owner on Nov 29, 2023. It is now read-only.

Enable the use of requirements.txt files to specify stage dependencies #192

Open
AlexIoannides opened this issue Jul 5, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@AlexIoannides
Copy link
Contributor

"As a ML Engineer, I would like to be able to specify the requirement for a pipeline stage by referencing a requirements.txt file, so that I do not have to specify requirements in YAML that can be very clunky and lead to bloated bodywork.yaml files."

Tasks

  • Extend the YAML schema defined in bodywork.config so that a path to a requirements.txt files can be specified for each stage's dependencies, that overrides any other dependency.
  • Extend the validation of bodywork.yaml so that it can check for the existence of any requirements.txt files.
  • Extend bodywork.stage_execution so that it can install requirements from the requirements.txt files provided in the config.
  • Add unit tests to cover this new functionality.
@AlexIoannides AlexIoannides added the enhancement New feature or request label Jul 5, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant