BugdrLog in
All problems
MediumPythonBackend Engineer · argo-workflows · conditional-branching · dag · python · workflow-orchestration

Argo conditional input path selection

★ 0.0 (0 ratings)60 min0 engineers solved this

Your assignment

This repository is a Python framework for building data workflows as graphs of steps. A flow is a class whose methods are steps connected by self.next(...) calls, and branching is expressed with conditional transitions. The Argo Workflows plugin compiles a flow into an Argo WorkflowTemplate where each step becomes a container template and the DAG edges become task dependencies. When a step has several predecessors, its container runs a small helper script that receives the base64-encoded, compressed list of predecessor task pathspecs (with unresolved placeholders for predecessors that never ran) and a comma-separated list of the predecessor step names that are conditional switch steps. The helper filters that list and prints the pathspecs the step should load its artifacts from. The plugin builds these lists from the flow graph, and the runtime uses the printed pathspecs to restore state.

What the team is seeing

incident log
In some workflows with several optional branches before a final step, results gathered in earlier steps go missing by the time the last step runs. The same workflow produces the complete results when it is run on a developer machine.

Acceptance checks 1

  • Check 1

Discussion is locked — log in and complete this problem to join the discussion and rate your experience.