Skip to content

comet_ml.integration.metaflow ¶

comet_flow ¶

comet_flow(func=None, **kwargs)

This decorator placed before your Flow class allows you to track each step of your flow in a separate comet experiment.

Parameters:

  • project_name (str) –

    Send your experiment to a specific project. Otherwise will be sent to Uncategorized Experiments. If project name does not already exists Comet.ml will create a new project.

  • workspace (str) –

    Attach an experiment to a project that belongs to this workspace

Example
1
2
3
4
5
@comet_flow(project_name="comet-example-metaflow-hello-world")
class HelloFlow(FlowSpec):
    @step
    def start(self):
        ...

comet_skip ¶

comet_skip(metaflow_step)

Add this decorator to prevents the step from being tracked by comet. This is useful for join steps or foreach step with a high number of iterations. Order is important - it must be placed above the @step decorator.

Read the documentation for more details.

Example
1
2
3
4
5
6
@comet_flow
class HelloFlow(FlowSpec):
    @comet_skip
    @step
    def start(self):
        ...
Sep. 30, 2024