Skip to main content

tw pipelines

Run tw pipelines -h to view the list of supported operations.

Pipelines define pre-configured workflows in a workspace. A saved pipeline includes the repository source, launch parameters, compute environment, and, in newer Platform releases, optional persisted schemas and multiple saved versions.

Pipeline versioning

Seqera Platform CLI 0.24 adds support for pipeline versioning workflows:

  • create a saved pipeline with an initial version name
  • list saved versions for a pipeline
  • target a specific version by --version-id or --version-name
  • promote a version to default
  • update a versionable field and let Platform create a new version

tw pipelines list

List pipelines.

tw pipelines list [OPTIONS]

Options

OptionDescriptionRequiredDefault
-f, --filterShow only pipelines that contain the given wordNonull
--visibilityShow pipelines: OWNER, MEMBER, COLLABORATOR [default: private].Noprivate
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID
--pagePage number for paginated results (default: 1)Nonull
--offsetRow offset for paginated results (default: 0)Nonull
--maxMaximum number of records to displayNonull

Example

tw pipelines list -w 123456789012345

Example output:

  Pipelines at [my-organization-updated / my-workspace] workspace:


ID | Name | Repository | Visibility
-----------------+----------------------+--------------------------------------+------------
777888999000111 | rnaseq4 | https://github.com/nf-core/rnaseq | SHARED
888999000111222 | nf-core-rnaseq | https://github.com/nf-core/rnaseq | SHARED
999000111222333 | rnaseq2 | https://github.com/nf-core/rnaseq | SHARED
555666777888999 | nextflow-hello-saved | https://github.com/nextflow-io/hello | SHARED
000111222333444 | rnaseqapitest | https://github.com/nf-core/rnaseq | SHARED
111222333444555 | rnaseq3 | https://github.com/nf-core/rnaseq | SHARED

tw pipelines add

Add a pipeline.

tw pipelines add [OPTIONS] <repository-url>

Options

OptionDescriptionRequiredDefault
-n, --namePipeline name. Must be unique within the workspace.Yesnull
<repository-url>Pipeline repository URL. Must be a full Git repository URL.Yesnull
-d, --descriptionPipeline description.Nonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID
--labelsLabels to apply to the resource. Provide comma-separated label values (use key=value format for resource labels). Labels will be created if they do not exist.Nonull
--version-nameInitial pipeline version name.Nonull
--pipeline-schema-idPipeline schema identifier to attach to the saved pipeline.Nonull
-c, --compute-envCompute environment identifier where the pipeline will run. Defaults to workspace primary compute environment if omitted. Provide the name or identifier.Nonull
--work-dirWork directory path where workflow intermediate files are stored. Defaults to compute environment work directory if omitted.Nonull
-p, --profileArray of Nextflow configuration profile names to apply.Nonull
--params-filePipeline parameters in JSON or YAML format. Provide the path to a file containing the content.Nonull
--revisionGit revision, branch, or tag to use. Use --commit-id to pin a specific commit within that revision.Nonull
--commit-idSpecific Git commit hash to pin the saved pipeline to.Nonull
--configNextflow configuration as text (overrides config files). Provide the path to a file containing the content.Nonull
--pre-runAdd a script that executes in the nf-launch script prior to invoking Nextflow processes. See: https://docs.seqera.io/platform-cloud/launch/advanced#pre-and-post-run-scripts. Provide the path to a file containing the content.Nonull
--post-runAdd a script that executes after all Nextflow processes have completed. See: https://docs.seqera.io/platform-cloud/launch/advanced#pre-and-post-run-scripts. Provide the path to a file containing the content.Nonull
--pull-latestPull the latest version of the pipeline from the repository.Nonull
--stub-runExecute a stub run for testing (processes return dummy results).Nonull
--main-scriptAlternative main script filename. Default: main.nf.Nonull
--entry-nameWorkflow entry point name when using Nextflow DSL2.Nonull
--schema-nameName of the pipeline schema to use.Nonull
--user-secretsArray of user secrets to make available to the pipeline.Nonull
--workspace-secretsArray of workspace secrets to make available to the pipeline.Nonull

Example

tw pipelines add \
--name my-rnaseq \
--version-name v1.0 \
--pipeline-schema-id 98765 \
--revision main \
--commit-id a1b2c3d4e5f6a1b2c3d4e5f6a1b2c3d4e5f6a1b2 \
--params-file my-rnaseq-params.yaml \
-w 123456789012345 \
https://github.com/nextflow-io/rnaseq-nf

Example output:

New pipeline 'my-rnaseq' added at [my-organization / my-workspace] workspace

Use --pipeline-schema-id with a schema uploaded by tw pipeline-schemas add to make that schema part of the saved pipeline definition in Platform.

tw pipelines view

View pipeline details.

tw pipelines view [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
--version-idPipeline version identifierNonull
--version-namePipeline version nameNonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID

If no version is specified, view shows the default saved version.

Example

tw pipelines view -n my-rnaseq --version-name v1.0 -w 123456789012345

The output includes version metadata such as the version name, whether it is the default version, and the version hash, followed by the resolved launch configuration.

tw pipelines update

Update a pipeline.

tw pipelines update [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
--version-idPipeline version identifier to update. If omitted, the default saved version is updated.Nonull
--version-namePipeline version name to update. If omitted, the default saved version is updated.Nonull
-d, --descriptionPipeline descriptionNonull
--new-namePipeline new nameNonull
--pipelineNextflow pipeline URLNonull
--allow-draftIf versionable fields change, keep the new version as an unnamed draft instead of auto-naming and promoting it to default.Nofalse
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID
--pipeline-schema-idPipeline schema identifier to attach to the saved pipeline.Nonull
-c, --compute-envCompute environment identifier where the pipeline will run. Defaults to workspace primary compute environment if omitted. Provide the name or identifier.Nonull
--work-dirWork directory path where workflow intermediate files are stored. Defaults to compute environment work directory if omitted.Nonull
-p, --profileArray of Nextflow configuration profile names to apply.Nonull
--params-filePipeline parameters in JSON or YAML format. Provide the path to a file containing the content.Nonull
--revisionGit revision, branch, or tag to use. Use --commit-id to pin a specific commit within that revision.Nonull
--commit-idSpecific Git commit hash to pin the saved pipeline to.Nonull
--configNextflow configuration as text (overrides config files). Provide the path to a file containing the content.Nonull
--pre-runAdd a script that executes in the nf-launch script prior to invoking Nextflow processes. See: https://docs.seqera.io/platform-cloud/launch/advanced#pre-and-post-run-scripts. Provide the path to a file containing the content.Nonull
--post-runAdd a script that executes after all Nextflow processes have completed. See: https://docs.seqera.io/platform-cloud/launch/advanced#pre-and-post-run-scripts. Provide the path to a file containing the content.Nonull
--pull-latestPull the latest version of the pipeline from the repository.Nonull
--stub-runExecute a stub run for testing (processes return dummy results).Nonull
--main-scriptAlternative main script filename. Default: main.nf.Nonull
--entry-nameWorkflow entry point name when using Nextflow DSL2.Nonull
--schema-nameName of the pipeline schema to use.Nonull
--user-secretsArray of user secrets to make available to the pipeline.Nonull
--workspace-secretsArray of workspace secrets to make available to the pipeline.Nonull

Version-aware update behavior:

  • Non-versioned changes are applied in place.
  • Changing versioned launch fields such as repository revision can cause Platform to create a new saved version.
  • By default, the CLI auto-names that new version and promotes it to the default Launchpad version.
  • With --allow-draft, the CLI leaves the new version as a draft so you can manage it later with tw pipelines versions.

Example

tw pipelines update \
--name my-rnaseq \
--version-name v1.0 \
--revision release-branch \
--allow-draft

Example output:

Pipeline 'my-rnaseq' updated at [my-organization / my-workspace] workspace
New draft version 'draft789' created. Use 'tw pipelines versions' to manage it.

tw pipelines versions list

List saved pipeline versions.

tw pipelines versions list [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID
-f, --filterSearch pipeline versions by name prefix. Also supports keyword filters: versionName, versionId, versionHash.Nonull
--is-publishedShow only published pipeline versions if true, draft versions only if false, or all versions by default.Noall versions
--full-hashShow full-length hash values without truncation.Nofalse
--pagePage number for paginated results (default: 1)Nonull
--offsetRow offset for paginated results (default: 0)Nonull
--maxMaximum number of records to displayNonull

Example

tw pipelines versions list \
-n my-rnaseq \
--is-published true \
--full-hash

This command shows each version's ID, name, default status, hash, creator, and creation time.

tw pipelines versions manage

Manage a pipeline version name or default status.

tw pipelines versions manage [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID
--version-idPipeline version identifierNonull
--version-namePipeline version nameNonull
--new-nameNew name for the pipeline versionNonull
--set-defaultSet this version as the defaultNonull

Provide at least one of --new-name or --set-default.

Example

tw pipelines versions manage \
-n my-rnaseq \
--version-id 7TnlaOKANkiDIdDqOO2kCs \
--set-default \
--new-name v2.0

Example output:

Pipeline version '7TnlaOKANkiDIdDqOO2kCs' of pipeline 'my-rnaseq' updated at workspace [my-organization / my-workspace]

tw pipelines delete

Remove a pipeline.

tw pipelines delete [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID

Example

tw pipelines delete -n my-rnaseq -w 123456789012345

tw pipelines export

Export a pipeline.

tw pipelines export [OPTIONS] [FILENAME]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
--version-idPipeline version identifierNonull
--version-namePipeline version nameNonull
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID

If you do not provide a version selector, export uses the default saved version.

Example

tw pipelines export -n my-rnaseq --version-name v2.0 my-rnaseq-export.json

tw pipelines import

Add a pipeline from file content.

tw pipelines import [OPTIONS]

Options

OptionDescriptionRequiredDefault
-n, --namePipeline nameYesnull
-c, --compute-envCompute environment name (defaults to value defined in the JSON file)Nonull
--overwriteOverwrite the pipeline if it already exists.Nofalse
-w, --workspaceWorkspace numeric identifier or reference in OrganizationName/WorkspaceName format (defaults to TOWER_WORKSPACE_ID environment variable)NoTOWER_WORKSPACE_ID

Example

tw pipelines import -n my-rnaseq-imported -w 123456789012345 my-rnaseq-export.json

tw pipelines labels

Manage pipeline labels.

tw pipelines labels [OPTIONS]

Options

OptionDescriptionRequiredDefault
-i, --idPipeline identifierNonull
-n, --namePipeline nameNonull
--no-createAssign labels without creating the ones that were not found.Nonull
--operations, -oType of operation (set, append, delete) [default: set].Noset

Example

tw pipelines labels -n my-rnaseq -w 123456789012345 project=demo
tip

The --params-file flag is used to pass default launch parameters that are associated with the saved pipeline in the Launchpad.

tip

The --config file must use Nextflow configuration syntax.