Changelog: Fusion

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.14-amd64.json'
}

Feature updates and improvements​

• Added exponential backoff retries to Azure Blob Storage.
• Added fallback to use AZ_BATCH_TASK_WORKING_DIR as FUSION_CACHE_LOCATION.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.3-amd64.json'
}

Feature updates and improvements​

• Added a warning for expected Spot termination.
• Enabled Fusion FS + Fusion Snapshots publish on ARM architecture.
• Added Snapshots-enabled ARM builds.
• Added env variables to disable pattern matching.
• Added the ability to track "in progress" uploads to prevent duplicates.
• Removed timers governing chunk uploads.
• Added functionality to generate post-mortem runtime traces if requested.
• Added an add exponential backoff retry strategy for Azure Blob Storage.
• Added an option to send logs to a remote IP.
• Bumped fusion-snapshots to 1.3.0
• Upgraded golangci.yml to version 2
• Bumped github.com/go-jose/go-jose/v4 from 4.0.4 to 4.0.5
• Bumped golangci/golangci-lint-action from 7.0.0 to 8.0.0

Bug fixes​

• Added a fix to suppress excessive checksum validation warnings.
• Fixed empty chunk allocation for file gaps.
• Fixed race conditions when flushing chunks.
• Solved a bug that caused the SpanExporter to always be NoOp.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.13-amd64.json'
}

Feature updates and improvements​

• Bumped Fusion Snapshots v1.2.0 to add ARM support.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.12-amd64.json'
}

Feature updates and improvements​

• Bumped Fusion Snapshot to 1.1.0.
• Fixed warning on Spot reclaim.

Bug fixes​

• Ensure unlock function matches mutex type.
• Fix EISDIR on Azure accounts with hieararchical namespaces enabled.

Fusion Snapshot 1.1.0 changelog​

• Return a specific error code (175) on failed restore.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.2-amd64.json'
}

Feature updates and improvements​

• Added ability to generate post-mortem pprof profile data.
• Added ability to enable monitoring of goroutines and memory usage.
• Added goroutine ID to log messages.
• Added support for authenticating with Azure Managed Identities.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.1-amd64.json'
}

Bugfix release to improve stability.

Bug fixes​

• Fixed logs removed when removeLogs is false.
• Unique IDs in file fragments.
• Remove exit code on serveFusion.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.0-amd64.json'
}

Fusion 2.5.0 significantly enhances performance and efficiency in file operations.

Fusion now handles small files more effectively and intelligently manages Nextflow task files by minimizing intermediate file uploads. A key improvement is the selective retention of only essential task output files upon completion, reducing storage overhead. Network optimization decreases bandwidth usage by consolidating upload operations. Additionally, the underlying architecture has substantial refactoring to support the future integration of diverse remote storage solutions, setting the foundation for expanded storage capabilities.

Feature updates and improvements​

• Chunked async content management.
• Nextflow-compatible pattern classifier.
• Define a default exit code on Fusion-IO errors.
• Object API refactoring.
• Bump golang.org/x/crypto to 0.31.0
• Bump golang.org/x/net to 0.33.0

Bug fixes​

• AsyncStore move issues.
• Log file deletion during Spot instance reclamation.
• Transient object persistence.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.8-amd64.json'
}

Bugfix release to improve stability.

Bug fixes​

• Do not delete the logs file during spot reclaim.
• Upload logs file in parts to support files larger than 5 GB.
• Remove leftover .bak file when using BAM and Tabix index.
• Bump golang.org/x/crypto from 0.25.0 to 0.31.0

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.7-amd64.json'
}

Feature updates and improvements​

• Add license validation.
• Integrate Fusion Snapshots.
• Make stopFusion timeout configurable (via FUSION_STOP_SHUTDOWN_TIMEOUT).

Bug fixes​

• Fusion shutdown only once.
• File moves overwriting files scheduled for upload.
• Force unmount and upload dirty manager on failed unmount.
• Correct spot instance termination metadata path.
• Error when overwriting a symbolic link.
• Add a timeout to Fusion stop function.
• Upload symbolic links in parallel.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.3.8-amd64.json'
}

Bug fixes​

• Fix security vulnerabilities.