Skip to main content

52 posts tagged with "fusion"

View All Tags

Fusion v2.5.11

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.11-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.11-arm64.json'.

Bug fixes​

AWS​

  • Added support for prefix-restricted S3 bucket policies.
  • Improved S3 bucket region detection with a fallback chain instead of defaulting to eu-west-1.

Azure​

  • Changed reads of an Azure Archive tier blob to return a "resource archived" error instead of a generic cloud provider error.
  • Fixed symlink compaction failing for files between 256 MiB and 4 GiB.

General​

  • Removed an unnecessary truncate before each append-mode write.
  • Fixed a NoSuchKey crash when an application renames a file and immediately creates a new one at the same path.
  • Fixed partial chunk uploads producing incomplete or corrupted objects.
  • Fixed symlinks being served as a short path string instead of the file content when symlink compaction failed.

fusion-tracer​

  • Removed spurious Failed to fetch entry size and Failed to load file metadata errors.
  • Built fusion-tracer against glibc 2.17 so it runs on container images with glibc 2.17 or later and loads the NVIDIA management library on GPU nodes.

Dependencies​

  • Updated CI and build dependencies.

Upgrade notes​

  • Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.4.21

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.21-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.21-arm64.json'.

Bug fixes​

General​

  • Fixed "entry not found" errors when reading a file after a rename where the new name is a prefix of the old name.
  • Fixed fchmod() failures on temporary files that were unlinked while still open, such as bash heredoc files.
  • Removed the dependency on the fusermount binary for unmounting, and fixed Fusion exiting with EINVAL during Spot instance reclamation.
  • Fixed a crash when a root CA certificate bundle contained invalid PEM data.

Logging​

  • Demoted license-related error messages to debug level.

Upgrade notes​

  • Drop-in replacement for v2.4.x. No configuration changes required.

Fusion v2.5.10

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.10-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.10-arm64.json'.

Feature updates and improvements​

Fusion Snapshots​

  • Added Spot interruption handling on Amazon ECS. On ECS, Spot interruptions arrive as signals rather than through a metadata endpoint. Fusion intercepts the signal and stops it from reaching child processes, which gives the snapshot time to complete.

fusion-tracer​

  • Added process metrics collection. The tracer records CPU, memory, I/O, context switches, cgroup statistics, and GPU metrics, and writes a .fusion/trace.json file when FUSION_WORK is set. Polling intervals adapt to load and metrics are aggregated across the process tree.

Logging​

  • Added the available disk space range to the task completion output. Use it to check cache storage capacity.

Bug fixes​

General​

  • Fixed incorrect byte ranges during multipart compose and copy operations on AWS S3, Azure Blob Storage, and Google Cloud Storage.
  • Fixed fchmod() failures on temporary files that were unlinked while still open, such as bash heredoc files.
  • Removed the dependency on fusermount for unmounting, and fixed Fusion exiting with an error during Spot instance reclamation.
  • Fixed a crash when a root CA certificate contained invalid PEM data.

Logging​

  • Demoted license-related messages to debug level.

Dependencies​

  • Bumped the Go toolchain from 1.24.8 to 1.24.13.
  • Updated CI and build dependencies.

Upgrade notes​

  • Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.4.20

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.20-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.20-arm64.json'.

Feature updates and improvements​

Fusion Snapshots​

  • Added support for Fusion Snapshots in Google Batch. See Fusion Snapshots for more information.
  • Added cleanup for dump folder following Spot termination to prevent unwanted storage costs.

Logging​

  • Better log readability: Added [seqera-fusion] prefix to console logs for easier identification in mixed output environments.
  • Improved error messages: Added more context and clearer wording to cloud provider errors, including better messages for archived/cold storage objects.

Troubleshooting​

Bug fixes​

AWS​

  • Fixed misleading "file not found" errors: Changed permission errors (403 Forbidden) from cloud providers to display as "Permission denied" instead of incorrectly showing "No such file or directory" (#1068).

General​

  • Cloud errors now log properly: Fixed an issue where cloud service errors were silently treated as simple "file not found" cases instead of logging and reporting properly (#1077).

Upgrade notes​

  • Drop-in replacement for v2.4.x. No configuration changes required.

Fusion v2.5.9

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.9-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.9-arm64.json'.

Feature updates and improvements​

Fusion Snapshots​

  • Added support for Fusion Snapshots in Google Batch. See Fusion Snapshots for more information.
  • Added cleanup for dump folder following Spot termination to prevent unwanted storage costs.

Logging​

  • Branded console logs: Added [seqera-fusion] prefix to all console logs for better identification in mixed output environments.
  • Real-time terminal output: Changed command output to display immediately in the terminal instead of buffering, improving visibility during execution.
  • Clearer error messages: Improved error messaging for non-recoverable I/O errors and archived objects.

Troubleshooting​

Bug fixes​

AWS​

  • Fixed AWS S3 Forbidden errors not mapping properly to permission denied.

General​

  • Fixed cloud storage errors not logging properly in certain scenarios.

Upgrade notes​

  • Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.4.19

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.19-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.19-arm64.json'.

Feature updates and improvements​

Snapshots​

  • Platform-specific snapshot detection: Added instance type detection for granular snapshot support; updated Fusion Snapshots to v1.8.0.
  • Incremental dumps enabled by default: Snapshots incremental dumps now run automatically.

GPU​

  • GPU tracer backport: Backported GPU tracer feature from master.

Bug fixes​

General​

  • Idempotent Remove operations: Fixed race conditions in concurrent rename operations by making Remove() idempotent across all cloud providers (GCS, S3, Azure)

Upgrade notes​

Drop-in replacement for v2.4.x. No configuration changes required.

Fusion v2.5.8

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.8-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.8-arm64.json'.

Feature updates and improvements​

Snapshots​

  • Platform-specific snapshot detection: Added instance type detection for granular snapshot support; updated Fusion Snapshots to v1.8.0.
  • Incremental dumps enabled by default: Snapshots incremental dumps now run automatically with a 5-minute timer.

GPU​

  • GPU tracer improvements: Consistent logging, --no-color flag support, and enabled by default in containers.

Bug fixes​

General​

  • Race condition fix: Prevented data loss from concurrent Unlink() and Mknod() operations on the same path.

Upgrade notes​

Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.5.7

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.7-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.7-arm64.json'.

Critical bug fixes​

Google Cloud​

GCS compose conflicts

  • Fixed concurrent compose operation conflicts in Google Cloud Storage.
  • When multiple Fusion instances compose the same target file concurrently (e.g., with Nextflow job arrays where all array jobs overwrite .exitcode), temporary objects created during composition could conflict.
  • Prevents conflicts when concurrent instances attempt to create, use, or delete the same temporary files.

Upgrade notes​

Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.5.6

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.6-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.6-arm64.json'.

Feature updates and improvements​

GPU​

  • GPU Usage Monitoring
    • New fusion-gpu-checker utility for monitoring GPU usage by processes.
    • Optional integration via environment variables.

Google Cloud​

  • GCP Batch support
    • Added support for Google Batch with Fusion Snapshots 1.7.0.

Dependencies​

  • Bumped golangci-lint-action: 8.0.0 → 9.0.0
  • Bumped actions/upload-artifact: 4.6.2 → 5.0.0
  • Bumped actions/download-artifact: 5.0.0 → 6.0.0
  • Bumped astral-sh/setup-uv: 6 → 7

Critical bug fixes​

Azure​

Azure Directory detection

  • Fixed "Is a directory" errors in hierarchical namespace containers (Data Lake Gen2).
  • Fixed files incorrectly treated as directories causing workflow failures.

General​

Context cancellation

  • Fixed critical operations failing mid-execution due to FUSE context cancellation.
  • Prevented data corruption, ghost files, and orphaned S3 objects.
  • Operations now complete reliably despite client disconnections.

Symlink compaction deadlocks

  • Fixed deadlock in entryService shutdown with symlink compaction.
  • Ensured target directory population before compaction.

Other improvements​

General​

Reliability

  • Fixed race condition in directory iteration.
  • Fixed write lock acquisition condition reevaluation.
  • Added comprehensive lock documentation.

Testing and CI

  • Pinned Nextflow to 25.04.8.
  • Updated license test certificates (40-year expiration).
  • Added GPU tracer test coverage.

Upgrade notes​

Drop-in replacement for v2.5.x. No configuration changes required.

Fusion v2.4.18

How to pin this version​

fusion {
enabled = true
containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.18-amd64.json'
}
info

For ARM64 CPU architecture, use containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.18-arm64.json'.