51 posts tagged with "fusion"

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.16-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Added Google Batch (GCP) support for snapshots.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.5-amd64.json'
}

Feature updates and improvements​

Release v2.5.5 with GCP snapshot support, critical race condition fixes, dependency updates, and improved reliability.

Snapshots​

• GCP Snapshot support: Add Google Batch (GCP) support for snapshots with comprehensive compute environment detection and metadata client integration.
• Snapshot version: Bump fusion-snapshot to v1.7.0 with GCP support.

Configuration​

• Locking documentation: Add comprehensive lock documentation to entryService including invariants, lock upgrade patterns, and TOCTOU prevention.
• Preemption handling: Improve logging and handling of instance reclamation/spot termination events.
• Nextflow pinning: Pin Nextflow to 25.04.8 in CI to work around AWS authentication issues in 25.10.0.

Dependencies​

• Bumped AWS SDK v2 components (1.19.11 → 1.19.13, 1.88.3 → 1.88.5, etc.)
• Bumped Azure SDK for Go (1.6.2 → 1.6.3, azidentity 1.12.0 → 1.13.0)
• Bumped Google APIs (0.251.0 → 0.252.0)
• Bumped golang.org/x/sys (0.36.0 → 0.37.0)
• Bumped failsafe-go (0.9.0 → 0.9.1)

Critical fixes​

General​

• Race Condition Fixes:
  • Resolve multiple race conditions in entry service operations.
  • Fix directory iteration race by consolidating lock scope.
  • Add lock condition re-evaluation after write lock acquisition to prevent TOCTOU issues.
• Priority test reliability: Improve TestBandwidthExecutor/PriorityExecution statistical reliability by increasing buffer and task counts.
• Directory operations: Ensure rmdir() properly fails on non-empty directories.
• License tests: Update test certificates to expire in 40 years (2065) to prevent test failures.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.15-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Added incremental dumps on 2.4.
• Bumped snapshots to 1.6.0 in 2.4.15

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.4-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Added incremental dumps.
• Updated fusion snapshots to 1.6.0

Configuration​

• Added support for checksum algorithm.
• Added ability to disable OTEL machinery if tracing not enabled.
• Added fallback to use AZ_BATCH_TASK_WORKING_DIR as FUSION_CACHE_LOCATION.

Dependencies​

• Bumped github.com/docker/docker from 28.2.2+incompatible to 28.3.3+incompatible
• Bumped hoverkraft-tech/compose-action from 2.3.0 to 2.4.0
• Bumped google.golang.org/grpc from 1.75.0 to 1.75.1
• Bumped actions/download-artifact from 4.3.0 to 5.0.0
• Bumped insightsengineering/coverage-action from 2.7.2 to 3.0.1

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.14-amd64.json'
}

Feature updates and improvements​

Azure​

• Added exponential backoff retries to Azure Blob Storage.
• Added fallback to use AZ_BATCH_TASK_WORKING_DIR as FUSION_CACHE_LOCATION.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.3-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Enabled Fusion FS + Fusion Snapshots publish on ARM architecture.
• Added Snapshots-enabled ARM builds.
• Bumped fusion-snapshots to 1.3.0

Performance​

• Added the ability to track "in progress" uploads to prevent duplicates.
• Removed timers governing chunk uploads.

Azure​

• Added an add exponential backoff retry strategy for Azure Blob Storage.

Configuration​

• Added a warning for expected Spot termination.
• Added env variables to disable pattern matching.
• Added functionality to generate post-mortem runtime traces if requested.

Logging​

• Added an option to send logs to a remote IP.

Dependencies​

• Upgraded golangci.yml to version 2
• Bumped github.com/go-jose/go-jose/v4 from 4.0.4 to 4.0.5
• Bumped golangci/golangci-lint-action from 7.0.0 to 8.0.0

Bug fixes​

General​

• Added a fix to suppress excessive checksum validation warnings.
• Fixed empty chunk allocation for file gaps.
• Fixed race conditions when flushing chunks.
• Solved a bug that caused the SpanExporter to always be NoOp.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.13-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Bumped Fusion Snapshots v1.2.0 to add ARM support.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.12-amd64.json'
}

Feature updates and improvements​

Snapshots​

• Bumped Fusion Snapshot to 1.1.0.

Configuration​

• Fixed warning on Spot reclaim.

Bug fixes​

Azure​

• Fixed EISDIR on Azure accounts with hieararchical namespaces enabled.

General​

• Fixed unlock function to match mutex type.

Fusion Snapshot 1.1.0 changelog​

Snapshots​

• Returns a specific error code (175) on failed restore.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.5.2-amd64.json'
}

Feature updates and improvements​

Azure​

• Added support for authenticating with Azure Managed Identities.

Logging​

• Added goroutine ID to log messages.

Configuration​

• Added ability to generate post-mortem pprof profile data.
• Added ability to enable monitoring of goroutines and memory usage.

How to pin this version​

fusion {
  enabled = true
  containerConfigUrl = 'https://fusionfs.seqera.io/releases/v2.4.10-amd64.json'
}

Bug fixes​

Azure​

• Fixed concurrent access to Azure client caches.

General​

• Fixed data corruption when renaming a file onto a path that still had active uploads.
• Fixed endless log uploads when the logs file was written to concurrently.
• Fixed .fusion.symlinks being uploaded when its contents had not changed.