Release Notes 1.0

What's Changed

ADBC Parquet Export - 2x Faster Performance

FastBCP now supports ADBC (Arrow Database Connectivity) for Parquet exports via the -C adbc_mssql connector, powered by ArrowTDS.

Performance improvements:

• 2x faster Parquet generation compared to traditional methods
• Native columnar data format (Arrow) eliminates conversion overhead
• Optimized for SQL Server data types

Usage:

fastbcp -S myserver.database.windows.net \
    -d MyDatabase \
    -Q "SELECT * FROM Sales.Orders" \
    -C adbc_mssql \
    --fileoutput "orders.parquet"

See Connection Parameters documentation for more details.

Buffered Cloud Uploads

New environment variables enable buffered cloud uploads for significantly improved Azure Data Lake Storage and OneLake performance.

New environment variables:

• FASTBCP_CLOUD_ISBUFFERED: When True, ADLS/OneLake writes are buffered to a local temp file, then uploaded in parallel on stream dispose (azcopy-like pattern). When False, the SDK's OpenWriteAsync streaming upload is used.
• FASTBCP_TMPPATH: Base directory for temporary files created during buffered cloud uploads. Default: System temp (%TEMP% / $TMPDIR).
• FASTBCP_CLOUD_MAXUPLOADTHREAD_PER_STREAM: Maximum number of parallel upload threads per cloud stream. Default: 8 if parallelmethod=None, 2 otherwise.
• FASTBCP_UID_STRING_CASING: Controls UID-to-string casing. Values: lower or upper. Default: lower (RFC 4122).

Example — Buffered cloud uploads:

# Enable buffered uploads for Azure
$env:FASTBCP_CLOUD_ISBUFFERED = "True"
$env:FASTBCP_TMPPATH = "D:\temp\fastbcp"

fastbcp -S myserver -d MyDB -T Sales.Orders `
    --fileoutput "abfss://container@storage.dfs.core.windows.net/orders.parquet"

Example — UID string casing (PowerShell):

# Output UIDs in uppercase
$env:FASTBCP_UID_STRING_CASING = "upper"

fastbcp -S myserver -d MyDB -T MyTable --fileoutput "output.parquet"

Example — UID string casing (Linux):

# Output UIDs in uppercase
export FASTBCP_UID_STRING_CASING=upper

fastbcp -S myserver -d MyDB -T MyTable --fileoutput "output.parquet"

See the Environment Variables documentation for detailed configuration.

Move to .NET 10

FastBCP now runs on .NET 10:

• Performance improvements in runtime and GC
• Enhanced security and stability
• Continued long-term support
• Compatibility: Windows, Linux, macOS (x64, ARM64)

Improved SBOM Generation

Enhanced Software Bill of Materials (SBOM) generation for better supply chain security and compliance.

SLSA Build Provenance

Added SLSA (Supply-chain Levels for Software Artifacts) build provenance in CI for enhanced supply chain security and compliance.

Early Cleanup of Temp Files

When uploading to cloud storage, temporary files are now cleaned up earlier in the process to reduce disk space requirements.

ArrowTDS ARPE.IO Driver

FastBCP 1.0 includes the ArrowTDS ARPE.IO driver for high-performance ADBC connectivity.

Key features:

• TDS 7.4 protocol compatibility
• Native Arrow columnar format support
• Optimized for SQL Server 2012 and later