Release Notes 1.0
What's Changed
ADBC Parquet Export - 2x Faster Performance
FastBCP now supports ADBC (Arrow Database Connectivity) for Parquet exports via the -C adbc_mssql connector, powered by ArrowTDS.
Performance improvements:
- 2x faster Parquet generation compared to traditional methods
- Native columnar data format (Arrow) eliminates conversion overhead
- Optimized for SQL Server data types
Usage:
fastbcp -S myserver.database.windows.net \
-d MyDatabase \
-Q "SELECT * FROM Sales.Orders" \
-C adbc_mssql \
--fileoutput "orders.parquet"
See Connection Parameters documentation for more details.
Buffered Cloud Uploads
New environment variables enable buffered cloud uploads for significantly improved Azure Data Lake Storage and OneLake performance.
New environment variables:
FASTBCP_CLOUD_ISBUFFERED: WhenTrue, ADLS/OneLake writes are buffered to a local temp file, then uploaded in parallel on stream dispose (azcopy-like pattern). WhenFalse, the SDK'sOpenWriteAsyncstreaming upload is used.FASTBCP_TMPPATH: Base directory for temporary files created during buffered cloud uploads. Default: System temp (%TEMP%/$TMPDIR).FASTBCP_CLOUD_MAXUPLOADTHREAD_PER_STREAM: Maximum number of parallel upload threads per cloud stream. Default:8ifparallelmethod=None,2otherwise.
Example:
# Enable buffered uploads for Azure
$env:FASTBCP_CLOUD_ISBUFFERED = "True"
$env:FASTBCP_TMPPATH = "D:\temp\fastbcp"
fastbcp -S myserver -d MyDB -T Sales.Orders `
--fileoutput "abfss://container@storage.dfs.core.windows.net/orders.parquet"
See the Environment Variables documentation for detailed configuration.
Move to .NET 10
FastBCP now runs on .NET 10:
- Performance improvements in runtime and GC
- Enhanced security and stability
- Continued long-term support
- Compatibility: Windows, Linux, macOS (x64, ARM64)
Improved SBOM Generation
Enhanced Software Bill of Materials (SBOM) generation for better supply chain security and compliance.
SLSA Build Provenance
Added SLSA (Supply-chain Levels for Software Artifacts) build provenance in CI for enhanced supply chain security and compliance.
Early Cleanup of Temp Files
When uploading to cloud storage, temporary files are now cleaned up earlier in the process to reduce disk space requirements.
ArrowTDS ARPE.IO Driver
FastBCP 1.0 includes the ArrowTDS ARPE.IO driver for high-performance ADBC connectivity.
Key features:
- TDS 7.4 protocol compatibility
- Native Arrow columnar format support
- Optimized for SQL Server 2012 and later