azure-storage-net-data-movement

Azure Storage Data Movement Library for .Net

MIT License

Stars
276
Committers
21

Bot releases are hidden (Show)

azure-storage-net-data-movement - Storage Data Movement Library 0.6.3

Published by vinjiang about 7 years ago

2017.10.11 Version 0.6.3

  • All Services
    • Upgraded azure storage client library to 8.5.0
  • File Service
    • Support File Share Snapshot
azure-storage-net-data-movement - Storage Data Movement Library 0.6.2

Published by vinjiang about 7 years ago

2017.09.25 Version 0.6.2

  • All Services
    • Upgraded to Netstandard 2.0
    • Make the TransferException format consistent, now all TransferException with StorageException will have StorageException as inner exception.
      • The TransferException with following 2 error codes won't expose inner exception details in TransferException Message any more
        • UncategorizedException
        • FailToVadlidateDestination
      • The TransferException with following 3 error codes will have StorageException as inner exception if any
        • SourceDoesNotExistException
        • DestinationBlobTypeNotMatch
        • SourceBlobDoesNotExistException
azure-storage-net-data-movement - Storage Data Movement Library 0.6.1

Published by vinjiang about 7 years ago

2017.08.31 Version 0.6.1

  • All Services
    • Upgraded azure storage client library to 8.4.0
azure-storage-net-data-movement - Storage Data Movement Library 0.6.0

Published by vinjiang over 7 years ago

2017.07.14 Version 0.6.0

  • All Services
    • Upgraded azure storage client library to 8.1.4
    • Supported long path files in .Net and .Net Core.
    • Merged PR #76 to add a constructor for TransferStatus.
azure-storage-net-data-movement - Storage Data Movement Library 0.5.3

Published by vinjiang over 7 years ago

2017.06.01 Version 0.5.3

  • All Services
    • Upgraded azure storage client library to 8.1.3
azure-storage-net-data-movement - Storage Data Movement Library 0.5.2

Published by vinjiang over 7 years ago

2017.05.09 Version 0.5.2

  • All Services
    • Fix a race condition issue in DataMovement on .Net Core
azure-storage-net-data-movement - Storage Data Movement Library 0.5.1

Published by vinjiang over 7 years ago

2017.04.19 Version 0.5.1

  • All Services

    • Upgraded azure storage client library to 8.1.1
  • Blob Service

    • Removed page blob size checking in uploading to leverage validation in Azure Storage Server
azure-storage-net-data-movement - Storage Data Movement Library 0.5.0

Published by vinjiang almost 8 years ago

2016.12.29 Version 0.5.0

  • All Services
    • Upgraded azure storage client library to 8.0.0
    • Updated DataMovement.sln to Visual Studio 2015 solution file
  • Blob Service
    • Added large block blob transfer support.
    • Added new option TransferManager.Configurations.BlockSize to specify the size of blocks when transferring data to block blob
    • Fixed the issue that copying source blob snapshot with name which includes special characters failed
azure-storage-net-data-movement - Storage Data Movement Library 0.4.1

Published by vinjiang almost 8 years ago

2016.12.06 Version 0.4.1

  • Blob Service
    • Fixed an issue that it cannot transfer data with an older version SAS token
azure-storage-net-data-movement - Storage Data Movement Library 0.4.0

Published by vinjiang almost 8 years ago

2016.11.04 Version 0.4.0

All Services

  • Upgraded azure storage client library to 7.2.1
  • Added an interface to support to output transferring checkpoint to stream which resolves the potential OutOfMemory issue when there are too many failed transfers files.
  • Changed TransferContext to SingleTransferContext for single file uploading/downloading/copying and DirectoryTransferContext for directory uploading/downloading/copying
  • Added a callback ShouldTransferCallback which can be used to determine whether or not to upload/download/copy a specific file in DirectoryTransferContext
  • Added a callback SetAttributesCallback to set destination's attributes in memory. The attributes set in this callback will be sent to azure storage service before transferring is completed
  • Removed ContentType property that SetAttributesCallback can be used to set destination content type
  • Renamed OverwriteCallback to ShouldOverwriteCallback
  • Added static interface ForceOverwrite to overwrite all existing destination. With this callback assigned to ShouldOverwriteCallback, supports downloading/copying to destination without READ permission

Blob

  • Added support to indicate virtual directory delimiter when downloading/copying from blob source
azure-storage-net-data-movement - Storage Data Movement Library 0.3.0

Published by vinjiang about 8 years ago

Changes in v0.3.0:

  • Upgrade azure storage client library to 7.2.0
  • Fixed a bug that ParallelOperations setting doesn't take effect
  • Fixed a bug of randomly throwing exception when transferring a directory
  • Removed directory downloading/copying interfaces without DownloadOptions/CopyOptions
  • Changed the return value for directory transferring interfaces from Task to Task
  • Support to work with the RTM release of .Net Core 1.0
azure-storage-net-data-movement - Storage Data Movement Library 0.2.0

Published by vinjiang almost 9 years ago

New in v0.2.0:

• Support download, upload, copy directory (local file directory, blob virtual directory, file share directory)
• Support transfer directory in recursive mode or flat mode
• Support specify the file pattern when copying files and directories
• Support download snapshots under directories
• Provide Event to get single file transfer result in a transfer
• Change TransferConfigurations.UserAgentSuffix to TransferConfigurations.UserAgentPrefix

azure-storage-net-data-movement - Storage Data Movement Library 0.1.0

Published by vinjiang almost 9 years ago

New in v0.1.0:

• Support data transfer for Azure Storage abstraction: Blob
• Support data transfer for Azure Storage abstraction: File
• Download, upload, copy single object
• Control the number of concurrent operations
• Synchronous and asynchronous copying
• Define the number of concurrent operations
• Define the suffix of the user agent
• Set the content type
• Set the Access Condition to conditionally copy objects, for example: copy objects changed since certain date
• Validate content MD5
• Download specific blob snapshot
• Track transfer progress: bytes transferred, number of success, fail, skip files
• Recover (Set/Get transfer checkpoint)
• Transfer Error handling (transfer exception and error code)
• Client-side logging

Related Projects