ADLS Gen 2 Legacy

  • 16 November 2023
  • 0 replies

Userlevel 1

[ADLS Gen 2 Changes]:

In Data Collector Version 5.5.0 a change was made which altered how the ADLS Gen 2 stage functioned. Previously the ADLS Gen 2 Stage utilized the Hadoop FS to access resources. This change also split the stage into the respective resources they access: ADLS Gen 2 and Azure Blob Storage. For additional information surrounding this change please review the patch notes linked below: 

Ref 1: Patch Notes
Ref 2: Available Stage Comparison


[Legacy ADLS Gen 2]:

Additionally, the ADLS Gen 2 Legacy stage which used Hadoop FS is also still available to be utilized.

** It should be noted though that when exporting a pipeline made on a version prior to 5.5 into later Data Collectors that the (Legacy) tag will not be present on the stage information. However, the description of the stage will still relay the method with which the resource is accessed.

When the (Legacy) stage is selected in a current pipeline it can be identified as seen in the image below


0 replies

Be the first to reply!