What’s the latest StreamSets Python SDK 6.0 you ask? Well it’s a blend of StreamSets capabilities with Python’s simplicity. Designed for those aiming to build, integrate, and maintain custom solutions, the SDK offers a gateway to unlock untapped potential.
Let’s dive into its new features:
- Migration Made Easy: Overcome data migration challenges across platforms. Previously, changing origins or destinations required users to work in the UI, manually adjusting pipelines - a tedious process. Now, a few code lines can programmatically adjust origins and destinations in numerous pipelines.
- Combat Fragmentation: With the SDK, you can now modify or expand existing pipelines at scale, preventing the need to duplicate or create new assets and reducing the potential for error.
- Enhanced Connection Control: Adjusting stage connections at scale was previously frustrating and time-consuming. The SDK now enables users to find connection patterns across pipelines and adjust them programmatically, bypassing manual, tedious alterations.
- Smoother UI - SDK Transition: Transitioning between the UI and SDK can be challenging. The recent update introduces enhanced ‘stage.configuration’ attribute, making top-level UI fields more accessible with simplified property names, simplifying your workflow.