Share your Best Practices

Topic: Org Admin wants to log in Platform as a local Control Hub user when SAML is enabledSolution: In our Platform documentation, when SAML is enabled, it is mentioned that:"After you publish a draft configuration to production, you enable the production configuration to activate it. When enabled, all organization users must log in using SAML authentication.As a user with the Organization Administrator role, you can log in using local or public identity provider authentication to access the Control Hub organization SAML configuration page only."This means that all users must authenticate via SSO SAML, but only Org Admin can log in locally to configure SAML settings when SAML breaks, o

Can we configure multiple tables in same pipeline when we use JDBC Query consumer 1 as origin and JDBC producer 1 as destination. in my case i need to send 20 tables data to send from on-premise DB (db2) to cloud DB (Azure postgresql)?. i am thinking to avoid multiple pipelines creation in streamsets.

In today's fashion landscape, the hoodie has evolved from a simple piece of sportswear to a versatile wardrobe staple. Among the myriad of brands offering this essential garment, Corteiz stands out for its unique blend of style, comfort, and quality. As a rising star in the US fashion market, Corteiz has garnered a loyal following thanks to its dedication to craftsmanship and innovative designs. This article delves into the world of Corteiz hoodies, exploring everything from their design and material to customer reviews and styling tips. Whether you're new to the brand or a longtime fan, this comprehensive guide will provide all the information you need about Corteiz hoodies.

I'm working with StreamSets and have three pipelines that each consume from different Kafka topics. Each pipeline writes to its own dedicated table (e.g., table1,table2, table3), but all three also write to a shared table . I'm using logic to avoid duplicates(update or insert). My concern is about concurrent writes — if all three pipelines try to write to the same row (shared table) at the same time, will StreamSets or the database handle it safely? I'm also wondering how to properly configure retry attempts, error handling, and backpressure in StreamSets to ensure that no data is lost or skipped if database locks or contention occur. What are best practices for configuring the JDBC  and pipeline error handling for this kind of multi-pipeline write scenario?

Question: Does SDC support IPv6?Answer: Our Data Collector core language was done in Java and, consequently, supports IPv6. Since we’re on Java Stack, the IPv6 is mostly there for the core Data Collector pieces. For compatibility with Data Collector, it mainly depends on the source / target you want to connect whether it supports IPv6. Since SDC acts as a system integrator, for each stage, we would have to go through it and see if they are IPv6 compatible or not. For example: Oracle DB has started to support IPv6 connectivity since 12c, therefore theoretically Data Collector should also support it.Please note that there are some technologies (and versions) that don’t support IPv6. If the origin or destination doesn’t support it, we currently don't have plans to create workarounds or patches to allow it.Besides that, communications between Data Collector and Control Hub / Platform are done using IPv4, so it should be visib

Environment: StreamSets Data Collector v5.7.2 Any ControlHub version.  Issue: When you installed Kafka 2.7 on the data collector version 5.7.2, and it is currently functioning without any issues. However, when attempting to upgrade the library to version 3.5 and subsequently removing older version 2.7, 2,5, 2.6 the ControlHub UI displays a validation error, as expected. The problem arises when attempting to use the Click here to update button in the DPM-UI, as it does not seem to work as intended. Keep asking users to update the libraries.Here is the screenshots of the issue:-Update the stage Library

The Jacquemus Pesco T-Shirt is an essential piece that combines minimalist design with high-end quality. Crafted with care and precision, this t-shirt seamlessly blends comfort, versatility, and a chic aesthetic, making it a wardrobe staple for any modern fashion enthusiast. Whether you're dressing up for an event or keeping it casual, the Pesco T-Shirt is designed to cater to your style needs with ease.Luxurious Fabric and Quality CraftsmanshipThe Jacquemus Pesco T-Shirt is made from premium cotton, ensuring a soft and breathable feel on the skin. This lightweight fabric allows for all-day comfort, making it ideal for both summer and transitional seasons. Jacquemus prides itself on exceptional craftsmanship, and the

Hi,We are using Microsoft SQL CDC Client to extract changes on one of our database. Now we noticed that the target (a Snowflake destination) is complaining about unknown operations.So added this following step to the data flow:       if (records[i].attributes['sdc.operation.type'] == 5)         continue;         sdc.output.write(records[i]);Is it normal that we have to filter out operation type 5 manually? So that the pipeline works.Is there an example pipeline (SQL CDC → Snowflake) so that we could apply best practicesThanksSebastian

Issue:-While adding a json data to the MongoDB collection, following error has been observed.MONGODB_13 - Error serializing record: java.lang.UnsupportedOperationException: BSON Converter cannot convert java.util.ArrayList to BSON DocumentSolution:- MongoDB atlas was reading the record as a list. As the JSON data was enclosed with the [].We have to set the JSON Content to JSON array of objects at the Origin side.

Can we configure multiple tables in same pipeline when we use JDBC Query consumer 1 as origin and JDBC producer 1 as destination. in my case i need to send 20 tables data to send from on-premise DB (db2) to cloud DB (Azure postgresql)?. i am thinking to avoid multiple pipelines creation in streamsets.

Deduplicate and keep latest based on timestamp field in streamsets ibm?  

Problem:When attempting to log in to Legacy Control Hub with SAML enabled, users encounter an HTTP 401 error after trying to authenticate with the Identity Provider. The Login Audit trail provides the following information:HTTP Status Code: 401 Error Type: WEB_SSO_204 Response Status: urn:oasis:names:tc:SAML:2.0:status:RequesterSolution:The above error basically means that the Identity Provider has not granted authorization to the user, resulting in a 401 error response to Legacy Control Hub.This issue may stem from a misconfiguration of SAML settings between Legacy Control Hub and the Identity Provider. In most cases, the problem is related to the SAML keys used by Control Hub. Ensure that the public keys are valid and that the Identity Provider is utilizing the same keys. We recommend exchanging fresh copies of metadata and public keys between Legacy Control Hub and the Iden

Any one can known the Error and how to fix this .   

In today's fashion landscape, the hoodie has evolved from a simple piece of sportswear to a versatile wardrobe staple. Among the myriad of brands offering this essential garment, Corteiz stands out for its unique blend of style, comfort, and quality. As a rising star in the US fashion market, Corteiz has garnered a loyal following thanks to its dedication to craftsmanship and innovative designs. This article delves into the world of Corteiz hoodies, exploring everything from their design and material to customer reviews and styling tips. Whether you're new to the brand or a longtime fan, this comprehensive guide will provide all the information you need about Corteiz hoodies.