30-Day Free Trial: It’s Never Been Easier To Get Started With StreamSets

11 months ago

Home
Community overview
StreamSets Platform
StreamSets Academy

StreamSets Academy

StreamSets Academy course topics and questions

101 Topics
247 Replies

When you subscribe we will email you when there is a new topic in this category

101 Topics

Most replies

Recently active Most views Newest first

lakshmi_narayanan_tDiscovered Fame

asked in StreamSets Academy

Santhosh KumarDiscovered Fame

asked in StreamSets Academy

Reattempt Test White Belt

Hi Team, Good Morning, as I participated in the test(White belt), unfortunately I am under scored so, i had another test within the month ,so I requested you to provide a coupon code or detailed information about the procedure for reattempt.

1 year ago

DolphinDiscovered Fame

asked in StreamSets Academy

How to set and get pipeline runtime configuration parameter value

Hi Team,We have some pipelines, which has some configuration like below, How can I get the exact plain test value for these parameter property value? Also how and where can I set these kind of values?

4 months ago

HariUmeshFan

asked in StreamSets Academy

How to get the list of pipeline names from control hub using python sdk ?

Hi All,i am building a unittest framework for validating the pipeline names from the streamsets control hubFor that i need to fetch pipeline names from streamsets using the python platform sdk as seen belowfrom streamsets.sdk import Controlhubsch = Controlhub(credential_id="my_id", token ="Mytoken", use_webscoke_tunneling=False)pipelines = sch.pipeline.get_allthe above code return list of attributes and name of pipeline with the type of class ‘Method’. i actually need to get only those pipelines that already deployed into the streamsets through our CI platformso what would be the right approach to filter and get the pipeline names from control hub?I don't see any example specific to this scenarioCan you please help on this?

1 year ago

ufmurphyOpening Band

asked in StreamSets Academy

Kafka not running in lab

Hey guys, I am running through the Academy training and seem to have hit a snag. I am not real knowledgeable about Docker/Kubernetes, so I thought I’d ask here. Is Kafka running in the labs? I am getting timeout errors when I try to connect from Control Hub.https://academy.streamsets.com/courses/dataops-platform-fundamentals/lessons/build-a-kafka-pipeline/topic/lab-build-a-kafka-pipeline-2/ Any help is appreciated. Jim

2 years ago

SebastienMRoadie

asked in StreamSets Academy

In Data Collector Fundamental course, Day 2, Lab - Data Drift, I get error 'HIVE_38 - unexpected authorization method SIMPLE, expected KERBEROS' when validating pipeline

Course and chapter url: https://academy.streamsets.com/courses/streamsets-data-collector/lessons/data-drift/topic/data-drift/ Screenshot of errors attached.

2 years ago

zhanghaoFan

asked in StreamSets Academy

activate streamset fail

Hello everyone, I'm a new user, and I got an installation package, but I can't activate it. I can access the community normally, but I can't log in normally and activate streamset. Who can give me some advice? Thank you!

2 years ago

himabinduFan

asked in StreamSets Academy

while loging streamstets facing error

Hi Team,while logging to stream sets i am facing error with this email id himabindu_nukaraju@persistent.comi need to login my course. Please help on this

1 year ago

saikat_chatterjeeDiscovered Fame

asked in StreamSets Academy

Unable to upload the driver in the external libraries and facing same issue while importing a pipeline

In the build jdbc pipeline the step where we need to upload the driver in the external libraries after selecting the mysql-connector-java-8.0.26 when I am clicking on upload a red line in appearing as error but there nothing mentioned of which error it is.The same thing is happening while importing a pipeline, when I am browsing the zip file and clicking on the import button the same error as mentioned above is appearing.

1 year ago

suresh_venkataFan

asked in StreamSets Academy

Unable to pause Strigo "The workspace cannot be paused"

Hi Team,I’m Unable to pass the strigo last 2hours. its Consumed 2hours time Already Please Help me on this.

1 year ago

yash4b4Fan

asked in StreamSets Academy

Streamsets Academy login issues

Hi Team,My login credentials are not working. getting the following error on the webpage. Your connection to this site isn't secureDon't enter any sensitive information on this site (for example, passwords or credit cards). It could be stolen by attackers.

1 year ago

AnkurDiscovered Fame

asked in StreamSets Academy

Metric Rule giving Alert on False Condition.

We have a Metric Alert in a JDBC Producer Input Counter with below Condition:${value() < 35}The above rule with “less than operator” is giving alert in both the conditions True or False. If we change the operator from “less than “< to “greater than”>. This it is behaving as expected.${value() > 35} Please provide the suggestion or resolution for ${value() < 35} to work as expected i.e. only on True condition.

1 year ago

brian parkerFan

asked in StreamSets Academy

Issue with Streamsets Tutorial

In the setup deployment step of the streamsets tutorial, when I run the update-nodes.sh script in the strigo environment, I get the following error every time:Error response from daemon: enpoint with name wonderful_volhard already exists in network streamsets-coreError response from daemon: enpoint with name wonderful_volhard already exists in network streamsets-integrationsError response from daemon: enpoint with name wonderful_volhard already exists in network streamsets-cookedAlso, the tutorial says I should see 3 engines in the control hub, but I only see 2.

2 years ago

vigneshmFan

asked in StreamSets Academy

Possibility to connect DB2 as source in StreamSets

Hi All,There is a plan to read records from DB2 in StreamSets. Can we use JDBC Multitable consumer Origin, if so, is any other additional steps that we need to take care to start reading records?Please confirm the possibilities in StreamSets connecting to DB2. Thank you,

11 months ago

aysudyFan

asked in StreamSets Academy

Cannot use Strigo / This course has ended

Hello, I was doing the StreamSets fundamentals training and I have got this notification from Strigo, saying “This course has ended”. Actually It hasn’t ended yet. How can I reaccess the account? I am Software AG employee.

7 months ago

tejas_surveRoadie

asked in StreamSets Academy

Related With REST API

I was working on StreamSet Learning Labs and after completing some learning tracks, currently I am stuck in REST API part and lab videos and instructions are not enough for me to understand it properly.So please guide me regarding these same things

1 year ago

Dhanashri_BhateOpening Band

asked in StreamSets Academy

Need more info on the two events for SFTP destination?

Hello,I am referring to this documentation : https://docs.streamsets.com/portal/platform-datacollector/latest/datacollector/UserGuide/Destinations/SFTP.html#concept_sgt_m2m_xhbThere are two Event types - Uses one of the following types:file-closed - Generated when the destination closes a file. wholeFileProcessed - Generated when the destination completes streaming a whole file.If I have to add an executor to move the file from this destination then to some other location upon receiving an event, which event I have to use? Are there any more steps between wholeFileProcessed and file-closed? Is there anything more after the event file-closed is triggered? Dhanashri

1 year ago

lakshmi_narayanan_tDiscovered Fame

asked in StreamSets Academy

how to saw the local fs in command terminal

below i post the pic ,anybody fix the issue .i dont known whats going wrong in pipeline or command terminal

1 year ago

Dhanashri_BhateOpening Band

asked in StreamSets Academy

Handling multiple destination tables in data copy/CDC pipeline

Hello,Scenario: Multiple tables from source DB are to be replicated in the target DB. Whatever changes happen in source tables should be reflected in the target tables. When a record gets deleted, an entry with all columns of the record must be saved to a file. Both source and target are postgres DBs.I have implemented this for a single table. Created one pipeline that simply performs one time data copy from source to target. Then created a CDC pipeline like in the picture below. I am using the JDBC Producer destination. Though this works as designed for single table, I am not sure if this is the right approach when working with multiple tables. Though the CDC origin accepts the table name pattern “source_tab%” , the JDBC Producer destination seems to allow just one table name. i.e. though CDC is giving me all updates for all records, I can only use one table name at a time in the JDBC producer destination.I have tried using EL in the table name e.g. ${record:attribute(/'change.table'

1 year ago

AnkurDiscovered Fame

asked in StreamSets Academy

Different types of Events and their names

Hi,In the StreamSets documentation we found very lesser Event Types like:no-more-data Pipeline start Pipeline StopOther than these we are not able to able any other Event Type if it exists in the documentation.Like, if I want to generate an event after the record count is 5000, what should be the event name to put in the below type of equation:${record:eventType()=='no-more-data'} Please share other Event types and their names for the usage.

1 year ago

lakshmi_narayanan_tDiscovered Fame

asked in StreamSets Academy

how to covert file and write into localfs as a XLSX file Format.

can you please suggest any other configuration or proseccor to achieve output.i reading my file in directory origin origin is :configuration my destination is localfs:configuration after execution of my pipeline :-out put file like - But my requirement is like how to acive my fie format ,by using any processor jython evaluvator or whole file transformer.

8 months ago

Santhosh KumarDiscovered Fame

asked in StreamSets Academy

Parquet file Data collector

Hi teami using streamset control hub 3.x ,if possible to read and write parquet file in data collector ?

1 year ago

shivrajRoadie

asked in StreamSets Academy

STF

In STF 3.x we have used "sch_authoring_sdc.get_history(pipeline)" to get all the information, for 4.x do we have anything like that for accessing the history? as get_history is not working with STF 4.x?

9 months ago

Page 2 / 5

Badge winners

vishwesh.margasahayamhas earned the badge Product expert
ajinkyahas earned the badge Innovator
Sanjeevhas earned the badge Eager to help
AkshayJadhavhas earned the badge Eager to help
john.durkinhas earned the badge Eager to help

Show all badges

Terms & Conditions

Sign up

Already have an account? Login

Social Login

Username *

E-mail address *

What I do... *

Data Leader Data Architect Data Engineer Data Scientist Other

Company *

Country *

Zip Code *

Marketing Communications

Yes No

Password *

I have read and Agree to the Website Terms of Service and I have read and acknowledged the Privacy Policy.

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Social Login

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.