StreamSets Academy

StreamSets Academy course topics and questions

  • 60 Topics
  • 161 Replies

60 Topics

H
Fan
himabinduFan
asked in StreamSets Academy

while loging streamstets facing error

Hi Team,while logging to stream sets i am facing error with this email id himabindu_nukaraju@persistent.comi need to login my course. Please help on this 

2
H
Fan
4 months ago
S
Roadie
saikat_chatterjeeRoadie
asked in StreamSets Academy

Unable to upload the driver in the external libraries and facing same issue while importing a pipeline

In the build jdbc pipeline the step where we need to upload the driver in the external libraries after selecting the mysql-connector-java-8.0.26 when I am clicking on upload a red line in appearing as error but there nothing mentioned of which error it is.The same thing is happening while importing a pipeline, when I am browsing the zip file and clicking on the import button the same error as mentioned above is appearing. 

2
S
Roadie
4 months ago
S
Fan
suresh_venkataFan
asked in StreamSets Academy

Unable to pause Strigo "The workspace cannot be paused"

Hi Team,I’m Unable to pass the strigo last 2hours. its Consumed 2hours time Already Please Help me on this.  

2
S
Fan
3 months ago
Y
Fan
yash4b4Fan
asked in StreamSets Academy

Streamsets Academy login issues

Hi Team,My login credentials are not working.  getting the following error on the webpage. Your connection to this site isn't secureDon't enter any sensitive information on this site (for example, passwords or credit cards). It could be stolen by attackers.

2
Bikram
Headliner
3 months ago
T
Fan
tejas_surveFan
asked in StreamSets Academy

Related With REST API

I was working on StreamSet Learning Labs and after completing some learning tracks, currently I am stuck in REST API part and lab videos and instructions are not enough for me to understand it properly.So please guide me regarding these same things

2
T
Fan
3 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy

how to saw the local fs in command terminal

below i post the pic ,anybody fix the issue .i dont known whats going wrong in pipeline or command terminal 

2
Santhosh Kumar
Discovered Fame
3 months ago
D
Opening Band
Dhanashri_BhateOpening Band
asked in StreamSets Academy

Handling multiple destination tables in data copy/CDC pipeline

Hello,Scenario:  Multiple tables from source DB are to be replicated in the target DB. Whatever changes happen in source tables should be reflected in the target tables. When a record gets deleted, an entry with all columns of the record must be saved to a file. Both source and target are postgres DBs.I have implemented this for a single table. Created one pipeline that simply performs one time data copy from source to target. Then created a CDC pipeline like in the picture below. I am using the JDBC Producer destination. Though this works as designed for single table, I am not sure if this is the right approach when working with multiple tables. Though the CDC origin accepts the table name pattern “source_tab%” , the JDBC Producer destination seems to allow just one table name. i.e. though CDC is giving me all updates for all records, I can only use one table name at a time in the JDBC producer destination.I have tried using EL in the table name e.g. ${record:attribute(/'change.table'

2
saleempothiwala
Opening Band
2 months ago
A
Roadie
AnkurRoadie
asked in StreamSets Academy

Different types of Events and their names

Hi,In the StreamSets documentation we found very lesser Event Types like:no-more-data Pipeline start Pipeline StopOther than these we are not able to able any other Event Type if it exists in the documentation.Like, if I want to generate an event after the record count is 5000, what should be the event name to put in the below type of equation:${record:eventType()=='no-more-data'} Please share other Event types and their names for the usage.

2
saleempothiwala
Opening Band
2 months ago
Santhosh Kumar
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy

Parquet file Data collector

Hi teami using streamset control hub 3.x ,if possible to read and write parquet file in data collector ? 

2
saleempothiwala
Opening Band
1 month ago
Y
Fan
ysunFan
asked in StreamSets Academy

Strigo Lab - Streamsets Academy: DataOps Platform Fundamentals/ Technical Issue with the lab

Hi all,I’m seeming to have issues today with the lab. It was wroking fine yesterday. However when I tried to login to StreamSet Cluster today, I got an error message saying: We have encountered a technical issue while setting up or your lab. Please contact your course provider, as they can best help you resolve this issue.Could you please help me with this issue? Many thanks.

1
john.durkin
StreamSets Employee
4 months ago
Santhosh Kumar
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy

Kafka connection not working ...

Hi Team,i using docker its work on JDBC connection but not working on a Kafka connection. 

1
Brenna
StreamSets Employee
2 months ago
Santhosh Kumar
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy

streamsets White Belt certification

How many attempts using the white belt certification.

1
Bikram
Headliner
3 months ago
V
Fan
vasanthiFan
asked in StreamSets Academy

Not able to access more than one kafka topic

Hi Team,I am not able to access more than one kafka topic in multi topic consumer .And also i am not access the local directory file path  in my local docker in windows version. I have created two topics  while i try preview the pipeline i am able to view only one kafka topic data and not able to see another kafka topic data  please some one help me in this.   

1
Rishi
StreamSets Employee
8 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
posted in StreamSets Academy

field renamer

In my FIELD RENAMER processor my input 6 columns looks  like (1'result.name' , 2'result.adress.street' , 3'result.adress.city' , 4'result.adress.state', 5'result.adress.zip' , 6'result.phone' ) BUT I WANT these output as a column name like(1’name' 2'street' 3city' 4'state' 5'zip' ,6'phone' )And also want to achieve these output in single field renamer processor

1
Brenna
StreamSets Employee
2 months ago
S
Fan
SUDHANSHOOFan
asked in StreamSets Academy

java.lang.IllegalArgumentException: File not found: '/resources/transformer/db_token'

HI Team,Trying a sample Transformer pipeline - “Scala User-Defined Function”. And after creation I found this error with pipeline not with component whichever its used.CREATION_005 - Could not resolve implicit EL expression '${runtime:loadResource('db_token', false)}': com.streamsets.pipeline.api.el.ELEvalException: CTRCMN_0100 - Error evaluating expression ${runtime:loadResource('db_token', false)}: java.lang.IllegalArgumentException: File not found: '/resources/transformer/db_token'I just open the sample pipeline, didn't do anything with it. Does any one have idea regarding this?

1
Rafael Lopez
Fan
3 months ago
C
Fan
chrisnrublocFan
asked in StreamSets Academy

SCD behaviour options missing !

HIi am trying to do the snowflake transformer course but the lab wants me to use an option in the scd processor thats not available !behaviour for new fields “Keep for inserted records and populate values from change data for updated records” all i see are remove from change and keep for newest and set null for previous ! is this the replaced version or is something different going to happen ?

1
C
Fan
3 months ago
N
Fan
nandhiniFan
asked in StreamSets Academy

Partitioning by date while data ingestion

Hi communityHow can we configure the partitioning option while we transfer the table from one end to other end.I dont want the table to be overwrite into the destination layer.I want to write it as a append mode by date.How can we do that?  

1
Kirti
StreamSets Employee
7 months ago
S
Fan
SUDHANSHOOFan
asked in StreamSets Academy

Build a CDC Pipeline, unable to find - https://academy.streamsets.com/wp-content/uploads/2021/11/externalResources.zip

Hi Streamsets Team,I was using Streamsets Tutorial - Build a CDC Pipeline, Where its mentioned to use External Resource but unable to find, because this hyperlink does not map correctly.Could you please check and update.

1
john.durkin
StreamSets Employee
3 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy

data collector vs transformer

Anyone can provide a quick overview of pros and cons of data-collector vs transformer apart from streamsets document also.

1
saleempothiwala
Opening Band
2 months ago
T
Fan
ttamangFan
asked in StreamSets Academy

Engine is no created when a deployment is successfully created

As a part of DataOps Platform Fundamentals course, i was trying to set up environments and create deployments. When I run the auto generated Install Script from my Deployment to provision the engines, I get Exit :1 and see no Engines created on my Streamset Console. Kindly suggest.

1
dima
StreamSets Employee
11 months ago
kapil24nagar
Fan
kapil24nagarFan
asked in StreamSets Academy

Lab: Build a JDBC Pipeline (zomato database is not found)

where can I get the SQL used to create the review tables under zomato database? or is there a way/script by which it can be made available in mysqldb docker?

1
saad
StreamSets Employee
10 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy

datadrift

Difference in  data rule vs data drift rule with some scenario, use case?

1
Bikram
Headliner
2 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy

cdc possibile are not SQLSERVER

it is possible to Achieve CDC in origin  JDBC MULTI TABLE consumer to JDBC Producer  Pipeline

1
saleempothiwala
Opening Band
2 months ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy

data type change by field mapper

if it possibile to  convert data type by  field mapper 

1
Bikram
Headliner
1 month ago
Santhosh Kumar
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy

Rest API

how to write rest api in python code..

1
Bikram
Headliner
1 month ago

Badge winners

Show all badges
Terms & Conditions