Skip to main content

StreamSets Academy

StreamSets Academy course topics and questions

  • 109 Topics
  • 255 Replies
109 Topics
A
Discovered Fame
AnkurDiscovered Fame
asked in StreamSets Academy
Metric Rule giving Alert on False Condition.

We have a Metric Alert in a JDBC Producer Input Counter with below Condition:${value() < 35}The above rule with “less than operator” is giving alert in both the conditions True or False. If we change the operator from “less than “< to “greater than”>. This it is behaving as expected.${value() > 35} Please provide the suggestion or resolution for ${value() < 35} to work as expected i.e. only on True condition.        

232
A
Discovered Fame
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
how to get data time format from mongodb to mysql .

the json data in mongodb had  a date format as a  timestamp in value  but during  process only date shown not timestamp show. how to fix below is my mongodb data:- but  inside of data updatedAt column has timestamp value but in streamsets not shown.how to get timestamp value from mongodb origin.

241
AkshayJadhav
StreamSets Employee
1 year ago
D
Opening Band
Dhanashri_BhateOpening Band
asked in StreamSets Academy
Where can I find Transpose processor documentation?

Hello,I am looking for documentation for the transpose processor in transformer pipelines.I searched here : https://docs.streamsets.com/portal/platform-transformer/latest/search.html?searchQuery=transpose but did not find it.Can someone share the link to the relevant documentation?-Dhanashri 

10110
Bikram
Headliner
1 year ago
deepikamani007
Fan
deepikamani007Fan
asked in StreamSets Academy
field type converter

If i converting string type date to date type means the output show wrong. 

664
deepikamani007
Fan
1 year ago
deepikamani007
Fan
deepikamani007Fan
asked in StreamSets Academy
How to create dynamic column creation in mysql and also auto create table

My origin as dymanic columns changes will happen and also load into mysql not manually but i want to achieve in dynamically.

771
Bikram
Headliner
1 year ago
S
Fan
suresh_venkataFan
asked in StreamSets Academy
Unable to pause Strigo "The workspace cannot be paused"

Hi Team!I’m Unable to Pause My Strigo . Iam Facing Error like this“The workspace cannot be paused while labs are still be provisioned. Once the labs are ready, you will be able to pause your workspace.”Requesting To You Please help me on this 

453
john.durkin
StreamSets Employee
1 year ago
M
Fan
MadhumithaFan
asked in StreamSets Academy
Any references for preparation of the Streamsets White belt Exam

Can I get any references for the preparation for Streamsets white belt exam other than the Streamsets Academy content…?

4784
Praveen P
Fan
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
how to implement the sql parser processor

how to execute the sql parser processor in pipeline ,anyone can provide the pipeline.

583
saleempothiwala
Headliner
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
file transfer from origin to destination

hi,I want to transfer multiple files from origin to  destination like any other destination ,how can I achieve these use case .any one can suggest  .

1098
Bikram
Headliner
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
multiple files transfer to directory

i had a multiple json files in same directory ,what i wanted to do is just transfer the files like copy and paste to another directory as whole file format .the origin directory contains two json files these two files copy and paste it to another directoryhow to give file name expression  

891
Bikram
Headliner
1 year ago
B
Fan
btsshirt5Fan
asked in StreamSets Academy
How to parametrize field remover field names

I'm having trouble parameterizing field remover's field names. In reality, you can give specific field names like /type, /id, and /name. In my use case, however, I would like to parametrize these fields and read the data from a properties file, however I am unable to do so.

401
Bikram
Headliner
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
jdbc tee processor not write data in microsoft sql server for control hub 3.x

hi,I am facing issue , to write  a data in  Microsoft Sql server database  by  using JDBC tee processor but its not work .I tried the identity insert on and off in database level .if it Possibile or not .suggest any processor to  achieve this .ERRORdemo pipelinejdbc tee configuration  

395
lakshmi_narayanan_t
Discovered Fame
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
active file ,file tail

hi,I want to use the file tail origin but i didn’t known the active file path usage  in sdc. anyone can provide the configuration of file tail and active file path . 

657
S
Discovered Fame
1 year ago
D
Opening Band
Dhanashri_BhateOpening Band
asked in StreamSets Academy
Selection of cloud libraries when pipeline needs 2 different cloud environments

Hello,We’re trying to create a transformer pipeline with Origin: AmazonS3 , Destination: Azure ADLS and compute is on Azure Databricks. We tried to break is down into smaller pieces.S3->ADLS pipeline with Streamsets own cluster worked fine. Random data source to ADLS with Databricks compute worked fine. But when we try to bring in all 3 components together, we are getting stage library specific errors which are conflicting. We have tried different combinations from the list in the attached picture.In this particular scenario, what are the stage libraries we need to choose?  

131
D
Opening Band
1 year ago
S
Fan
suresh_venkataFan
asked in StreamSets Academy
How to Create Engine from Control Hub by using SDK Python ?

Hi Team,we Observed, After the Creation Of Deployment using SDK Python Version 5.1.0, we have to Run the “Get Install Script” in Our Local VM for the Creating Engine. Except This Step How to Create the Engine By using SDK Python? can anyone Please help me on this. Thank YouSuresh_venkata

260
S
Fan
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
Rest API

how to write rest api in python code..

461
Bikram
Headliner
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
Parquet file Data collector

Hi teami using streamset control hub 3.x ,if possible to read and write parquet file in data collector ? 

1042
saleempothiwala
Headliner
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
data type change by field mapper

if it possibile to  convert data type by  field mapper 

451
Bikram
Headliner
1 year ago
tamilarasup
Discovered Fame
tamilarasupDiscovered Fame
posted in StreamSets Academy
errorhandling

Anyone can provide the topics and some use case OR real-time scenario about the error handling SDC, SCH that will be very useful for my belt preparation.

100
tamilarasup
Discovered Fame
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
cdc possibile are not SQLSERVER

it is possible to Achieve CDC in origin  JDBC MULTI TABLE consumer to JDBC Producer  Pipeline

301
saleempothiwala
Headliner
1 year ago
A
Discovered Fame
AnkurDiscovered Fame
asked in StreamSets Academy
Connect to Dynamic 365

Hi,As per the requirement I need to connect Streamsets to Dynamic 365 db.DO we have this connector and if not how we can connect it?  Regards,Ankur

310
A
Discovered Fame
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
datadrift

Difference in  data rule vs data drift rule with some scenario, use case?

361
Bikram
Headliner
1 year ago
S
Discovered Fame
Santhosh KumarDiscovered Fame
asked in StreamSets Academy
Reattempt Test White Belt

Hi Team, Good Morning, as I participated in the test(White belt), unfortunately I am under scored so, i had another test within the month ,so I requested you to provide a coupon code or detailed information about the procedure for reattempt.

3043
Bikram
Headliner
1 year ago
lakshmi_narayanan_t
Discovered Fame
lakshmi_narayanan_tDiscovered Fame
asked in StreamSets Academy
data collector vs transformer

Anyone can provide a quick overview of pros and cons of data-collector vs transformer apart from streamsets document also.

2391
saleempothiwala
Headliner
1 year ago
A
Discovered Fame
AnkurDiscovered Fame
asked in StreamSets Academy
Different types of Events and their names

Hi,In the StreamSets documentation we found very lesser Event Types like:no-more-data Pipeline start Pipeline StopOther than these we are not able to able any other Event Type if it exists in the documentation.Like, if I want to generate an event after the record count is 5000, what should be the event name to put in the below type of equation:${record:eventType()=='no-more-data'} Please share other Event types and their names for the usage.

972
saleempothiwala
Headliner
1 year ago

Badge winners

Show all badges
Terms & Conditions