Skip to main content
Question

I am facing issue when trying to start from offset file in SQL SERVER CDC CLIENT

R
Roadie

I am facing issue when trying to start from offset file in SQL SERVER CDC CLIENT. Could you please help and share the Json which I should be using to start pipeline from particular offset? Below is the json I am using and it is failing:

{
  "version" : 2,
  "offsets" : {
    "$com.streamsets.pipeline.stage.origin.jdbc.CDC.sqlserver.SQLServerCDCSource.offset.version$" : "1",
    "tableName=TABLE_NAME;;;partitioned=false;;;partitionSequence=-1;;;partitionStartOffsets=;;
    ;partitionMaxOffsets=;;;usingNonIncrementalLoad=false" : "___$seqval=SEQVAL::___$operation=2::___$sdc.txn_window=10::___$start_lsn=LSN_VALUE"
  }
}

    5 replies

    alex.sanchez
    StreamSets Employee
    Forum|alt.badge.img
    • alex.sanchezStreamSets Employee
    • StreamSets Employee
    • 73 replies
    • October 3, 2022

    Hi @rayyan143786,

    Can you share the exact error you are getting?

    Alex - StreamSets Engineering Manager @ Collector
    R
    Roadie
    • rayyan143786Roadie
    • Author
    • Roadie
    • 5 replies
    • October 3, 2022

    Hello Alex,

     

    Thanks for responding. I am not getting any error it is just giving me red line at the button of dialog box where we submit to start the pipeline from offset, and the job is not kicking off. Just wanted to know if I am using the correct offset file for starting the pipeline from particular offset?

     

    Thanks!

    alex.sanchez
    StreamSets Employee
    Forum|alt.badge.img
    • alex.sanchezStreamSets Employee
    • StreamSets Employee
    • 73 replies
    • October 4, 2022

    @rayyan143786, if you open the logs from the user interface you should be able to see the full logs that triggered that error.

    Alex - StreamSets Engineering Manager @ Collector
    R
    Roadie
    • rayyan143786Roadie
    • Author
    • Roadie
    • 5 replies
    • October 5, 2022

    Hello Alex,

    I don’t see anything is captured in logs when I am trying to start job from option “Upload offset and start”. Please find the screenshot attached. 

    Thanks!

    1 Attachments
    alex.sanchez
    StreamSets Employee
    Forum|alt.badge.img
    • alex.sanchezStreamSets Employee
    • StreamSets Employee
    • 73 replies
    • October 5, 2022

    Your engine logs should show the full error.

    You can download the bundle following these steps https://www.youtube.com/watch?v=l7j3J3AZz2Q&t

    Alex - StreamSets Engineering Manager @ Collector

    Reply


    Terms & Conditions