Skip to main content

SDC writes additional double quotes when using " as quote character in Custom Delimiter Format.

  • February 14, 2022
  • 0 replies
  • 34 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

QUESTION:

Why does the SDC write additional double quotes when using double quote character as quote character in Custom Delimiter Format?

 

ANSWER:

Some CSV modes use double quotes to escape a quote character appearing in the text - for example, RFC4180 CSV. Therefore, Say, "Hello." is escaped and written as "Say, ""Hello.""" .

 

If you use double quotes as quote character in Custom Delimiter Format, it will use the same rules to escape the quote character as if you choose RFC4180 CSV - the SDC will escape the quotes as well according to the CSV standards. However, you could change the character to a different one, for example to Tab. Then the quotes in the text are not considered as quote characters and do not need to be escaped.

Did this topic help you find an answer to your question?

0 replies

Be the first to reply!

Reply