Skip to main content

SDC writes additional double quotes when using " as quote character in Custom Delimiter Format.

  • February 14, 2022
  • 0 replies
  • 37 views

AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

QUESTION:

Why does the SDC write additional double quotes when using double quote character as quote character in Custom Delimiter Format?

 

ANSWER:

Some CSV modes use double quotes to escape a quote character appearing in the text - for example, RFC4180 CSV. Therefore, Say, "Hello." is escaped and written as "Say, ""Hello.""" .

 

If you use double quotes as quote character in Custom Delimiter Format, it will use the same rules to escape the quote character as if you choose RFC4180 CSV - the SDC will escape the quotes as well according to the CSV standards. However, you could change the character to a different one, for example to Tab. Then the quotes in the text are not considered as quote characters and do not need to be escaped.