Question

parsing a file which special delimiter

  • 16 March 2022
  • 5 replies
  • 85 views

i have file which has records delimited by pipe and around pipe i have double quotes.

how can is plit this file and store into snowflake or parquet.

 

ex :

1”|”USA”|”ABC company“|”Resident

2”|”CAN”|”NORther “|”Rsdiendtn


5 replies

Userlevel 2

Hi Ashok,

Have you tried setting the file format as Delimited and the Delimiter Format Type to Custom?

 

I think this will let you process a pipe delimited file like your example

 

i am able to process but i see double quotes on my first field name at target and rest all fields are populating correctly.

ex :

1”

2”

Userlevel 3
Badge

I have just tried with this data as input:
ID"|"Country"|"Company"|"Status
1"|"USA"|"ABC company"|"Resident
2"|"CAN"|"NORther "|"Rsdiendtn
 

I have added a header row, just so that I can get proper field names.

I have then configured the format as follows:
 

And the result is:

 

Which, I believe, is what you want.

 

 

thanks you, if i put schema as DDL format, the values are populating as null

 

SEQUENCE_NUMBER    Integer,
country    String,
company    String,
status    String,

Giuseppe Mura, without adding header were you able to achieve?

Reply