Skip to main content

i have file which has records delimited by pipe and around pipe i have double quotes.

how can is plit this file and store into snowflake or parquet.

 

ex :

1”|”USA”|”ABC company“|”Resident

2”|”CAN”|”NORther “|”Rsdiendtn

Hi Ashok,

Have you tried setting the file format as Delimited and the Delimiter Format Type to Custom?

 

I think this will let you process a pipe delimited file like your example

 


i am able to process but i see double quotes on my first field name at target and rest all fields are populating correctly.

ex :

1”

2”


I have just tried with this data as input:
ID"|"Country"|"Company"|"Status
1"|"USA"|"ABC company"|"Resident
2"|"CAN"|"NORther "|"Rsdiendtn
 

I have added a header row, just so that I can get proper field names.

I have then configured the format as follows:
 

And the result is:

 

Which, I believe, is what you want.

 

 


thanks you, if i put schema as DDL format, the values are populating as null

 

SEQUENCE_NUMBER    Integer,
country    String,
company    String,
status    String,


Giuseppe Mura, without adding header were you able to achieve?


Reply