Fixed width file import to catalog through webui or desktop
Hi all, what about if I had a fixed width file in the catalog with the first row as the header (in error). The column data comes in as one string which renders it unusable for profiling and DQ. How can I get these types of files into the catalog so I can use them in my monitoring project?
I have used VCI’s before to add headers to csv files in the catalog and they work well.
Kind regards
Des
Page 1 / 1
Hi Des,
Indeed it looks impossible to specify any particulars on import of a file into the data catalog. For my understanding of the issue, is it just the header row that is a problem or the fixed width data rows as well? I suppose also the data rows will read as one string, so one catalog item attribute.
Kind regards,
Albert
Good morning @Albert de Ruiter,
The first record is classed as the header and each row is one string. I do have an xml doc for each file I am trying to handle so I was wondering whether I could use an xml reader or parser in the desktop to create a spec or something like that. Unfortunately my knowledge of xml is non existent but only for now.
Kind regards
Des
Hi Des.
Have you considered a VCI with a Text File Reader step configured as fixed width? The Text File Reader can be set up to ignore the header/first record.
If this is an option, the easiest way to configure it is to right-click on the input file in File Explorer pane from within in Desktop and click on “Edit Metadata...”.
The “Set Fixed Widths” button might prove useful.
Then simply drag-and-drop the input file from the File Explorer pane onto the VCI’s canvas.
Kind regards, Adrian
Morning @Adrian Anderson,
Many thanks for your response, this will come in handy