Skip to main content

Hi all, what about if I had a fixed width file in the catalog with the first row as the header (in error). The column data comes in as one string which renders it unusable for profiling and DQ. How can I get these types of files into the catalog so I can use them in my monitoring project?

 

I have used VCI’s before to add headers to csv files in the catalog and they work well.

 

Kind regards

 

Des

Hi Des,

Indeed it looks impossible to specify any particulars on import of a file into the data catalog. For my understanding of the issue, is it just the header row that is a problem or the fixed width data rows as well? I suppose also the data rows will read as one string, so one catalog item attribute.

Kind regards,

Albert


Good morning @Albert de Ruiter

The first record is classed as the header and each row is one string. I do have an xml doc for each file I am trying to handle so I was wondering whether I could use an xml reader or parser in the desktop to create a spec or something like that. Unfortunately my knowledge of xml is non existent but only for now.

 

Kind regards

 

Des 

 


Hi Des.

Have you considered a VCI with a Text File Reader step configured as fixed width? The Text File Reader can be set up to ignore the header/first record.

If this is an option, the easiest way to configure it is to right-click on the input file in File Explorer pane from within in Desktop and click on “Edit Metadata...”.

The “Set Fixed Widths” button might prove useful.

 

Then simply drag-and-drop the input file from the File Explorer pane onto the VCI’s canvas.

Kind regards,
Adrian

 


Morning @Adrian Anderson

 

Many thanks for your response, this will come in handy 😁

 

kind regards

 

Derek


Reply