Possibility of a text separator

Edit Subject

Hello Georg,

for text file metadata we use:
line separator - this separates records and indicates the beginning of the new record
field separator - separates columns within one field
string qualifier - indicates the begining and end of the string column (so that you may use inside the field the line separator - this seems to be the case you are describing)
string qualifier escape - the character which precedes the string qualifier when it is used inside the field

All these parameters can be set for one plan in TextFileReader (when you generate the profiling plan) or for all settings when you set them via preferences.

Marek

Hi Georg,

Actually, it is even not necessary to directly edit the parameters of TextFileReader for each plan that uses that particular file. For each CSV file, DQ Analyzer maintains "text file metadata" which host these parameters. Normally, the metadata are determined when the file is used for the first time (such as when you first profile the file). However, the heuristic responsible for finding the appropriate values may not find the right settings (and apparently it didn't in your case).

To allow the user to override the settings found by DQ Analyzer, there is an "Edit Metadata" action available after right-clicking the particular file. The dialog then allows you to configure all the parameters; once you save them, they will be used for any further operations with the file.

Pavel