Skip to main content

Hi, This file is comma separated with header and “ text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail.

Any assistance would be most welcome.

2025-04-10 16:27:04 4INFO]    com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 4INFO]    com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 4INFO]     Using following licenses:10.04.2025 16:27:04 4INFO]       /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 5INFO]     running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 5DEBUG]    metrics will be scraped to /data/ataccama/one/dpe-assembly-14.5.1.231205-13929-3b0b5777/storage/jobs/2f1568e2-0000-7000-0000-00000026b0c8/workspace/metrics10.04.2025 16:27:05 5INFO]     Ataccama DQC engine initialized.10.04.2025 16:27:05 5INFO]     Creating runtime...10.04.2025 16:27:05 5DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemoryTotal = 1,000,000 (default)10.04.2025 16:27:05 5DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemorySortPercent = 50 (default)10.04.2025 16:27:05 5DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemorySortWeight = 5 (default)10.04.2025 16:27:07 7INFO]     Starting runtime...10.04.2025 16:27:07 7INFO]     Running runtime...10.04.2025 16:27:07 7DEBUG]    Starting runnables...10.04.2025 16:27:07 7DEBUG]    in] Reading...10.04.2025 16:27:18 8WARNING]   EHS:LONG_LINE]Estep:2f1568e2-0000-7000-0000-00000011a43b]bline:12531]10.04.2025 16:27:18 8FATAL]    Parse errors in file reader.rSTEP Component/2f1568e2-0000-7000-0000-00000011a43b3Text File Reader]]First 1 detected problem(s) (out of 1)1EHS:LONG_LINE]Estep:2f1568e2-0000-7000-0000-00000011a43b]bline:12531]

Hi ​@Delbert71,

is this the complete log? It looks like it is failing only on one line - 

line:12531

Are you able to check the details of this specific record? This error usually means that there are more fields present than is the header (usually caused by extra delimiter).

Also, is this profiling done via Ataccama ONE? What version are you on? Can you provide a screenshot of the Import settings? https://docs.ataccama.com/one/16.0.0/sources/custom-file-import.html

Thank you.

Kind regards,

Anna

Hi ​@Delbert71, did ​@anna.spakova’s solution help?

Hi Anna,

 

Thanks so much for your reply. I was away last week on holiday so thanks for your patience. You are bang on, turns out there was a ‘\’ on it’s own in one of the columns and this was shunting the data to the right. Not sure why it thought it was a delimiter but once I found that, the file loaded successfully.

 

Cheers Derek

Reply


Community Terms of Use & ConditionsCookie settings