Skip to main content
Solved

Profiling comma separated file in webui

D
Universe Traveller
Forum|alt.badge.img

Hi, This file is comma separated with header and “ text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail.

Any assistance would be most welcome.

2025-04-10 16:27:04 [INFO]    com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 [INFO]    com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 [INFO]     Using following licenses:10.04.2025 16:27:04 [INFO]       /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 [INFO]     running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 [DEBUG]    metrics will be scraped to /data/ataccama/one/dpe-assembly-14.5.1.231205-13929-3b0b5777/storage/jobs/2f1568e2-0000-7000-0000-00000026b0c8/workspace/metrics10.04.2025 16:27:05 [INFO]     Ataccama DQC engine initialized.10.04.2025 16:27:05 [INFO]     Creating runtime...10.04.2025 16:27:05 [DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemoryTotal = 1,000,000 (default)10.04.2025 16:27:05 [DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemorySortPercent = 50 (default)10.04.2025 16:27:05 [DEBUG]    Profiling(ProfilingAlgorithm): profiling.inMemorySortWeight = 5 (default)10.04.2025 16:27:07 [INFO]     Starting runtime...10.04.2025 16:27:07 [INFO]     Running runtime...10.04.2025 16:27:07 [DEBUG]    Starting runnables...10.04.2025 16:27:07 [DEBUG]   [in] Reading...10.04.2025 16:27:18 [WARNING]  [EHS:LONG_LINE][step:2f1568e2-0000-7000-0000-00000011a43b][line:12531]10.04.2025 16:27:18 [FATAL]    Parse errors in file reader.[STEP Component/2f1568e2-0000-7000-0000-00000011a43b[Text File Reader]]First 1 detected problem(s) (out of 1)[EHS:LONG_LINE][step:2f1568e2-0000-7000-0000-00000011a43b][line:12531]

Best answer by anna.spakova

Hi ​@Delbert71,

is this the complete log? It looks like it is failing only on one line - 

line:12531

Are you able to check the details of this specific record? This error usually means that there are more fields present than is the header (usually caused by extra delimiter).

Also, is this profiling done via Ataccama ONE? What version are you on? Can you provide a screenshot of the Import settings? https://docs.ataccama.com/one/16.0.0/sources/custom-file-import.html

Thank you.

Kind regards,

Anna

View original
Did this topic help you find an answer to your question?

anna.spakova
Ataccamer
Forum|alt.badge.img+3

Hi ​@Delbert71,

is this the complete log? It looks like it is failing only on one line - 

line:12531

Are you able to check the details of this specific record? This error usually means that there are more fields present than is the header (usually caused by extra delimiter).

Also, is this profiling done via Ataccama ONE? What version are you on? Can you provide a screenshot of the Import settings? https://docs.ataccama.com/one/16.0.0/sources/custom-file-import.html

Thank you.

Kind regards,

Anna

Cansu
D
2 people like this
  • Cansu
    Cansu
  • D
    Delbert71
Cansu
Community Manager
Forum|alt.badge.img+3
  • CansuCommunity Manager
  • Community Manager
  • April 22, 2025

Hi ​@Delbert71, did ​@anna.spakova’s solution help?

Check out our Quick Start Guide to get started on the community 🙋‍♀️
D
Universe Traveller
Forum|alt.badge.img
  • Delbert71Universe Traveller
  • Universe Traveller
  • April 22, 2025

Hi Anna,

 

Thanks so much for your reply. I was away last week on holiday so thanks for your patience. You are bang on, turns out there was a ‘\’ on it’s own in one of the columns and this was shunting the data to the right. Not sure why it thought it was a delimiter but once I found that, the file loaded successfully.

 

Cheers Derek

Cansu
1 person likes this
  • Cansu
    Cansu

Reply


Community Terms of Use & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings