Skip to main content
Solved

How to increase the speed of profiling data for using Oracle DB?


Forum|alt.badge.img+1

Hello, I have a speed of profiling data for using Oracle DB of about 4000-7000 rows per minute.

I use Ataccama DQ Analyzer (Version: 11.1.1.ga-2017-06-14). 

 

Please, can you take me to advise me on how to increase the speed of profiling data for using Oracle DB?

I hope to take the profiling speed to about 100 000 rows per minute...

 

 

Connation config:

 

 

 

Log:

17.03.2023 12:56:04 [INFO]     Switching to logging setup from C:\Users\ECHERN~1\AppData\Local\Temp\loggingConfig3307204922660014311.tmp
17.03.2023 12:56:04 [INFO]     Using following licenses:
17.03.2023 12:56:04 [INFO]       C:\Ataccama DQ Analyzer 11\runtime\license_keys\license.plf
17.03.2023 12:56:04 [INFO]     Using DQ Analyzer configuration file C:\Ataccama DQ Analyzer 11\workspace\sqb_prof_pilot\data\out\sqb_all_table.plan
17.03.2023 12:56:04 [INFO]     Using runtime configuration file C:\Users\echernoskutov\AppData\Local\Temp\runtimeCfg1065525328424309714.tmp
17.03.2023 12:56:04 [INFO]     Changing CPU affinity to 4 CPU(s).
17.03.2023 12:56:04 [INFO]     DQ Analyzer engine initialized.
17.03.2023 12:56:04 [INFO]     Creating runtime...
17.03.2023 12:56:04 [INFO]     Starting runtime...
17.03.2023 12:56:04 [INFO]     Running runtime...
17.03.2023 12:56:06 [INFO]     Current status: Reading data (pass 1/2) - 29 records read
17.03.2023 12:56:08 [INFO]     Current status: Reading data (pass 1/2) - 379 records read
...
17.03.2023 13:06:15 [INFO]     Current status: Reading data (pass 1/2) - 63776 records read
17.03.2023 13:06:17 [INFO]     Current status: Reading data (pass 1/2) - 63976 records read
17.03.2023 13:06:17 [INFO]     Stopping runtime...
17.03.2023 13:06:18 [INFO]     Current status: Reading data (pass 1/2) finished - 63991 records read
17.03.2023 13:06:18 [INFO]     Current status: Computing profile (pass 2/2) - 0% complete
17.03.2023 13:06:18 [INFO]     Finished!

17.03.2023 13:06:18 [INFO]     Task completed successfully. Elapsed time: 00:10:13

 

Best answer by Cansu

Hi @Evgeny Chernoskutov, welcome to the community and thank you for posting. 

Profiling speed can depend on multiple factors, including your subscription plan. 

Using one of our paid subscription plans, you can increase resources for the DQC application that the plan utilizes to help with performance. DQA also has that option. Another alternative is to add plan logic that would optimize performance.

Hope this helps! 

View original
Did this topic help you find an answer to your question?

2 replies

Cansu
Community Manager
Forum|alt.badge.img+3
  • Community Manager
  • 630 replies
  • Answer
  • March 21, 2023

Hi @Evgeny Chernoskutov, welcome to the community and thank you for posting. 

Profiling speed can depend on multiple factors, including your subscription plan. 

Using one of our paid subscription plans, you can increase resources for the DQC application that the plan utilizes to help with performance. DQA also has that option. Another alternative is to add plan logic that would optimize performance.

Hope this helps! 


Forum|alt.badge.img+1

Hello all! I fixed it through a modified url in the connected setting:

jdbc:oracle:thin:@10.XXX.XXX.XXX:1521/XEPDB1?defaultRowPrefetch=1000


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings