Runtime.internal_error.step_fatal_error - Java heap spacejava.lang.OutOfMemoryError: Java heap space


(Rajashekhar Reddy) #1

Hi Peers,

I have created a source system on my local model explorer, underneath I have created multiple Technical Models. I am able to process all the technical model rules except last technical model rules from my source system, if I delete the last technical model all the rules are getting success, as soon as I add the last one I am getting out of memory error. I did increase to Xmx1024m, could you please help me to resolve this issue.

02.05.2018 16:02:04 [FATAL] [DqdServerComponent][dqd][dqd-config.xml] Not enough memory to run the plan file.[STEP Jdbc Reader[Jdbc Reader]]
java.lang.OutOfMemoryError: Java heap space
at java.util.jar.Manifest$FastInputStream.(Manifest.java:332)
at java.util.jar.Manifest$FastInputStream.(Manifest.java:327)
at java.util.jar.Manifest.read(Manifest.java:195)
at java.util.jar.Manifest.(Manifest.java:69)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:199)
at java.util.jar.JarFile.getManifest(JarFile.java:180)
at sun.misc.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:944)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:450)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.ataccama.dqc.tasks.io.jdbc.read.JdbcReaderInstance.run(JdbcReaderInstance.java:136)
at com.ataccama.dqc.processor.internal.runner.ComplexStepNode.runNode(ComplexStepNode.java:69)
at com.ataccama.dqc.processor.internal.runner.RunnableNode.run(RunnableNode.java:28)
at com.ataccama.dqc.commons.threads.AsyncExecutor$RunningTask.run(AsyncExecutor.java:131)
at java.lang.Thread.run(Thread.java:745)
02.05.2018 16:02:05 [FATAL] [DqdServerComponent][dqd][dqd-config.xml] Internal error occurred during run of the plan: Java heap space[STEP Jdbc Reader[Jdbc Reader]]
java.lang.OutOfMemoryError: Java heap space
at java.util.jar.Manifest$FastInputStream.(Manifest.java:332)
at java.util.jar.Manifest$FastInputStream.(Manifest.java:327)
at java.util.jar.Manifest.read(Manifest.java:195)
at java.util.jar.Manifest.(Manifest.java:69)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:199)
at java.util.jar.JarFile.getManifest(JarFile.java:180)
at sun.misc.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:944)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:450)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.ataccama.dqc.tasks.io.jdbc.read.JdbcReaderInstance.run(JdbcReaderInstance.java:136)
at com.ataccama.dqc.processor.internal.runner.ComplexStepNode.runNode(ComplexStepNode.java:69)
at com.ataccama.dqc.processor.internal.runner.RunnableNode.run(RunnableNode.java:28)
at com.ataccama.dqc.commons.threads.AsyncExecutor$RunningTask.run(AsyncExecutor.java:131)
at java.lang.Thread.run(Thread.java:745)
02.05.2018 16:02:13 [WARNING] [DqdServerComponent][dqd][dqd-config.xml] Task #1 LMR finished with ERROR:
com.ataccama.dqd.core.DqdProcessingException: Plan “C:\Ataccama\Ataccama-all-11.2.0.ga-2017-09-27-win-x862\workspace\LMR_Testing\Files\engine\load\LMR_LMR_Loans.comp” execution failed: runtime.internal_error.step_fatal_error - Java heap spacejava.lang.OutOfMemoryError: Java heap space
at java.util.jar.Manifest$FastInputStream.(Manifest.java:332)
at java.util.jar.Manifest$FastInputStream.(Manifest.java:327)
at java.util.jar.Manifest.read(Manifest.java:195)
at java.util.jar.Manifest.(Manifest.java:69)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:199)
at java.util.jar.JarFile.getManifest(JarFile.java:180)
at sun.misc.URLClassPath$JarLoader$2.getManifest(URLClassPath.java:944)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:450)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.ataccama.dqc.tasks.io.jdbc.read.JdbcReaderInstance.run(JdbcReaderInstance.java:136)
at com.ataccama.dqc.processor.internal.runner.ComplexStepNode.runNode(ComplexStepNode.java:69)
at com.ataccama.dqc.processor.internal.runner.RunnableNode.run(RunnableNode.java:28)
at com.ataccama.dqc.commons.threads.AsyncExecutor$RunningTask.run(AsyncExecutor.java:131)
at java.lang.Thread.run(Thread.java:745)

at com.ataccama.dqd.internal.engine.process.DqdLocalPlanExecutor.run(DqdLocalPlanExecutor.java:151)
at com.ataccama.dqd.engine.sources.PlanDataSource$PlanDataSourceRtm.run(PlanDataSource.java:107)
at com.ataccama.dqd.internal.engine.process.DqdProcessing.runModel(DqdProcessing.java:233)
at com.ataccama.dqd.internal.engine.process.DqdProcessing.run(DqdProcessing.java:193)
at com.ataccama.dqd.internal.engine.DqdExecutor$DqdTaskRunnable.run(DqdExecutor.java:152)
at com.ataccama.dqd.internal.engine.DqdExecutor$Runner$InnerRunnable.run(DqdExecutor.java:371)
at com.ataccama.dqc.commons.threads.ThreadSet$1.run(ThreadSet.java:52)
at java.lang.Thread.run(Thread.java:745)

Thanks,
Raj.


(zahida) #2

Hi,

go to run configuration
select right hand side tab call “Runtimes”
under VM arguments put this code -Xmx2048m including the - (dash)


(Rajashekhar Reddy) #3

Hi Mirza,
Thank you for quick response, actually on my installation dqc.ini file is accepting only Xmx1024m. If I tried to update it with 2048m then my IDE is not opening.

Thanks,
Raj.


(zahida) #4

oh, I am sorry. seems like your infrastructure team needs to max the memory