KJ
indifferent I’m neutral
KJ October 27, 2009 20:43

First error in EA 5

First error in EA 5: Just creating a profile as usual. Here is the console screen:

27.10.2009 15:17:28 [INFO] Using following licences:
27.10.2009 15:17:28 [INFO] C:\Program Files\DQ Analyzer 6\runtime\lib\..\license_keys\license.plf
27.10.2009 15:17:28 [INFO] Using Ataccama DQ Analyzer configuration file C:\Documents and Settings\klockett\My Documents\CDI\Data Quality\Profiling\Ataccama\TTPRO\ATTARCHIVE\.ATTARCHIVE.plan
27.10.2009 15:17:28 [INFO] Using runtime configuration file C:\Documents and Settings\klockett\Local Settings\Temp\runtimeCfg5671179018732928062.tmp
27.10.2009 15:17:29 [INFO] Ataccama DQ Analyzer engine initialized.
27.10.2009 15:17:29 [INFO] Creating runtime...
27.10.2009 15:17:30 [INFO] Starting runtime...
27.10.2009 15:17:30 [INFO] Running runtime...
27.10.2009 15:28:52 [FATAL] Error in step ATTARCHIVE (cz.adastra.cif.tasks.io.jdbc.read.JdbcReader)

java.lang.OutOfMemoryError: Java heap space
at java.lang.String.(Unknown Source)
at java.lang.StringBuffer.toString(Unknown Source)
at com.microsoft.sqlserver.jdbc.Util.bytesToHexString(Util.java:696)
at com.microsoft.sqlserver.jdbc.DDC.convertStreamToObject(DDC.java:381)
at com.microsoft.sqlserver.jdbc.ServerDTVImpl.getValue(dtv.java:2007)
at com.microsoft.sqlserver.jdbc.DTV.getValue(dtv.java:175)
at com.microsoft.sqlserver.jdbc.Column.getValue(Column.java:113)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.getValue(SQLServerResultSet.java:1982)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.getValue(SQLServerResultSet.java:1967)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.getString(SQLServerResultSet.java:2292)
at cz.adastra.cif.tasks.io.jdbc.A.B.A(SqlStringBinding.java:26)
at cz.adastra.cif.tasks.io.jdbc.read.JdbcReaderInstance.A(JdbcReaderInstance.java:249)
at cz.adastra.cif.tasks.io.jdbc.read.JdbcReaderInstance.run(JdbcReaderInstance.java:132)
at cz.adastra.cif.processor.internal.runner.B.E(ComplexStepNode.java:62)
at cz.adastra.cif.processor.internal.runner.F.run(Node.java:115)
at java.lang.Thread.run(Unknown Source)
27.10.2009 15:28:55 [FATAL] Error in input ATTARCHIVE

java.lang.OutOfMemoryError: Java heap space
at com.ibm.icu.util.ByteArrayWrapper.ensureCapacity(ByteArrayWrapper.java:121)
at com.ibm.icu.util.ByteArrayWrapper.append(ByteArrayWrapper.java:169)
at com.ibm.icu.util.ByteArrayWrapper.set(ByteArrayWrapper.java:142)
at com.ibm.icu.text.RuleBasedCollator.getSortKey(RuleBasedCollator.java:2882)
at com.ibm.icu.text.RuleBasedCollator.getRawCollationKey(RuleBasedCollator.java:1005)
at com.ibm.icu.text.RuleBasedCollator.getCollationKey(RuleBasedCollator.java:924)
at cz.adastra.cif.tasks.profiling.B.T$_A.compare(LocaleStringValueStrategy.java:141)
at cz.adastra.cif.io.sorting.I$_A.A(Frequency.java:210)
at cz.adastra.cif.io.sorting.I.B(Frequency.java:102)
at cz.adastra.cif.io.sorting.I.G(Frequency.java:90)
at cz.adastra.cif.tasks.profiling.C.J$_A.C(PdRuntime.java:361)
at cz.adastra.cif.tasks.profiling.C.J$_B.B(PdRuntime.java:275)
at cz.adastra.cif.tasks.profiling.C.A$_A.B(CompositeProfilingRuntime.java:132)
at cz.adastra.cif.tasks.profiling.C.I.A(RollUpWrap.java:267)
at cz.adastra.cif.tasks.profiling.ProfilingAlgorithmInstance$_B.E(ProfilingAlgorithmInstance.java:335)
at cz.adastra.cif.tasks.profiling.ProfilingAlgorithmInstance$_B.run(ProfilingAlgorithmInstance.java:307)
at java.lang.Thread.run(Unknown Source)
27.10.2009 15:28:55 [FATAL] Error in step Profiler (cz.adastra.cif.tasks.profiling.ProfilingAlgorithm)

java.lang.NullPointerException
at cz.adastra.cif.tasks.profiling.A.E.A(ProfilingResultRoot.java:112)
at cz.adastra.cif.tasks.profiling.ProfilingAlgorithmInstance.run(ProfilingAlgorithmInstance.java:237)
at cz.adastra.cif.processor.internal.runner.B.E(ComplexStepNode.java:62)
at cz.adastra.cif.processor.internal.runner.F.run(Node.java:115)
at java.lang.Thread.run(Unknown Source)
27.10.2009 15:28:55 [INFO] Stopping runtime...
27.10.2009 15:28:55 [INFO] Finished!

27.10.2009 15:28:55 [WARNING] TASK COMPLETED WITH ERRORS. Elapsed time: 00:11:25

Here is the Error Log:



ALSO, still can't pull up previous EA version profiles in the latest version. Same errors as were previously reported.

Regards,

K.J.
1 person has
this question +1
Reply

  • Pavel Nejedly EMPLOYEE
    Pavel Nejedly (Official Rep) October 29, 2009 21:36
    Hi KJ,
    this error signals that the engine ran out of memory during the computation. This usually happens in case of tables that either contain a too many columns (normally, DQ analyzer can handle several hundreds of columns) or contain a large BLOB or CLOB columns (these are arbitrary-length data types used to store large binary or textual data, such as PDF files or structured XML documents). The name of your input table (ATTARCHIVE) suggests that this might be the case of such an archive table.
    DQ Analyzer provides two ways of dealing with data that exceed the "expected" size. You can either set more memory for the engine (this is normally 256MB, but can be increased in Window -> Preferences under the node of Ataccama DQ Analyzer -> Launching) or you can filter out the large columns in the last step of "Create profile" wizard choosing "custom selection" and unchecking the problematic columns.



    In case that this does not solve the issue, could you please provide us with some brief information about th table? The information (such as the column count and column types) can be obtained from the bottom Properties view when you select the table in Explorer.
    Comment
    good answer! good answer! (undo)
  • (some HTML allowed)
    How does this make you feel?     Add Image
    I'm

    e.g. kidding, amused, unsure, silly indifferent, undecided, unconcerned sad, anxious, confused, frustrated happy, confident, thankful, excited

    Cancel