Learn & Share

Hi,I am creating an export operation, I have an entity 01, with a list of users and an entity 02 with email addresses:Entity structure I need to convert this to an export file with the next structure: Export file layoutI would to know if there a step to help me grouping the data for this purpose. Thanks in advance,Alejandro

It is worth immediately clarifying that I have admin rights. I create a policy and after creation there is no block for creating conditions. Are there any guesses? Policy Managment Block 

How to change  environment in ataccama web interface?

Will ataccama support vault model? For example on Day 1 - My name is entered as “Karthika” day 2 - “Kar” Day 3 corrected as “Karthika”. 

I did full profiling for data catalog and it finished successfully, but “Error” occured after when we want to see data. Where there may not be access for source/table?

How to Check whether the target column has only DATE values or not.?

In the second article of Get certified with Ataccama series, we will focus on Adding a Data Source to the Catalog. 👉 First article of the series - #1 Adding Data Sources 🔎 LET’S TEST YOUR SKILLSUsing the ONE Web App, in the ONE Knowledge Catalog module, add your database as a data source. Using the ONE Web App, in the ONE Knowledge Catalog module, add the table you created in ONE Desktop application to the Catalog Items. 💡 How to do it? Go to ONE Web App - Data Catalog - Sources and click on CreateFill in Name and Description (if needed)Fill in Connection details - Select connection type, Name and JDBCAdd Credentials, select Credential type, fill in required information and Test ConnectionSave and publishNavigate to Connections in and click on BrowseSelect your tableFrom Profile menu select ProfileAfter the profiling is done, check that your table is in the Catalog items list Do you have any question or tips&tricks? Let us know in comments section! 

Has anyone successfully connected to Salesforce environments (prod/test/dev etc.) thru One Desktop (13.7.1).  Thanks

We are having a difficult time connecting a MS SQL database to Ataccama

What makes manual data quality so hard to scale in large organization? Is there a step by step approach to automating data quality? Why is an automated DQM system the future of enterprise data quality?You can find an answer to all these questions (and many more!) in our latest whitepaper.👉 Download it here

My organization runs McAfee antivirus.  I’ve just tried out the DQ Analyzer 11 tool and really like it, but it takes forever to start up or perform any actions.  Just starting up, the antivirus pegs 1 CPU for about 30 minutes before the application starts.  And then various actions like starting a new profile or clicking a menu item will also be delayed by several minutes at least.We’ve tried excluding the install directory, but it hasn’t helped.  Any ideas?  Has anyone else run into this issue before, and how did you solve it? 

This is needed when a user would like to go directly to the platform and skip the “login with Azure AD SSO or OKTA” page. This can be turned on (or off) by following the below directions: Login to the Keycloak Administration Console Ensure the Ataccamaone Realm is selected In the left-hand-menu, Click on Authentication Under Flows select Browser  On the Identity Provider Redirector line, click on Actions and select Config a. If you would like to disable (turn off) the auto login - we can select the ‘disabled’ radio button on the Identity provider redirector line Enter the name of the Identity provider, e.g. saml, in both the Alias and Default Identity Provider boxes Select Save

Hi,I am wondering to know if is good idea:use MDC Reader step for delta export operations where we need to complement data from entities of other layer   oradd another Data Sources with full mode of this other entity, then use a Join step to get the information required.  Both are feasible, not sure what is better talking about batch processing, performance, etc.

Hello Ataccama gurus--- Has anyone here integrated with OneTrust before? It’s something that’s come up at 2-3 potential projects at different customers recently, and I’m curious of any previous experience people may have nad, or not with this? (What type of data would be kept at each side, methods of synchronisation (assuming API & metadata readers/writers. Any re-usable components available?)Cheers! 

Can we create custom check on data as per our need and get stats out of it ??for example.. I want to check whether colA has values between list [‘A’,’AB’,’O’,’B’] and stats about the values that are present in data.

I was thinking that this should be possible with a hack to the postgreSQL jdbc configuration using the redshift jdbc driver. Does anyone know if this is possible or if there is another avenue?Edit: I found the connection after the install and properly configured the Redshift driver and connection settings.

I need the party entity (MDC -ataccama one) to send a notification to kafka when insert or update

When I am publish message in kafka, it throw exception error I am using ataccama 12.7 com.ataccama.nme.core.NmeException: java.lang.NullPointerException at com.ataccama.nme.engine.event.handler.SimpleEventProcessor$NmeSimpleEventProcRuntime.publish(SimpleEventProcessor.java:66) at com.ataccama.nme.engine.event.handler.NmeEventPublisherBase$Runner.mainLoop(NmeEventPublisherBase.java:210) at com.ataccama.nme.engine.event.handler.NmeEventPublisherBase$Runner.run(NmeEventPublisherBase.java:172) at java.base/java.lang.Thread.run(Unknown Source)Caused by: java.lang.NullPointerException at com.ataccama.dqc.streaming.io.writer.KafkaWriter.validate(KafkaWriter.java:130) at com.ataccama.dqc.model.validation.ValidationUtils.validateRecursiveInternal(ValidationUtils.java:158) at com.ataccama.dqc.model.validation.ValidationUtils.validateRecursive(ValidationUtils.java:127) at com.ataccama.dqc.tasks.common.config.ValidatingStepConfigBase.validateElement(ValidatingStepConfigBase.java:39) at com.atacca

Hi,We have a problem in a workflow in DQC, with task “Send Mail”, because the generated message is incompatible with the internet message format RFC 5322.When there are at least 2 recipients, in the generated message, the header “to” is duplicate as many times as there are recipients, but the RFC 5322 standard does not allow this.How to correct this problem ?Thanks for your help.

I have Ataccama 12.x version and I do not see their Aggregate functionPlease help, how to get it enabled or patch it Thanks,Mukesh

Full support for team based permissions in Ataccama ONE is coming in v14. However, you may need to implement team based permissions sooner than v14. This document is a guide to how you could achieve this in v13.8. BackgroundPermissions in ONE can be configured as role based or user based. In most cases, configuration by role is preferred as it will usually be a one-time set up, where the role only needs to be configured once in the beginning, then any users allocated to that role will inherit all permissions on role.The out of the box roles in ONE have some capabilities already allocated. These are auto-sharing permissions, which allows the role to have access to all items of that entity. E.g. Your role could have the capability of Rule Owner. This means the user will be automatically be owner of all rules that would ever be created on the platform.But what if your user should only be owner to rules (or any other entities) within their team / division / domain?As it stands in v13.8, th

 This article will explain how you can build a relationship between different entities in Gen 2. Out-of-the-box you can have relationship between the same entities - e.g. Catalog Items. But what if you would like to define a relation between different entities? E.g. Source and Report (custom entity)? Following are steps that will explain how to do it. AssumptionsYou have your two entities between which you would like to have a relationship. For this article we will use source (default entitiy) and report (custom). Create the relationship entityFirst, go to the Global Settings (or Organization) → Metadata Model and create a new entity that will store the relationships. Name it e.g. sourceReportRelationship. It will have following properties:order (Integer) source (Referenced Object: source) target (Referenced Object: report) type (Referenced Object: relationshipType). Put the new relationship entity in metadata entityUnder Metadata model, navigate to the entity metadata. Add a new prope

Ataccama is known and appreciated by our customers for complex, big deployments where massive amounts of data are processed. We were one of the first to support MapReduce and Spark as native pushdown and enable distributed processing across different cluster nodes.Ataccama’s engine works with the major of enterprise data sources and processes them to provide valuable insight, such as statistics of the data, detection of domains, and data quality.To provide the best experience for our customers that use Snowflake, we developed a tighter integration between our technologies. Specifically, we use the Snowflake data processing capabilities in a pushdown manner which means that data is processed directly on Snowflake.The key advantages of this integration are:Lower data transfer costs for the client. Snowflake’s computational capabilities deliver results faster because of reduced IO operations. Customers don’t incur additional costs to maintain external systems for Big Data. Improved securi

Hi Team, I have few data loads that read data using API’s and writing to Snowflake tables. Often the data is incomplete & inconsistent. Im checking if I can use Attacama to compare the data between different snowflake schema’s : eg) Raw vs Curated? I understand we can write SQL Execute (select col1 from Tab A minus select col1 from Tab b and create a plan. But i have 500+ jobs and needs a lot of plans to be created. Looking for correct way of doing this?