Learn & Share

Hi,I have a table where a datetime column is present with several records:number    datetimecolumn1              2024-02-01 00:00:00 2             2024-02-02 00:00:00I want a DQ Rule that filters out the datetime records that do not start with the first of the month. Meaning number 1 is valid, number 2 is invalid. I couldn't find anything useful in the condition builder option and the advanced expression (even through documentation in ONE expression) is giving me headache. Any suggestions how to fulfill this?

Hello,I am currently working on a data masking project in ONE Desktop and I'm seeking some advice on how to approach a specific scenario using two tables.I have two CSV files: Classification Table (CSV #1): This table contains two columns - 'ColumnName' and 'DataClassification'. The 'ColumnName' field lists the names of various columns, and 'DataClassification' provides their respective data classifications, such as "Restricted", "Confidential", "Public", or it may be blank. Data Table (CSV #2): This table contains multiple columns, named according to the entries in the 'ColumnName' field of the Classification Table. Each column holds different sets of data. Classification Table (CSV #1):ColumnName DataClassification Name Confidential Age Public Email Restricted  Data Table (CSV #2):Name Age Email Alice 30 alice@example.com Bob 25 bob@example.com  My goal is to mask the data in the Data Table (CSV #2) based on the classification provided in the Classificati

Hello hive mind,Has anyone out there who have RDM v14.3 or later, and successfully used the new RDM REST API feature?We’ve upgraded our dev environment to v14.5.1 this week, I tried the REST API, and it keeps returning with “java.lang.Exception: org.springframework.security.access.AccessDeniedException: Cannot access entity: address_type” error. (Was trying to query my entity called address_type)I ensured my service account client has full access to the table. That service account client calls other API endpoints that I have built before on rdm-server and that authenticates fine.I wonder what I’m missing. Anybody successful before and we can compare notes?Thanks!

Yes, it is clearly stated in the documentation (Scheduler - Ataccama ONE Gen2 Platform Latest), but it is also easy to overlook: scheduling plans for workflows look a bit like crontab schedules. But they aren't.Example workflow scheduling plan:<?xml version='1.0' encoding='UTF-8'?><scheduleDefinition>        <description>ATAC_DWH - Load Dimensions and Facts</description>        <enabled>true</enabled>        <job workflow="myorg:ATAC_DWH_dims_and_facts.ewf" class="com.ataccama.adt.scheduler.job.WorkflowJob"/>        <scheduling>0 20 1-5 *</scheduling></scheduleDefinition> For example, when you want to schedule workflow Monday to Friday at 20:00 you might think “easy, I just go to crontab.guru, Fill in what I want and voila”: the schedule plan will be 0 20 * * 1-5.Except you will notice that your workflow will also run in weekends. Because the format of the workflow scheduler is:minutes hours day_of_week day_of_monthIt has only

Hi, I have my input like below example. May I know how can I transpose the data from columns to rows? Input Data: Pilot_Yr10 Vermont_Yr10 Pilot_Yr9 Vermont_Yr9 Pilot_Yr8 Vermont_Yr8 2014 2014 2015 2015 2016 2016 9.67 9.67 -3.76 -3.76 18.4 18.4 9.02 9.02 -4.33 -4.33 17.7 17.7 13.69 13.69 1.41 1.41 11.96 11.96  Expected Output Data:  Period Pilot Vermont SI Since Inception 1/1/91 Since Inception 1/1/91 Yr1 2023 2023 Yr10 2014 2014 Yr2 2022 2022 Yr3 2021 2021 Yr4 2020 2020 Yr5 2019 2019 Yr6 2018 2018 Yr7 2017 2017 Yr8 2016 2016 Yr9 2015 2015

Hi Team, require help- when clicking on any entity in web URL, popup error box and not able to edit for seach any records.error- "getRowsWithDraftsFailed to determine origin for record party, id = 37104” MDM log capture as per below:2024-02-09 19:24:33,338 ←[39mDEBUG←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:31←[0;39m - actionId=findRecords() status=START2024-02-09 19:24:33,355 ←[31mWARN ←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:51←[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Error: Failed to determine origin for record party, id = 371042024-02-09 19:24:33,356 ←[31mWARN ←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:51←[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Description: java.lang.NullPointerException: Failed to determine origin for record party, id = 37104        at com.ataccama.dqc.commons.util.AssertUtil.as

On my virtual desktop I have two ways I do an API call to ServiceNow to create an incident.With Postman it is working. I've managed to create an incident in ServiceNow serveral times.With One Desktop, with the same URL, header and JSON body I get Connection reset every time. And the Json call response debug file isn't even created.So here is my Postman setup:Authorization is a basic auth. Headers:When I run this I get the following response:{    "import_set": "ISET0012345",    "staging_table": "u_str_call",    "result": [        {            "transform_map": "STR - Call API",            "table": "incident",            "display_name": "number",            "display_value": "INC0217277",            "record_link": "https://mydev.service-now.com/api/now/table/incident/8c47e2e6472fb11016fd2e61e36d4336",            "status": "inserted",            "sys_id": "8c47e2e6472fb11016fd2e61e36d4336"        }    ]}Now here is my One Desktop setup:And my component with Json Call:This is my Json Call:An

Querying APIs via GraphQLDid you know that your ONE solution already comes with a preconfigured GraphQL interface that can be used to run API queries in your web application?The GraphQL Playground is available at the following URL: <web_app_URL>/playground. You can use the queries for a wide range of operations to read or manipulate data in the Ataccama application, for instance:Listing your Catalog Items, associated Terms or Connection Sources Checking the status of your Catalog items Trigger a Profiling of a Catalog item Publish an Entity from a Draft state … and many more!ExampleList all available Catalog items via a query: Make sure you get familiar with this powerful feature. Visit the following page and get familiar with the basics via following a series of simple use cases. Good luck!

Read the metadata from the connected source systems like descriptions, null constraints, policy tags, primary keys in Ataccama one

Hi All,require help on below error "This user does not have sufficient rights to access the application”.

Would you like to cover the case what will happen when a user enters her/his credentials incorrectly many times? The setting of Max Login Failure can be set in Keycloak Admin Console, follow these steps:Log into Keycloak Admin Console Go to Realm Settings (Ataccamaone) on the left-hand menu Go to Security Defenses tab Select Brute Force Detection and enable the feature Set the Max Login Failure to the desired amountBrute Force Detection before enablementWhen enabled, all setting can be changed accordingly to your needs Any question or comment? Let us know!

I have a ‘provider_name’ cleansing component under ‘provider’ component. When I test the ‘provider_name’ cleansing component on DQS in a test plan, the values on pur* and out* fields look good. And the provider component shows the propertied of the name component as but for some reason, none of my changes are reflected or seen when the component is deployed with changes and subject is reprocessed. Am I missing something? I did debug at the name level and the component level, the values come out right but not after being deployed and reprocessed. Any suggestions?

Hi All,as we are adding more data product to our Ataccama One environment als more profiling jobs run every morning. For every succesful job from the processing center we currently get a flash pop up that it ran succesfull. Can we somehow hide these pop-ups? Or only show the failed ones for instance?Regard, Jur Dördregter

Hi, is ataccama one available for deployment in VM?Because of data confidentiality and system requirement, i need to deploy data catalog & governance tool in VM within private network. if available, can someone provide link for documentation for VM deployment?need to check the sizing, required component, etcalso do ataccama one (cloud) support private link to aws cloud?   thank you

Hey community,The term overview screen shows the entries of all types.I would like to implement a ‘term type’-filter (via Application Settings → Search Configurations) on that page. For that I need to know in which entity and property term type has been implemented, but I cannot find that. We have version 13.9.4.Does anyone have a clue?Kind regards,Albert de Ruiter

Hi,  What is Fractional digit used for? Can it help to identify character length within an attribute? 

I'm trying to connect to a SericeNow API to create data quality related incidents. (see: ServiceNow API call keeps running into Connection reset | Community (ataccama.com)).It is now pretty clear this is failing because the proxy isn't letting me through. And it also now seems pretty clear I need to use a certificate to authenticate on the proxy.So I have .crt file that I might use. But where do I change the config of One Desktop so it will use it?Under Window > Preferences > Network Connections you can find the proxy settings:But the proxy settings have no certificate settings: Under Network Connections there is a SSH2 screen, but I have no idea where to enter the location of my .crt file here. Any idea? 

I have tried to implement MS teams notifications for the monitoring projects - but after following the instructions in the user documentation ( https://support.ataccama.com/home/docs/aip/14.3.0/development-guides/one-development-guide/configuring-the-one-web-application/ms-teams-integration ) I don’t get any messages to my teams channel, is there something else that needs to be configured for this to work? 

Hi,does anybody have experience with integrating with service now? We want to create an incident on a dq check that breaches a threshold to raise an incident. Any examples?

How to delete orphan but active records on source and instance table in Omnihealthdata. The records were deleted at source but the load to onramp was missed for delete batch. Is there other way I could delete these records from _s(source) and instance tables? Is a manual SQL delete a right way to go with or would it cause any future issues?

I’m using RDM 14.2 (soon to be upgraded to 14.5) and I need to build an API endpoint to accept incoming data.I have an integration input and will use an RDM Importer step to import the data into my table.My table has a generated id as a primary key and I need to provide the generated id as a response back to the incoming API call.But the RDM Importer step stops there. It doesn’t tell me the id. How do I then get the id back? I could make an RDM Extended Reader step in the plan, but I cannot guarantee the Reader step is executed after the Importer step, because the Importer step doesn’t have an out endpoint, it only has an err endpoint. And if I query the data before the insert is committed then I will end up with nothing to provide. Any ideas? (I believe the new RDM REST API functionality is read only so that won’t be relevant here?)

We are on version 14.2 and trying to create a connection to Microsoft OneDrive, so we can export some data from RDM to it. We are planning to write the data using onPublish plan.We see that Ataccama ONE supports Onedrive in the ONE webapp (https://support.ataccama.com/home/docs/aip/14.2.0/user-guides/one-web-application-user-guide/knowledge-catalog/data-catalog/working-with-data-sources/microsoft-onedrive-storage-connection)But I cannot find a corresponding connection type in ONE Desktop. In here One drive is not an option: How can we set this up please?

 Hello everyone!In the new version of Ataccama 14.5, how is the configuration done for regular scanning of data schemas to detect the appearance of new tables: metadata import? I need to regularly automatically import tables based on a specific schema that are not in the Catalog Item.I will be very grateful for your help🤗Thank you!

I got 2 questionsFirst: how can I replicate my DQ rules from one environment to another ? (example: from dev to QA)Second: how can I make the rules automatically replicate to new records on a table ? Like if I have a table with 500 rows and I add 50 more rows, I need to re apply the rules to all the table, instead I wanna make it in an incremental way so only my new records would need to have the rules applied.