Data Quality & Catalog ⚙️

I am getting started with ataccama at the moment so I was curious to know something. While I was exploring business terms I came across a thing in the settings section in a particular business term that goes as detection on tables so according to my understanding of ataccama detection rules are applied on business terms and then they are in turn applied to attributes so according this section can we apply detection rules directly on tables as well and can you please explain how does that work? 

I am still building our solution to automatically create ServiceNow incidents for data quality issues. After creating an incident in ServiceNow you get a JSON body as response with a link to that incident. I want to store this link in a database and later check if the incident is still active.The URL looks like this;https://mydev.service-now.com/api/now/table/incident/a1b02c3456d78e9012f34g56h78i90jkIn my environment I have a generic server with the url https://mydev.service-now.com/, Now all we have to do, is add the second part dynamically and feed that to the Json Call step.My simple component to experiment with this looks like this: For now I'm just going to put the second part of the url in an Alter Format step: I believe I read somewhere that record_link must be mapped as a parameter for this to work. Only if you want to enter it as a value whenever you run the component or if you want to pass a parameter from a workflow. But that's not in my plans currently. So I won't map it as

So recently I’ve been working on workflows and schedulers, my current task is to schedule a workflow in/using the Webapp and not in IDE, is there any support documentation based on this problem? I’ve already completed the IDE workflow tutorials and scheduling workflows using one runtime server. Thanks!

Hi, I'm setting up an approval workflow in ONE Desktop and need to execute identical plans on Workflow state: Draft and Workflow state: Published, each having their own plan file. Although the plans are identical, I know for certain that the two outputs should be different. However, I am currently getting the same output for both. Both workflows consist of a metadata reader to an excel file writer. Could there be a glitch running identical plans for different workflow states?

Hello Community, I use an import .csv file to load catalog item attribute data into OneWeb with a Desktop plan.The .csv file has the attributes in the same order as they appear in the underlying table.When these attributes are imported with the plan, in OneWeb for the catalog item I see the attributes in a different order as compared to the csv.Is there a way to keep the order in accordance with the import .csv file? Thank you in advance!

I am building a component that carefully prepares input in an Alter format step to be used in a Json Call that creates a ServiceNow incident. One of those added columns is called load_id. I want to store the output of the Json Call in a database table _with_ the load_id. So that I can relate data in the table with output with other tables.This is my Alter format step before the Json Call:load_id is mapped as a parameter coming from the workflow that runs the component. That works. And when I run the component standalone and fill in load_id by hand, that also works.So here is my data stream in the Json call:Adding load_id probably won't work here, because after all it's not part of the JSON output from the ServiceNow call.When I read the snowresponse data stream and send it to a Jdbc Writer I have no load_id. I've tried adding it as a shadow column, but the Jdbc Writer then complains that load_id is null (and I set the table column as not null). So the currently I use this hacky way to

Hi folks, I have a date format that I need to validate using a DG rule in Ataccama ONE. I don’t need to do anything with it, just validate that the format is as expected. Any ideas on how I can achieve this please?Many thanksDC 

Currently we updating Catalog Items and Attribute metadata (description, classification, and terms) via desktop plan (bulk) and would like to create one overall task with sub-tasks for each ‘categorized’ catalog item or attribute. Example:Execution one desktop plan updates 100 attributes - SIN and Surname with  descriptions, classifications, or terms; Trigger a creation of a 1 task called Review/Approve Metadata with 2 sub-tasks based on the 2 attribute names Assign the tasks to a defaulted group (Data Catalog Enrichment Arbitration Group) with a requirement of all members of that group approved or reject with an reason prior to completing the task. 

Hi,I have a table where a datetime column is present with several records:number    datetimecolumn1              2024-02-01 00:00:00 2             2024-02-02 00:00:00I want a DQ Rule that filters out the datetime records that do not start with the first of the month. Meaning number 1 is valid, number 2 is invalid. I couldn't find anything useful in the condition builder option and the advanced expression (even through documentation in ONE expression) is giving me headache. Any suggestions how to fulfill this?

Hello,I am currently working on a data masking project in ONE Desktop and I'm seeking some advice on how to approach a specific scenario using two tables.I have two CSV files: Classification Table (CSV #1): This table contains two columns - 'ColumnName' and 'DataClassification'. The 'ColumnName' field lists the names of various columns, and 'DataClassification' provides their respective data classifications, such as "Restricted", "Confidential", "Public", or it may be blank. Data Table (CSV #2): This table contains multiple columns, named according to the entries in the 'ColumnName' field of the Classification Table. Each column holds different sets of data. Classification Table (CSV #1):ColumnName DataClassification Name Confidential Age Public Email Restricted  Data Table (CSV #2):Name Age Email Alice 30 alice@example.com Bob 25 bob@example.com  My goal is to mask the data in the Data Table (CSV #2) based on the classification provided in the Classificati

Yes, it is clearly stated in the documentation (Scheduler - Ataccama ONE Gen2 Platform Latest), but it is also easy to overlook: scheduling plans for workflows look a bit like crontab schedules. But they aren't.Example workflow scheduling plan:<?xml version='1.0' encoding='UTF-8'?><scheduleDefinition>        <description>ATAC_DWH - Load Dimensions and Facts</description>        <enabled>true</enabled>        <job workflow="myorg:ATAC_DWH_dims_and_facts.ewf" class="com.ataccama.adt.scheduler.job.WorkflowJob"/>        <scheduling>0 20 1-5 *</scheduling></scheduleDefinition> For example, when you want to schedule workflow Monday to Friday at 20:00 you might think “easy, I just go to crontab.guru, Fill in what I want and voila”: the schedule plan will be 0 20 * * 1-5.Except you will notice that your workflow will also run in weekends. Because the format of the workflow scheduler is:minutes hours day_of_week day_of_monthIt has only

Hi, I have my input like below example. May I know how can I transpose the data from columns to rows? Input Data: Pilot_Yr10 Vermont_Yr10 Pilot_Yr9 Vermont_Yr9 Pilot_Yr8 Vermont_Yr8 2014 2014 2015 2015 2016 2016 9.67 9.67 -3.76 -3.76 18.4 18.4 9.02 9.02 -4.33 -4.33 17.7 17.7 13.69 13.69 1.41 1.41 11.96 11.96  Expected Output Data:  Period Pilot Vermont SI Since Inception 1/1/91 Since Inception 1/1/91 Yr1 2023 2023 Yr10 2014 2014 Yr2 2022 2022 Yr3 2021 2021 Yr4 2020 2020 Yr5 2019 2019 Yr6 2018 2018 Yr7 2017 2017 Yr8 2016 2016 Yr9 2015 2015

On my virtual desktop I have two ways I do an API call to ServiceNow to create an incident.With Postman it is working. I've managed to create an incident in ServiceNow serveral times.With One Desktop, with the same URL, header and JSON body I get Connection reset every time. And the Json call response debug file isn't even created.So here is my Postman setup:Authorization is a basic auth. Headers:When I run this I get the following response:{    "import_set": "ISET0012345",    "staging_table": "u_str_call",    "result": [        {            "transform_map": "STR - Call API",            "table": "incident",            "display_name": "number",            "display_value": "INC0217277",            "record_link": "https://mydev.service-now.com/api/now/table/incident/8c47e2e6472fb11016fd2e61e36d4336",            "status": "inserted",            "sys_id": "8c47e2e6472fb11016fd2e61e36d4336"        }    ]}Now here is my One Desktop setup:And my component with Json Call:This is my Json Call:An

Querying APIs via GraphQLDid you know that your ONE solution already comes with a preconfigured GraphQL interface that can be used to run API queries in your web application?The GraphQL Playground is available at the following URL: <web_app_URL>/playground. You can use the queries for a wide range of operations to read or manipulate data in the Ataccama application, for instance:Listing your Catalog Items, associated Terms or Connection Sources Checking the status of your Catalog items Trigger a Profiling of a Catalog item Publish an Entity from a Draft state … and many more!ExampleList all available Catalog items via a query: Make sure you get familiar with this powerful feature. Visit the following page and get familiar with the basics via following a series of simple use cases. Good luck!

Read the metadata from the connected source systems like descriptions, null constraints, policy tags, primary keys in Ataccama one

I have a ‘provider_name’ cleansing component under ‘provider’ component. When I test the ‘provider_name’ cleansing component on DQS in a test plan, the values on pur* and out* fields look good. And the provider component shows the propertied of the name component as but for some reason, none of my changes are reflected or seen when the component is deployed with changes and subject is reprocessed. Am I missing something? I did debug at the name level and the component level, the values come out right but not after being deployed and reprocessed. Any suggestions?

Hi All,as we are adding more data product to our Ataccama One environment als more profiling jobs run every morning. For every succesful job from the processing center we currently get a flash pop up that it ran succesfull. Can we somehow hide these pop-ups? Or only show the failed ones for instance?Regard, Jur Dördregter

Hi, is ataccama one available for deployment in VM?Because of data confidentiality and system requirement, i need to deploy data catalog & governance tool in VM within private network. if available, can someone provide link for documentation for VM deployment?need to check the sizing, required component, etcalso do ataccama one (cloud) support private link to aws cloud?   thank you

Hey community,The term overview screen shows the entries of all types.I would like to implement a ‘term type’-filter (via Application Settings → Search Configurations) on that page. For that I need to know in which entity and property term type has been implemented, but I cannot find that. We have version 13.9.4.Does anyone have a clue?Kind regards,Albert de Ruiter

Hi,  What is Fractional digit used for? Can it help to identify character length within an attribute? 

I'm trying to connect to a SericeNow API to create data quality related incidents. (see: ServiceNow API call keeps running into Connection reset | Community (ataccama.com)).It is now pretty clear this is failing because the proxy isn't letting me through. And it also now seems pretty clear I need to use a certificate to authenticate on the proxy.So I have .crt file that I might use. But where do I change the config of One Desktop so it will use it?Under Window > Preferences > Network Connections you can find the proxy settings:But the proxy settings have no certificate settings: Under Network Connections there is a SSH2 screen, but I have no idea where to enter the location of my .crt file here. Any idea? 

I have tried to implement MS teams notifications for the monitoring projects - but after following the instructions in the user documentation ( https://support.ataccama.com/home/docs/aip/14.3.0/development-guides/one-development-guide/configuring-the-one-web-application/ms-teams-integration ) I don’t get any messages to my teams channel, is there something else that needs to be configured for this to work? 

Hi,does anybody have experience with integrating with service now? We want to create an incident on a dq check that breaches a threshold to raise an incident. Any examples?