Learn & Share

Hello,I have a monitoring project, and inside, there is a table (operations). This table is populated by ETL daily, and every day the ETL job finishes at a different time. That's why I can't assign a specific schedule to this monitoring project. There is another table (job_status) that shows the condition of the ETL job. Inside that table, there is a column named 'Status of ETL JOB'. If the value in that column is 'Completed,' then it means the job has completed, and now the monitoring project can be run. How can I create such a schedule for that MP?I would be grateful if you can help me. Thanks in advance.

Hi everyone! We hope that you’ve found our Getting Started with Data Governance best practice series useful! This week we are continuing the Getting Started series with Data Observability 🔭 In this post, we will introduce you to the key components of Data Observability and guide you through the process of configuring it for your data source. Understanding Data Observability Data Observability expands on the existing data quality monitoring capabilities in Ataccama. It allows you to gain insights into the state of your data by monitoring data quality, detecting anomalies, and tracking schema changes. The key components of data observability are:Data quality monitoring: Regularly checks data against predefined data quality rules, providing results and trends based on business terms or domains. AI-powered anomaly detection: Utilizes AI to identify unpredictable data quality issues, such as sudden drops in data volumes or average values in specific columns. Data discovery: Monitors and tr

Hello Community: Iam on version 14.5.1 and I would like to create a custom term type - in addition to the three types that are available out of box such as Business Terms, Key Performance Indicator and Security Terms. If a new type is NOT possible, i would like to rename one of them to meet my needs. Can someone throw some details on how to do that? 

This may have a very simple solution. I have a workflow that runs a component with a Json Call that does an API call. If the API call succeeds the data is stored in a database table. No problem. But what to do if it fails? In the Json Call I've created a Response Code Column called jsoncall_response. And if jsoncall_response=200 that means it was successful. But what to do if it is not successful? I can use a text writer to write that data to file. Actually I would like to see the component and the workflow fail. But there isn't a "Break” or “Fail” step as far as I can see. The closest that I can find is the Stop Reading step.BTW I've tried Stop Reading, but it seems to ignore my condition.In the Jscon Call I put in a misformed url and in the debug it clearly gave a HTTP 405 response. That didn't seem to stop it from going further. In the SNOW response output file it even wrote that jsoncall_response was indeed 405. Alternatively I've been thinking about maybe sending notifications fro

Currently I created a Monitoring Project for a team that has a Catalog Item included called: CI A. They want that particular CI, with applied DQ checks (thus the MP), to be scheduled every month.Few weeks later the team requested to add another Catalog Item called CI B. They want this CI, with applied DQ checks, to be scheduled every week.Few weeks later the team requested to add another Catalog Item called CI C. They want this CI, with applied DQ checks, to be scheduled every day.At this point I'm running the MP every day, meaning it's also running CI A and CI B which don't need to be run every day. I'm told I need to create a seperate MP specific for the schedule in order to seperate this. Having three or more different MP for one team can be very dissatisfying and takes up a lot of space when looking at an overview. Whereas if it's one MP with a builtin feature to have more schedules specific for CIs is where my ideal vision is at (in my opinion).Q: Is it possible to have one, singl

Is there any integration between Ataccama and DBT to read the DQ rules that are defined in DBT?

Hi Community,When defining a metadatareader you can add the parent ID in the output by specifying the Parent ID Column Name in the Columns tab. It is not always clear though to which entity this parent ID belongs (and browsing the model graph is often cumbersome).Is there a way to identify the entity for a given GID value?Thanks and kind regards,Albert

How do I create two lookups and link them together so that a particular element in one of the lookups is mapped to a element in another lookup in web app .

For a near future project we want to get capability data on terms. We have a graphQL query to get this data (the hardcoded gid is just for experimentation sake. It will be parameterized of course):query GetCapabilities_term {   term(gid:  "5877cd9a-0000-7000-0000-000000b63f13") {     gid     assignedIdentities {       capability {         name         id         operationSets {           name           displayName           id         }       }       identity {         ... on Role {           name           ... on GroupRole {             name             gid           }         }       }     }   } } I've created this very simple component to explore working with this data.  Here is the Json Call:And the data stream in the Json Call:It runs the graphQL query and gets the results. In the Json Call debug with response data I can see the call was successful and we have data.But it will get multiple results for multiple capabilities. This Json Call just writes the last line of the list to t

In the Getting Started with ONE DG: Collaboration & Tasks article, it mentions that you are able to delete tasks and all subtasks.  Deleting: When you delete a task, all related subtasks and comments are deleted as well. You can delete subtasks and comments individually. To delete a task: Expand the more options menu of the task. Select "Delete". Confirm the deletion. Unable to locate Options Menu of the task to perform the deletion.  What am I missing to perform these deletions?  

Hello everyone,How can I replace null values in a column with a float data type in OneWeb? I need to substitute null values with 0 and apply a formula in advanced expressions.Thanks in advance.

I am getting started with ataccama at the moment so I was curious to know something. While I was exploring business terms I came across a thing in the settings section in a particular business term that goes as detection on tables so according to my understanding of ataccama detection rules are applied on business terms and then they are in turn applied to attributes so according this section can we apply detection rules directly on tables as well and can you please explain how does that work? 

I am still building our solution to automatically create ServiceNow incidents for data quality issues. After creating an incident in ServiceNow you get a JSON body as response with a link to that incident. I want to store this link in a database and later check if the incident is still active.The URL looks like this;https://mydev.service-now.com/api/now/table/incident/a1b02c3456d78e9012f34g56h78i90jkIn my environment I have a generic server with the url https://mydev.service-now.com/, Now all we have to do, is add the second part dynamically and feed that to the Json Call step.My simple component to experiment with this looks like this: For now I'm just going to put the second part of the url in an Alter Format step: I believe I read somewhere that record_link must be mapped as a parameter for this to work. Only if you want to enter it as a value whenever you run the component or if you want to pass a parameter from a workflow. But that's not in my plans currently. So I won't map it as

So recently I’ve been working on workflows and schedulers, my current task is to schedule a workflow in/using the Webapp and not in IDE, is there any support documentation based on this problem? I’ve already completed the IDE workflow tutorials and scheduling workflows using one runtime server. Thanks!

Hi, I'm setting up an approval workflow in ONE Desktop and need to execute identical plans on Workflow state: Draft and Workflow state: Published, each having their own plan file. Although the plans are identical, I know for certain that the two outputs should be different. However, I am currently getting the same output for both. Both workflows consist of a metadata reader to an excel file writer. Could there be a glitch running identical plans for different workflow states?

Hello Community, I use an import .csv file to load catalog item attribute data into OneWeb with a Desktop plan.The .csv file has the attributes in the same order as they appear in the underlying table.When these attributes are imported with the plan, in OneWeb for the catalog item I see the attributes in a different order as compared to the csv.Is there a way to keep the order in accordance with the import .csv file? Thank you in advance!

I am building a component that carefully prepares input in an Alter format step to be used in a Json Call that creates a ServiceNow incident. One of those added columns is called load_id. I want to store the output of the Json Call in a database table _with_ the load_id. So that I can relate data in the table with output with other tables.This is my Alter format step before the Json Call:load_id is mapped as a parameter coming from the workflow that runs the component. That works. And when I run the component standalone and fill in load_id by hand, that also works.So here is my data stream in the Json call:Adding load_id probably won't work here, because after all it's not part of the JSON output from the ServiceNow call.When I read the snowresponse data stream and send it to a Jdbc Writer I have no load_id. I've tried adding it as a shadow column, but the Jdbc Writer then complains that load_id is null (and I set the table column as not null). So the currently I use this hacky way to

Hi folks, I have a date format that I need to validate using a DG rule in Ataccama ONE. I don’t need to do anything with it, just validate that the format is as expected. Any ideas on how I can achieve this please?Many thanksDC 

Currently we updating Catalog Items and Attribute metadata (description, classification, and terms) via desktop plan (bulk) and would like to create one overall task with sub-tasks for each ‘categorized’ catalog item or attribute. Example:Execution one desktop plan updates 100 attributes - SIN and Surname with  descriptions, classifications, or terms; Trigger a creation of a 1 task called Review/Approve Metadata with 2 sub-tasks based on the 2 attribute names Assign the tasks to a defaulted group (Data Catalog Enrichment Arbitration Group) with a requirement of all members of that group approved or reject with an reason prior to completing the task. 

Hi,I have a table where a datetime column is present with several records:number    datetimecolumn1              2024-02-01 00:00:00 2             2024-02-02 00:00:00I want a DQ Rule that filters out the datetime records that do not start with the first of the month. Meaning number 1 is valid, number 2 is invalid. I couldn't find anything useful in the condition builder option and the advanced expression (even through documentation in ONE expression) is giving me headache. Any suggestions how to fulfill this?