Learn & Share

Hey all!I am working through a use case that wants to check if data is being populated. The issue I am facing is that when there are no records being populated, the case statements I am using will not work (due to no records being in the table) and no rule seems to work as well due to the fact that when no records are passed through a monitoring project, it “passes” but shows that there are 0 records. Is there a default value that Ataccama will show on the back end that I can check for on a rule?I also want to add that they stated they do not want to use anomaly detection due to the fact that we cannot be 100% guaranteed that it will catch no records being populated.Has anyone else faced this issue previously? Looking for any assistance here.Thanks!

Hello Community: Iam on version 14.5.1. WE have created a custom field for Catalog items to flag (a boolean field) whether the data is certified for consumption. I would like to update from a batch file to the few hundred catalog items. Is there a template anyone has  - to update catalog items ? I have previously used a component for updating catalog attributes (like fields in a table), but here i need to update the catalog item itself (and not the attribute). appreciate anyone sharing a template of a component that i can adopt and use. 

Hello,I'd like to set up a rule for the 'transaction_date' column to verify if the latest date in the column equals to previous work day. How can I do this? Is there any function for that?  If there isn’t , we also have an additional calendar table where  previous work day indicated for each date. But how can I indicate another table inside a rule?Thanks in advance.

Short question here: I'm creating a debug step that writes to a database table. In that I would like to put the name (or path?) of the component that was running. Is there some kind of system variable (similar to $ewf_workflow_id in workflows)? 

I want to load around 832,032 records from Excel file to DB table using Plan. Plan is not executing.It giving below error message :-1)Not enough memory to run the plan file. java.lang.OutOfMemoryError: Java heap space     at org.apache.commons.io.IOUtils.byteArray(IOUtils.java:338)     at org.apache.commons.io.output.AbstractByteArrayOutputStream.needNewBuffer(AbstractByteArrayOutputStream.java:104)     at org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream.<init>(UnsynchronizedByteArrayOutputStream.java:51)     at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:181)     at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:153)     at org.apache.poi.openxml4j.util.ZipArchiveFakeEntry.<init>(ZipArchiveFakeEntry.java:67)     at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource.<init>(ZipInputStreamZipEntrySource.java:98)     at org.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:132)     at org.apache.poi.openxml4j.opc.OPCP

Hello,I have a monitoring project, and inside, there is a table (operations). This table is populated by ETL daily, and every day the ETL job finishes at a different time. That's why I can't assign a specific schedule to this monitoring project. There is another table (job_status) that shows the condition of the ETL job. Inside that table, there is a column named 'Status of ETL JOB'. If the value in that column is 'Completed,' then it means the job has completed, and now the monitoring project can be run. How can I create such a schedule for that MP?I would be grateful if you can help me. Thanks in advance.

Hi everyone! We hope that you’ve found our Getting Started with Data Governance best practice series useful! This week we are continuing the Getting Started series with Data Observability 🔭 In this post, we will introduce you to the key components of Data Observability and guide you through the process of configuring it for your data source. Understanding Data Observability Data Observability expands on the existing data quality monitoring capabilities in Ataccama. It allows you to gain insights into the state of your data by monitoring data quality, detecting anomalies, and tracking schema changes. The key components of data observability are:Data quality monitoring: Regularly checks data against predefined data quality rules, providing results and trends based on business terms or domains. AI-powered anomaly detection: Utilizes AI to identify unpredictable data quality issues, such as sudden drops in data volumes or average values in specific columns. Data discovery: Monitors and tr

Hello Community: Iam on version 14.5.1 and I would like to create a custom term type - in addition to the three types that are available out of box such as Business Terms, Key Performance Indicator and Security Terms. If a new type is NOT possible, i would like to rename one of them to meet my needs. Can someone throw some details on how to do that? 

This may have a very simple solution. I have a workflow that runs a component with a Json Call that does an API call. If the API call succeeds the data is stored in a database table. No problem. But what to do if it fails? In the Json Call I've created a Response Code Column called jsoncall_response. And if jsoncall_response=200 that means it was successful. But what to do if it is not successful? I can use a text writer to write that data to file. Actually I would like to see the component and the workflow fail. But there isn't a "Break” or “Fail” step as far as I can see. The closest that I can find is the Stop Reading step.BTW I've tried Stop Reading, but it seems to ignore my condition.In the Jscon Call I put in a misformed url and in the debug it clearly gave a HTTP 405 response. That didn't seem to stop it from going further. In the SNOW response output file it even wrote that jsoncall_response was indeed 405. Alternatively I've been thinking about maybe sending notifications fro

Currently I created a Monitoring Project for a team that has a Catalog Item included called: CI A. They want that particular CI, with applied DQ checks (thus the MP), to be scheduled every month.Few weeks later the team requested to add another Catalog Item called CI B. They want this CI, with applied DQ checks, to be scheduled every week.Few weeks later the team requested to add another Catalog Item called CI C. They want this CI, with applied DQ checks, to be scheduled every day.At this point I'm running the MP every day, meaning it's also running CI A and CI B which don't need to be run every day. I'm told I need to create a seperate MP specific for the schedule in order to seperate this. Having three or more different MP for one team can be very dissatisfying and takes up a lot of space when looking at an overview. Whereas if it's one MP with a builtin feature to have more schedules specific for CIs is where my ideal vision is at (in my opinion).Q: Is it possible to have one, singl

Is there any integration between Ataccama and DBT to read the DQ rules that are defined in DBT?

Hi Community,When defining a metadatareader you can add the parent ID in the output by specifying the Parent ID Column Name in the Columns tab. It is not always clear though to which entity this parent ID belongs (and browsing the model graph is often cumbersome).Is there a way to identify the entity for a given GID value?Thanks and kind regards,Albert

How do I create two lookups and link them together so that a particular element in one of the lookups is mapped to a element in another lookup in web app .

For a near future project we want to get capability data on terms. We have a graphQL query to get this data (the hardcoded gid is just for experimentation sake. It will be parameterized of course):query GetCapabilities_term {   term(gid:  "5877cd9a-0000-7000-0000-000000b63f13") {     gid     assignedIdentities {       capability {         name         id         operationSets {           name           displayName           id         }       }       identity {         ... on Role {           name           ... on GroupRole {             name             gid           }         }       }     }   } } I've created this very simple component to explore working with this data.  Here is the Json Call:And the data stream in the Json Call:It runs the graphQL query and gets the results. In the Json Call debug with response data I can see the call was successful and we have data.But it will get multiple results for multiple capabilities. This Json Call just writes the last line of the list to t

In the Getting Started with ONE DG: Collaboration & Tasks article, it mentions that you are able to delete tasks and all subtasks.  Deleting: When you delete a task, all related subtasks and comments are deleted as well. You can delete subtasks and comments individually. To delete a task: Expand the more options menu of the task. Select "Delete". Confirm the deletion. Unable to locate Options Menu of the task to perform the deletion.  What am I missing to perform these deletions?  

Hello everyone,How can I replace null values in a column with a float data type in OneWeb? I need to substitute null values with 0 and apply a formula in advanced expressions.Thanks in advance.

I am getting started with ataccama at the moment so I was curious to know something. While I was exploring business terms I came across a thing in the settings section in a particular business term that goes as detection on tables so according to my understanding of ataccama detection rules are applied on business terms and then they are in turn applied to attributes so according this section can we apply detection rules directly on tables as well and can you please explain how does that work? 

I am still building our solution to automatically create ServiceNow incidents for data quality issues. After creating an incident in ServiceNow you get a JSON body as response with a link to that incident. I want to store this link in a database and later check if the incident is still active.The URL looks like this;https://mydev.service-now.com/api/now/table/incident/a1b02c3456d78e9012f34g56h78i90jkIn my environment I have a generic server with the url https://mydev.service-now.com/, Now all we have to do, is add the second part dynamically and feed that to the Json Call step.My simple component to experiment with this looks like this: For now I'm just going to put the second part of the url in an Alter Format step: I believe I read somewhere that record_link must be mapped as a parameter for this to work. Only if you want to enter it as a value whenever you run the component or if you want to pass a parameter from a workflow. But that's not in my plans currently. So I won't map it as

So recently I’ve been working on workflows and schedulers, my current task is to schedule a workflow in/using the Webapp and not in IDE, is there any support documentation based on this problem? I’ve already completed the IDE workflow tutorials and scheduling workflows using one runtime server. Thanks!

Hi, I'm setting up an approval workflow in ONE Desktop and need to execute identical plans on Workflow state: Draft and Workflow state: Published, each having their own plan file. Although the plans are identical, I know for certain that the two outputs should be different. However, I am currently getting the same output for both. Both workflows consist of a metadata reader to an excel file writer. Could there be a glitch running identical plans for different workflow states?

Hello Community, I use an import .csv file to load catalog item attribute data into OneWeb with a Desktop plan.The .csv file has the attributes in the same order as they appear in the underlying table.When these attributes are imported with the plan, in OneWeb for the catalog item I see the attributes in a different order as compared to the csv.Is there a way to keep the order in accordance with the import .csv file? Thank you in advance!