Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hello,Β Is it possible to mask attributes that are classified as restricted/confidential using Ataccama One Web? I was able to assign rules and terms to attributes,Β but I was not able to create/apply any masking methods. Please let me know if anyone has tried this before.Β Thanks in advance!
Hi Team,I am trying to findΒ how we can achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them. Also, need to know how we can achieve the same by using the composite keys.
Hi,I have a question about the display of invalid samples when a specific section is selected. It's helpful that the invalid samples are based on that section's checks, but I'm wondering why all attributes are shown by default.Wouldn't it make sense to show only the attributes relevant to the failed rules, with an option to add more if needed? The current setup is a bit confusing.Thank you!
Hi community,Does anyone know about documentation about visualizing relationship types? On the documantation portal I found this, but that doesn't seem to cover the setup in the Graph Visualization section in the Application Settings. The documentation mentions βFor more information, seeΒ Configure Graph Visualization.β, but that is a link to the page you are already on.Kind regards,Albert
Hello Dears!Β Would someone advise if there any watch outs once I want to rename Monitoring projects and DQ rules on ONE Web?I have running projects and DQ rules naming convention of which I would like to improve. If I just simply change names, wonβt it have negative impact anywhere?Thank you.Β Kind regards,Maria
Hi CommunityΒ Iβm Antonio, a Professional Services Consultant here at Ataccama.Β Assets created in ONE do not come with the option of being sorted into folders out of the box. This guide will demonstrate how to set up folders for rules, butΒ can be used for other asset types and isnβt specific to rules.Β In this guide we will describe how to set up a custom attribute βruleFolderValueListβ on rules which will hold data from a list of values, then create new navigation sections in the tool where we can apply AQL expressions to filter rules based on our set criteria. This will allow us to split rules into folders based on the value that has been entered into the custom attribute. The process and results outlined have only been tested in v13.9.3 and v14.5.0 of the ONE Web application.Β Create Value ListFirst we will create the list of values. To do this follow the below stepsGo to Global Settings > Metadata Model.Β Select Create entity.Provide the following information:Name of the value that
I would like to setup a generic data quality rule to check string length. Requirements for length checks differs per attribute. SayΒ column1 needs to have max length of 10Β column2 needs to have max length of 15 and so onIs it possible to create a generic rule to check string length, passing value of length as parameter?I am aware of attribute length insights available as part of DQ profiling results but I would like to make the check as part of monitoring project. Thanks!
HiI would like to get a summary of DQ checks and results like the one we have in ONE web like how many in % and count of broken rules, how many are passing and how many records do we have in total etc. in Ataccama ONE desktop. I tried looking out any related topic in the community but I could not find one. Is it possible to achieve this via Ataccama ONE desktop as we have an existing plan comparing data fields in two different sources. Do you mind sharing the suggested steps to achieve this? Thanks in advance!
When it comes to data quality (DQ) management, monitoring projects provide us with ability to export DQ results and maintain a close eye on data quality. However, the initial export contains attributes organized in columns, alongside additional columns housing information regarding the DQ results for these attributes. Analysing this data can be challenging because DQ rule results and explanations are presented as a single string.Despite the fact, that extracting DQ results in a customized format might require a more detailed approach, it might be better aligning with the client's specific needs. In this guide, you will find information how to export DQ results tailored to specific requirements.The Task at Hand:Our objective is to ensure a separate line for each attribute in an export file, with the following columns related to DQ results:the name of the DQ rule; an explanation for the check; a list of terms assigned to that attribute; the attribute value.We have three main steps:Attrib
HiΒ everyone, I'm Sathya, Solutions Consultant at Ataccama. In this post I am going to discuss about adding Data Classification and relationship types.Β Step 1:Β Go to Global setting and you will see Metadata Model, click on Create EntityΒ Β Β Step 2:Β Once Create Entity page opens, fill the Name of the Entity: Data ClassificationΒ Step 3:Β Click Add Property and fill in the property needed for the Entity: Name and Description with its data typeΒ and hit saveΒ Step 4:Β Goto Metadata Model under Global settings and search for metadataΒ Step 5:Β Click Add property: Fill in name, type: Embedded Object Array and Object type:dataClassificationΒ Step 6:Β Goto Metadata Model under Global settings and search for termΒ Step 7:Β Click add property and Fill in data Classification type as Referenced Object, PII and CDE as BooleanΒ Β Β Step 8:Β Hit Apply changes and the System will be Switching to Maintenance modeΒ Step 9:Β Click DB backup and the application restarts.Β Β Step 10:Β Click on Run changes again and all the chan
Hi, is it possible to have aΒ single rule that checks many condition. example is belowΒ Β Β i want a single rule named--Name Validationi want this rule to checkΒ and validate name that are in -Title Case --first letter upper case follow by all lower caseΒ Accented--- Accepts accented characterΒ Accepts special charactersΒ Could have Hyphen -Β the rule should should invalidate any other names that does not meet these conditions . or is there a better way to do this ? preferred to break it down so its will be easy to know the reason why the names are not valid whenever its does not matchesΒ
Hello,I have a runtime-serverΒ online service that I am trying to call using Azure Synapse using OAuth authentication. I created a REST Linked Service in Azure that connects successfully to the runtime-server online service. IΒ am usingΒ a copy activity in Azure to do a POST call on the online service. When running the copy activity I get the following error:{ "errorCode": "2200","message": "Failure happened on 'Source' side. ErrorCode=UserErrorCharSetInvalidOrNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The CharSet '\"UTF-8\"' is invalid or not supported from Response.Headers.Content-Type.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.ArgumentException,Message='\"UTF-8\"' is not a supported encoding name. For information on defining a custom encoding, see the documentation for the Encoding.RegisterProvider method.\r\nParameter name: name,Source=mscorlib,'", "failureType": "UserError", "target": "CopyDataCatalogToRaw","details": [] }T
Hi Community,Would there be a way in Ataccama Desktop to select records from for instance entity term that have been inserted/updated/deleted from a certain datetime, like the Published on datetime in the History tab? My intention is to use the metadatareader to read the details from term and then use this mutation datetime in the filter in the metadatareader.Kind regards,Albert
Hello, Iβm trying to mask certain attributes in a table and be able to export them while exporting the table as a file. Is it possible to mask them as part of the JSON code while creating an export plan or create masking rules and apply it toΒ the attributes and then export them. (using ataccama ONE Web). Has anyone tried doing this before or has any idea about this? Please let me know!Thank you,PrithikaΒ Β
Hi Everyone,We are in the process of transitioning to Ataccama as our DQ solution. In our current setup, we perform various data controls such as:Empty File Check Duplicate File Check Header or Trailer Validation (e.g., validating trailer record count or checksum)We are keen to understand if these types of data controls can also be implemented using Ataccama. Our goal is to consolidate all data quality processes into a single tool for better efficiency and management.Thank you!
Hi all, is there any configurations we can edit in the page template and/or the metadata model,Β so that we can (best having a hyperlink or button to) exportΒ the content from e.g. the access,Β data structure or profile tabs of the catalog items? Thanks a lot.
Hello everyone, I am Abir π. I am a Principal Consultant at Ataccama. I have recently worked on a project where I had to explore how IDs in Ataccama MDM work, what to consider if any customization is required from the default behavior and how to utilize the dedicated ID sequence feature. I will share in this post what I have learned from MDM gurus and from the overall experience when implementing a custom solutionΒ for anyone else venturing into the same journey.Β Understanding IDs in MDMMDM generates IDs for columns such as id, master_id, xid, tid, etc.Β utilizing a database sequence created based on the model definition. When an MDM process creates new records, it fetches the NEXTVAL value from this sequence, multiplies it by 1000, and generates and assigns IDs to the new records. Once the MDM process is completed, using the maximum ID value assigned, the sequence is updated for the next MDM process. The sequence is cached in Java (for performance reasons) during this process, this is
Hi everyone, I am Sathya, Solutions Consultant at Ataccama. In this post I am going to discuss about how to create Relationship types(Source and Target reference).Β Step 1: To add new relationship type, go to Global settings on the left navigation bar.Β Step 2:Β Under Application Settings, choose Relationship typesΒ Β Step 3:Β Available Relationship Types will be listed.Β Β Step 4:Β Click on create button on the top right corner of the screen layout.Β Β Step 5:Β Fill in the name, Source rel name and Target rel name of the Relationship TypeΒ Β Step 6:Β DomainOf relationship type is created, with its source rel name and Target rel name with its ID.Β Β Step 7:Β All the relationship Type is listed along with the newly created DomainOf.Β Β I hope you found this article useful, please let us know if you have any questions or thoughts in the comments below.Β Β
Hi all,I am in process of learningΒ ONE Desktop and was curious if there any documentationΒ or best practices on integrating GIT. I have searched and found aΒ related topic that was helpful.Β Β Thanks for anyΒ help.Β
Checking to see if there is a way to create a βcurrent values onlyβ table in RDM, with no historical records to be kept?Β I donβt see any option for this in the documentation or One Desktop dialogs.Β Β Β Β
Hello community,Iβm working on an RDM project and have a question regarding the security configurations. I find that if I tick the Fixed Permission checkbox in the Security config. node, the roles permissions I have setupΒ in the IDE will get uploaded onto the web app., but it wonβt be editable later there. However, if I donβt tick this checkbox, none of the permissions will get loaded on to the web app., but I will be able to fully customize the roles permissions on the web app.Is there a way to have the initial roles permissions loaded from IDE, but also editable later on the web app.?Thank you in advance
Is anyone able to confirm if One Desktop version 13.3.2 is compatible withΒ with MS Windows Server 2022
Hello allA basic (and rookie) question, but I couldnβt find the answer in the manual or tutorials, or on this forum.After Iβve loaded source data into Ataccama ONE Desktop, Iβm looking to create a new column and fill it with the concatenated content of some other columns (two or more), maybe with a bit of text in between. In Excel Iβd use the Concatenate function...Example from ExcelAs you can see, I can then lookup information based on Column D and use that for bringing in various lookup values (the real use case is not name-based, this is just to create a simple example)Note - Iβm not looking to merge different tables (with join, union, or representative creator - unless those tools can do what Iβm looking for) - this is simply creating a new column/field which is a concatenation of two or more other fieldsContext: Iβm building a lookup based on multiple attributes - Iβll combine them into a single attributeΒ to give me a single lookup key and then I can use that for various other pur
Hello, I am trying to create a rule for validity on Names. The logic and condition is that the rule matches names that areΒ Title Case --first letter upper case follow by all lower caseΒ Accented Accepts special charactersΒ Mandatory Could have Hyphen -Β I have this regexΒ ^[a-zA-Z '-]+$Β ^[A-Z][a-z]*(?:[ '-][A-Z][a-z]*)*$(?<=^|\s)[a-z]*[A-Z][a-z]*[A-Z]*[a-z]*Β above regex capture and validate names likeΒ John DoeMary Anne which are okay.Β but also validate name in all lower case for example john doe which is not okay. i want to know what i need to do to allow the regex not validate names in all lower case .Β
Hello everyone ! Β Iβm Srija ,Solutions Consultant here at Ataccama. Today, Iβd like to talk about how to trigger profilingΒ while running a monitoring project.While running the monitoring project, the profiling process is getting triggered without any schedule or event created on the catalog item to initiate profiling. This unexpected profiling of over 1000+ records significantly slows down the system. The likely cause for this issue is the anomaly detection feature being enabled on the catalog item.To address this issue, you need to check if anomaly detection is enabled on the catalog item.Β Β Β Β Anomaly Detection in Ataccama DQWhat Anomaly Detection Does:Anomaly detection in Ataccama Data Quality (DQ) automatically identifies outliers and unusual patterns in your data. This feature is designed to ensure data quality by detecting anomalies such as unexpected values, missing data, or patterns that do not conform to the expected behavior.Implications of Enabling Anomaly Detection:Automatic
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.