Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?
Dear Colleagues,Β I am seeking a solution for looping over the data and also for using iteration.What I need to achieve: matching a 4-value string against another 4-value string for Levenshtein match score.Method is to match every 4 value in the string against every 4 value in the other string. It adds up to 16 combinations.Somehow like below I want to create a loop:String1:= L1+' '+L2+' '+L3+' '+L4;String2:=MATCH_L1+' '+MATCH_L2+' '+MATCH_L3+' '+MATCH_L4;MS:= null; //this will be the match string β a dynamically extending string as shown belowfor i := 0 to 3MV1 := set.subSequence(String1,i,1); //match value is L1 For i2 = 0 to 3MV2:= set.subSequence(String2,i2,1); //match value is MATCH_1MC:=levenshtein(MV1,MV2); //we have some score here as match case Next i2;MS:=MS+MC+'_MC'+toString(i)+';'; //match string value and case number stored here and in each loop, new values are getting added to the stringNext i;MS //here I use the final match string value as it is and that's al
Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently.Β I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality.Β Β What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day.Β
Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I donβt see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1
When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as βCDE Indicatorβ how to do that in metadata model?β@anna.spakovaΒ , β@CatherineΒ
Hi,I have created a VCIΒ along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilizeΒ the VCI as well.Β Any information regarding this would be helpful. Thanks!Note:Β Ataccama V15.4Β
Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call:Β Any suggestions on how to solve this issue?
whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processedβalong with their associatedΒ trace_idΒ andΒ source_idβand requeue them for reporting purposes?
how to resolve βUnable to use the config file provided, exiting.β error
Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of eachΒ asset that has such columns and replace that column with some dummy value, that's not masking.
Hello,I am using Ataccama V15.4Β I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK itβs not as convincing as setting levels like sev 1,2 etc.Thanks.
Hi community!Β We hope youβve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you havenβt seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in!Β Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate." Β A copy of the rule will open in a new tab with the settings already populated. Β Edit the information as required and click "Save."Power users can also perform this action via API.Β Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul
Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that.Β Thanks.
I am looking for a way to load data that has many columns that keep changing.Β For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute:Β example fromto having it like thisΒ It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail.Β Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?
Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if itβs possible?Thanks!
Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results viewβfor example, Iβd like the "Dimension" column to be the second column.Iβve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the templateβs default structure?If direct reordering isnβt supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, whatβs the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!
Can we get results at column level where filter is applied. For ex:Β For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count.Β Β Like this we have to get results of all the cities present in that column.Β
Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from.Β How can I achieve this? Is there something out of the box available for this?Kind regards, Jur DΓΆrdregter
Hi There,Β We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop.Β Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps inΒ DQ Firewalls :: Ataccama ONE
COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule asΒ [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales dateΒ Β
Hi all,Iβm working on a Python script to fetch monitoring project results via GraphQL. My goal is to determine whether the monitoring project is 100% successful or if there are any issues.Iβve checked the documentation but canβt find the exact GraphQL query or fields that return the projectβs overall success status or completion percentage.Could anyone please share: A sample GraphQL query to get the monitoring project status (success, percentage, etc.) How to execute this query using Python (e.g., with requests or any GraphQL client) Tips on parsing the response to identify if the project is fully successful or not Thanks a lot!
I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutionsΒ to work on this requirement.
I have a lot of categories in an RDM setup.Β In the Web UI, isΒ there anyway to setup βshortcutsβ or bookmarks so that users can see just the tables/views/datasets in their category?Looking for suggestions/best practices here on user navigation through many tables in the RDM Web UI please.Β
Letβs say we currently have some tables:TableATableBTableCTableDΒ TableA and TableB are parents of TableC, then TableC is parent of TableD.So we have:Relationship Parent Table Child Table Rel1 TableA TableC Rel2 TableB TableC Rel3 TableC TableD Β We are trying to get rid of Table C, so that the new relationships will be:Relationship Parent Table Child Table Rel4 TableA TableD Rel5 TableB TableD Β Iβve tried to deploy the model and I get validation messages of missing parent values. Trouble is TableD is quite big in RDM terms (in the magnitude of 200k rows) and I think the application is struggling to start at the moment with all these failed validations.Is there some specific alter hints that can be used or am I going to have to anticipate going into repair mode somehow?Β
Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.