Discuss, learn, ask, suggest, share all things DQ&C 🔍
Recently active
Hi, I was wondering if there is a way to profile a subset of the data based on a certain criteria in the web application. For example, I want to get the profiling results only for records with the ‘Active’ status in the ‘Status’ field.I am able to do this in the desktop application by writing a custom sql query to filter the results. If I can do this directly in the web app that would be really helpful.Thanks in advance!
Hello Dears,Is there a functionality or a tool available to search on the code of VCI, catalog items, DQ rules…. in all the object types that we use in Ataccama.We know that there is possibility to search on the names, but not on the underlying levels. Thank you for ideas.Kind regards,Maria
Hello,I was able to parse a fixed width file using the Ataccama One App by editing the metadata. But when i try to parse the same file using the Ataccama Web App it doesn’t parse correctly. Is there a way to give the metadata file to the Web App for it to parse the file correctly ? Thanks, Rene Requenes
Business glossary - relationship types (part 2)Hi Community,In my previous post I presented the idea to implement new metadata entities for attribute and entity terms in the glossary. The reason for this is that it makes most sense to have more types of terms that best describe either a catalog item attribute (the attribute term) or a catalog item (the entity term).I finished the post with making a comparison to logical data modelling.In a logical data model the entity is described by its properties, so the attributes. An entity not only has descriptive attributes, but obviously also one or more attributes that identify a record of that entity, the primary key. Besides the primary key also an alternate key may exist (for instance an email address can be used as alternate key next to the client id). Or an attribute can act as foreign key to another entity. Such an attribute will then also exist in its parent entity.With the example of an attribute existing both as foreign key in one ent
Hi Team,I am checking on connecting to Cosmos database from Ataccama One Desktop, can you please share any documentation or usecase available to do that. Thanks,Rohith
Need an automation to map Active Directory groups to access to groups and monitoring projects on Ataccama UI.
I have a use case where I want to store some client id and secret in my own company’s Azure keyvault.Then I have a component which needs to use the client id and secret to authenticate against a 3rd party, so I can issue a GET call to get some data. So I am thinking:Runtime server authenticate against keyvault Runtime server issue a “get secret” call to keyvault Keyvault sends back the secret Runtime server takes the secret and authenticate against 3rd party Runtime server issue a “get data” call to 3rd party 3rd party sends me back the actual data What authentication methods from runtime server to keyvault are supported? I had a look at Azure keyvault’s documentation but I don’t think I understand it fully. https://learn.microsoft.com/en-us/azure/key-vault/general/authentication Has anybody else done it? What’s your experience?
Good Morning, I have a quick question in regards to loading data and how it appears into Ataccama from a database. I did not see this topic addressed but I wanted to reach out and ask this and see if this question made sense.In the Knowledge Catalog, if terms are “table names” and attributes are “columns” as described in the documentation. How does Ataccama interpret duplicate attributes spread across separate tables of data? For example, how would Ataccama interpret two different tables that have duplicate titled columns within those tables? Especially if those column headers have different meanings across the tables. If any further explanation is needed feel free to send me a message.
I have been given a list of emails that I want to transpose—converting the data from rows to separate columns—and then concatenate these columns into a single row. How can I do that in the IDE? Original Data After Transpose Final Output Note: All the emails will be unique, so I don’t want them to be grouped. Could you please suggest how I can transpose these rows into columns and later merge them into one single row?Thank you.Regards,Dhaval
We are trying to pass a csv file’s column which is generated from the Run DQC and contains a list of emails to the Send Mail’s “to” section. What are the other ways of passing a column to that particular section. Let me know if there are any alternative steps. This is the workflow planConfiguration of Send Mail:Regards,Emmanuel
we need to achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them or by using composite keys. - This is in continuation with the query posted in ataccama community - Regarding DQ controls (ataccama.com) Do we have any step or document to follow on how we can import that file into ONE web app as catalog item and can we upload the file from local or we need to get that from the file system? Thanks,Karthikeyan.
I have created a rule that detects if a record is in the table more than once based on aggregation of 2 attributes in OneWeb application. This gives a proper result in Invalid samples data and exports giving 2 errors if the record is in the table 2 times etc. But the customer requires that only 1 record should be visible in Invalid samples and also in exporting to db. It does not matter which one. Is it possible to configure the result to do this?
Hi Team This is the continuation of the of the below thread about using reconciliation project for comparing a file with the table.Compare data between file and table (ataccama.com) The data compare is working fine when I followed the approach suggested. But from this link (Data Reconciliation Best Practices 👾 (ataccama.com) - it is mentioned as (except snowflake data).So, what will be the approach for the snowflake related connections. I have one more question - for eg ., I have column fullName in source (which has a full name) in target I have two columns one has the first name and other column has the second name. Can we compare source column to target column1 and 2.
Hello,I was wondering if someone has an idea to help my question about one of my DQ check. Basically let me explain what i have and what i want to achieve with them.I have; one list consisting 2 columns. Column A has unique values having 2 or 3 digits with a mixed combination of letters and numbers. Column B has names according to the column A. Here is the example: Column A Column B abc name1 abd name1 abe name1 abf name2 xy name3 1a1 name4 1a2 name4 1a3 name4 yz name5 yz1 name6 As you see, there is no corelation between column A and column B. I can’t assume if the value of column A is yz and value of column B is name5 then i have name5 for yz1 of column A.And I have a field in my data lets call it as column C. Column C has values with a mixed combination of digits and letters and with different length. Such as abc1231422ad , 1a3577afdg , yz4564sdfsfs can be example. And I have another field which is Column D having some other values. I want to check v
Hi Community,I’d like to share some thoughts about the business glossary. After considering how we wanted to use the glossary, we applied customizations in the metamodel, so we have a specific implementation. I suppose that others have a different approach to using the glossary, so it would be great if we could share and discuss our visions. I am looking forward to your feedback!Let’s start.The business glossary provides a way to describe terms that have relevance to the organization. Obvious properties like name, definition and owner describe a term. It is possible to connect catalog items and its attribute to a term, so that physical data elements becomes meaningful.The question is, can we describe these elements with the same properties? (Indeed a rhetorical question)To logically describe a catalog item attribute, besides its name and definition also properties like its (logical) datatype, an indicator to mark a ‘personal identifying information’ term and the GDPR classification.The
On a matching component if address table is mapped as shown in the screenshot. Why would the process still run for the address table for both insertion and deletion. while its not being used. How to avoid it run through it and why would it run through? it would not need a master_id associated wither as it is tied to parent by u_parent_id.
I'm currently using the "start-server.bat" file within the Ataccama Desktop tool to manually start Ataccama Server. However, if I forget to start the server, certain workflows fail to execute. I've attempted to automate server startup using Windows Task Scheduler, but it's not working as expected. Is there a reliable method to start Ataccama Server independently of the Desktop tool, perhaps through a scheduled task or another approach?
Hello: I have a use case specifically for assigning a term. If the data is a 9 digit number and if the field name is NOT one of the list i want to exclude - then that term be assigned. I also have additional field names that i want to be tagged with that term - irrespective of value with in that field.As of now - iam able to create separate rules one that runs on metadata and other runs on real data - and put a OR condition or AND condition between the two rules. But that is not addressing my use case very well. I need one rule that can refer to both real data and metadata. OR - i should be able to give a complex join condition with more than two rules(Rule 1 AND Rule 2) OR (Rule 3) Has anyone done something like that?
I’m trying to build a GET API call to an external data provider.This provider requires me to send my GET call with the certificate.We managed to test it in POSTMAN, where I had to add the certificate in the Settings → Certificates menu: I have a .pfx file with a passphrase, and I needed to specify the host.This works on my laptop in POSTMAN. Now I’m trying to do the same call in ONE Desktop using JSON Call step.By way of googling, I’ve managed to convert my .pfx file into .cer, then I imported the .cer file into {DQC_HOME}/jre/lib/security/cacerts . Then I have restarted ONE Desktop. But when I call the API I’m still getting an error message from the other side saying my certificate is not sent. I have a suspicion that the certificate is sitting in the keystore but it is not used. Is there some way to ensure it is used? Some java parameter somewhere?
Hey all!Now that incoming webhooks within Microsoft Teams is discontinued (Existing configurations will work until end of 2025), is there a plan for how teams will continue to integrate with notifications from Monitoring Projects? This was a big sell to a lot of our users, and now that we are unable to use incoming webhooks for new monitoring projects, I want to see if there is a plan to have a work around, or if it will be not supported in the future.
Hello: I have a use case where when the data in a given column - for a key changes from previous day to next day - that should trigger an alert/notification For Ex: Security Ratings, and/or ESG ratings generally dont change for a given security. I have a table that has one record for each day for each security. And the ratings are in the columns of that table. Now - on a regular day - all ratings from previous day should be same for next day, and day after (until it changes). And on the day when it changes - i want to capture that security, ,what field changed - what was yesterday;s value vs todays value. The way - i would like to solve this - is create a SQLCatalog item - with previous day - and current day values combined into one dataset for each security and write scripts to compare them one by one, and report any changes. But I want to know if there is an out of box - date driven compare that can be done for this.
Hi everyone, I’m Srija Piratla, Solutions Consultant here at Ataccama.In this post I’m going to talk about how to create a hyperlink for an attribute column in the ONE Web App. Curious? Follow these steps. This example demonstrates how to make a column, such as "Product URL," in the catalog item "Epic Dashboard" clickable, redirecting to the respective web page.Steps to Create a Hyperlink for an Attribute ColumnCreate Metadata Model: First, ensure you have a metadata model set up. You can find detailed instructions for creating a metadata model here. If you need to create a new entity, use the metadata writer step to load the data. Edit the Page Template: Navigate to the page where you want to create the URL hyperlink. In the top right corner of the page, click on the Edit Page Template option. Add Renderers for Hyperlinks: In the page template editor, add the necessary renderers for hyperlinks. This involves specifying the renderer type for the attribute you want to make clic
hi Team, i need to get yesterday date in my workflow global variable, can you please help in getting.when i use toString(now(),"yyyy-MM-dd") -- printed me todays date when i use toString(now() - 1 ,"yyyy-MM-dd"), getting error as operator “-” can not be used
Hi, I am trying to write some rules to check the data type of attributes within sql tables or flat file columns. I am aware that profiling checks this but I have a requirement to check the data type as well. There don’t appear to be any parse functions in the interface. Any help would be appreciated, I am a noob so please be gentle :)
DQS matching component results are not reflected when bundle is deployed and the entity is re-processed. I did re-build the repo with the new Extended unifier but no effect. What could be a reason?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.