Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi β@anna.spakovaΒ My manager wanted to get a metric on how many rules each person created. Is it possible to take the metric from ONE Desktop Plan?
Is there a way to implement data slices or leverage other techniques on Salesforce tables to monitor only specific attributes, rather than profiling the entire table?Our Salesforce tables are quite large, and attempting to profile the full dataset is causing our on-prem DPM service to crash. We're looking for a more targeted approach to reduce the load and improve stability.Any guidance or best practices you can share would be greatly appreciated.
Hi I am using v15.4.0 on windows 11 cloud pc and trying to run a small metadata reader project from Advanced DQ training projects that come along with ataccama installation.Iβm getting the warning -βStatus Tracking Issueβ when tried running it with correct Ataccama Environment selected. The result of the plan are not rendered but the job status is shown as completed on Admin Server. What could be the issue here? Any resolution that you can think of pls advise?cc: β@Ataccama Community AdminΒ
Dear Fellow Users,I have a certain issue using the Matching step in workflow editor.I composed a Matching Function, and assigned it to a data field as Matching Rule.Now I want to use the result of the Matching Rule further in the next steps as value.Please see the attachment for exact presentation of the case.First attachment demonstrates how the Matching step is structured - the details in question are highlighted in green frames.Second attachment demonstrates the function applied, and the result I want to take as value to be processed further.Β Any solution is keenly welcome.Thank you, Laszlo
Hi β@anna.spakova,Would Ataccama provides REST APIs to read metadata of rules, catalog items and monitoring projects?We would like to useΒ python API capabilities and read the metadata from API in the form of JSON. Please let us know if this is a possibility.
hi Team,I would like to understand a couple of things related to implementation of slices directly on catalog item v/s filtering out records in sql or virtual catalog items and then using these items in monitoring projects (MPs)Β I amΒ adding aΒ data slice on a data catalog item X having e.g., 300 millions of records in total, sliced subset is having records around 30-35 millions -Question: when I run the MP, will it first pull all 300 records and then filter out those 30 million records based on slice and then do the DQ evaluation?Β Also, In case I use SQL catalog item (SCI), I am already cutting down undesired records, so Iβm directly applying DQ evaluation on 30 million records, will it be faster in this case than above scenario?In any case, Slice / SCI/ VCI - how are we calculating the overall quality of the data catalog item here? Are there any guidelines on calculation of DQ on the whole dataset using output/score from DQ of subset of data.Really looking forward for your inputs here!
Hey Community!I would like to create an overview with One Desktop that provides me insight in which assets have been shared with which groups/persons with which type of access.Β I have been checking the metadata model, but cannot exactly locate the relevant entities that I could use for this purpose. Does anyone have an idea? Maybe only possible with GraphQL?Kind regards,Albert
Hi All,Does anyone have a best practice for creating mappings between related reference data?Β Β We need to be able to relate various datasets used by different systems that have the same "entity" but the codes for that entity are different. Some examples:Entity:βββββββββββββββββββββStateTable 1 Value for State:ββββββββNYTable 2 Value for State:ββββββββ034Table 3 Value for State:ββββββββ34Table 4 Value for State:ββββββββNew YorkΒ Β Entity:βββββββββββββββββββββAutoTable 1 Value for Auto:ββββββββAATable 2 Value for Auto:ββββββββAUTable 3 Value for Auto:ββββββββ01Table 4 value for Auto:ββββββββAutoΒ We need to be able to "map" these values within RDM, so we know that NY, 034, 34 and New York are all "State", and that AA, AU, 01 and Auto are all "Auto".Β Β Additionally, these mappings may need to be hierarchical.Β Β In Informatica, these objects are called βcrosswalksβ, and they exist as base entities within the tool. We need to duplicate that type of behavior.Β If youβve implemented this, or have
I need some assistance creating a AQL query for finding a table within a database and schema.Β How would this be written?Β
I have few monitoring projects in web but I would want to add them as components in workflows and run from desktop on schedule.Is it possible and if so what are the steps to do?Β Are there any pre-requisites for this?Thanks in advance!
Hi,Via ONE Desktop I created an invalid records component file which can be extracted in the Monitoring Projects βΒ Export tab. It is in regards to a Float attribute. However, when I download the .xlsx file and open to check the invalid records it shows blanks. While if I check the database I see values.How do I show Float attributes within the .xlsx file?
Our team has just started usingΒ reconciliation project in Ataccama ONE UI, just wanted to confirm if we can apply a DQ rule on reconciliation projects, you can take a requirement e.g. if source data is having Wed as a record in an attribute and target is having Wednesday as a record in an attribute with same name, it shouldn't be highlighted as a different record.
We have environment with 14.5 and now we have established totally new environment with new Ataccama 15.4. We want to migrate all the object from one environment to another without manually re-creation of objects.Is possible to use metadata database & Audit DatabaseΒ of 14.5 in 15.4 Environment with some upgrade process so that all the objects can be accessed in 15.4 without any issues?What are the steps to be taken for this?
I have two location tables with 2-letter codes and integer codes but need to keep them both.Β Need to create a crosswalk table that maps the codes in both to a location name. Has anyone setup a crosswalk-type table with ONE RDM?
Below areΒ Ataccama ONE DesktopΒ shortcuts organized into categories by particular viewer or editor.A full list of keyboard shortcuts can be found and called by pressingΒ Ctrl+Shift+LΒ at any time.To edit shortcuts, go toΒ Window > Preferences > General > Keys.Data Viewer SQL Editor Profile Viewer Plan Editor Search and Navigate Edit Layout Run Progress Viewer Online Service Editor Common ShortcutsData ViewerCtrl+FΒ -Β FindΒ - Opens Find dialog. Ctrl+LΒ -Β Show ColumnsΒ - Opens dialog where user selects which columns should be visible and which columns should be hidden. Ctrl+HomeΒ - Selects and reveals the top left cell. Ctrl+EndΒ - Selects and reveals the bottom right cell.SQL EditorCtrl+FΒ -Β FindΒ - Opens Find/Replace dialog if SQL query field has focus (from v8). Ctrl+EnterΒ -Β ExecuteΒ - Executes current query. Ctrl+RΒ -Β Read RestΒ - Reads the rest of the query execution. Ctrl+BΒ -Β Next BatchΒ - Reads the next batch of the query execution. EscΒ -Β StopΒ - Stops the query execution.Profile View
As we have relation for catalog items, can we also have relations for attributes?What are the metadata model changes required for this?Β Appreciate the supportΒ π
Ataccama MDM presents particular challenges for multiple developers maintaining a solution together. There is no magic bullet to resolve this, but good working practices can minimise the risk of git conflicts and help resolve them when they occur.Your organization may have established working practices for branch management, naming conventions and so on. Compare these practices with the suggestions here when defining yourΒ team processes.This post assumes the reader is familiar both with MDM and with Git usage β there are many good resources available for Git in general and for Eclipse eGit as used in Ataccama ONE-Desktop; and Ataccama provides training for MDM. This post is long enough: I will not explain technical terms or procedures that should already be familiar or can be looked up elsewhere!What is the problem?MDM and RDM use a metadata-based configuration known as a Model Project. This consists of many xml files, and it is very easy for several developers to make model changes at
In Ataccama Monitoring projects, the email notifications currently provide summary details (e.g., number of failed rules, scores, etc.). Is it possible to customize the email notification content so that it also includes a snippet or sample set of failed records directly in the email body (instead of just attaching or linking to error tables)?If yes, what would be the recommended approach or configuration to achieve this in V15.4.1?
I have two BDE DPEs pointing to different Hadoop clusters. They have different cluster ids set in the configuration. In the DPM they both show up separately with their own configuration. In ONE Web I have a connection that uses DPE 1, which is working fine when only DPE 1 is connected. However, when both DPEs are connected I get the following error when I try to browse this connection:It seems to me that ONE Web can't seem to differentiate between the two DPEs. I have tried all kinds of different constraints in the application.properties files of both DPEs, but nothing has worked so far.Does anyone know if this is possible and if so, how I can get this done? Please let me know.
In One Web, withΒ invalid sample records uploaded to ONE Data, we would like to filter data that failed on a particular DQ (Data Quality) rule and download it. However, at present, there is no way to download a filtered view.The system currently only allows us to download the entire table. This means that when we download the whole table, all the DQ rule filters are lost, and there is no way to figure out which rows failed on which DQ rule. This is quite problematicΒ as we want to be able to download records that errored on a particular rule so we can send them to the appropriate team for corrections specific to that rule.Also, we often perform DQ evaluations on spreadsheets and setting up post processing or remediation plan on an excel sheet is not the most efficient approach. This is because each time there is a new version of the excel data, we would need to rebuild the whole plan again. Considering that the download functionality is already available, I believe adding an option to do
Hi β@anna.spakovaΒ Is it possible to download the list of rules (maybe using metadata reader if not from UI)?Also, anything/any links related to functionality of Export List Of Items option could help here.Thanks!Β
Hi I see we can configure PowerBI as data source in connections but want to know if itβs possible to use the BI report to be treated as catalog item to apply DQ checks and profile these.
Hello community,Iβm creating a Power BI source on Ataccama One and have a few queries:Is the built-in Power BI connection allow One to retrieve a Power BI datasets? Or this is strictly for only bringing the Power BI reports to One? The imported catalog items from this connection shows β0β number of attributes and β-β number of records (screenshots below). This is also presents in the the screenshot from the Ataccama support page (link). Is this behave as intended or am I missing anything here?Thank you in advance.Ben
Introduction What is the Ataccama Admin Centre? Where is Ataccama Admin Centre? What are the serverConfig and runtimeConfig files? Where do I start? Where are these configuration files? Sample project structure What is inside the configuration files? ServerConfig RuntimeConfig IntroductionThis is an introduction to the Ataccama Admin Centre serverConfig and runtimeConfig files:What the files are and where to find them How to setup security on the Admin Centre UI itself How to setup an online service endpoint on Admin Centre How to setup Admin Centre to enable the run of schedulers, workflows and plans / componentsThe intended audience for this article are Power Users for Ataccama ONE. Power Users may have built some plans / components / workflows / schedulers / online services, and are now looking to host them on a server environment.Β What is the Ataccama Admin Centre?The Atacccama Admin Centre can also be referred to as the βONE Runtime Serverβ. For the purposes of this document, we
Hi,After moving internal mdm connection (mdc_db) fromΒ mdm.runtimeCfg to runtime/etc/application.properities there is no more chance to see this connection in console under βDatabase Connectionsβ site and be able to track sql by turning on βSQL Monitoringβ.This was handy to see, easy and fast, which SQLs were executed and could help as early warning, that some SQL a running slow.Β This was working in v13, but since v14, this is not possible anymore to my knowledge.Is there any way, how to monitor this internal MDM connection back in MDM console?Thank you
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.