Data Quality & Catalog ⚙️

Hi,I have a table where a datetime column is present with several records:number    datetimecolumn1              2024-02-01 00:00:00 2             2024-02-02 00:00:00I want a DQ Rule that filters out the datetime records that do not start with the first of the month. Meaning number 1 is valid, number 2 is invalid. I couldn't find anything useful in the condition builder option and the advanced expression (even through documentation in ONE expression) is giving me headache. Any suggestions how to fulfill this?

Hello,I am currently working on a data masking project in ONE Desktop and I'm seeking some advice on how to approach a specific scenario using two tables.I have two CSV files: Classification Table (CSV #1): This table contains two columns - 'ColumnName' and 'DataClassification'. The 'ColumnName' field lists the names of various columns, and 'DataClassification' provides their respective data classifications, such as "Restricted", "Confidential", "Public", or it may be blank. Data Table (CSV #2): This table contains multiple columns, named according to the entries in the 'ColumnName' field of the Classification Table. Each column holds different sets of data. Classification Table (CSV #1):ColumnName DataClassification Name Confidential Age Public Email Restricted  Data Table (CSV #2):Name Age Email Alice 30 alice@example.com Bob 25 bob@example.com  My goal is to mask the data in the Data Table (CSV #2) based on the classification provided in the Classificati

Hi, I have my input like below example. May I know how can I transpose the data from columns to rows? Input Data: Pilot_Yr10 Vermont_Yr10 Pilot_Yr9 Vermont_Yr9 Pilot_Yr8 Vermont_Yr8 2014 2014 2015 2015 2016 2016 9.67 9.67 -3.76 -3.76 18.4 18.4 9.02 9.02 -4.33 -4.33 17.7 17.7 13.69 13.69 1.41 1.41 11.96 11.96  Expected Output Data:  Period Pilot Vermont SI Since Inception 1/1/91 Since Inception 1/1/91 Yr1 2023 2023 Yr10 2014 2014 Yr2 2022 2022 Yr3 2021 2021 Yr4 2020 2020 Yr5 2019 2019 Yr6 2018 2018 Yr7 2017 2017 Yr8 2016 2016 Yr9 2015 2015

On my virtual desktop I have two ways I do an API call to ServiceNow to create an incident.With Postman it is working. I've managed to create an incident in ServiceNow serveral times.With One Desktop, with the same URL, header and JSON body I get Connection reset every time. And the Json call response debug file isn't even created.So here is my Postman setup:Authorization is a basic auth. Headers:When I run this I get the following response:{    "import_set": "ISET0012345",    "staging_table": "u_str_call",    "result": [        {            "transform_map": "STR - Call API",            "table": "incident",            "display_name": "number",            "display_value": "INC0217277",            "record_link": "https://mydev.service-now.com/api/now/table/incident/8c47e2e6472fb11016fd2e61e36d4336",            "status": "inserted",            "sys_id": "8c47e2e6472fb11016fd2e61e36d4336"        }    ]}Now here is my One Desktop setup:And my component with Json Call:This is my Json Call:An

Querying APIs via GraphQLDid you know that your ONE solution already comes with a preconfigured GraphQL interface that can be used to run API queries in your web application?The GraphQL Playground is available at the following URL: <web_app_URL>/playground. You can use the queries for a wide range of operations to read or manipulate data in the Ataccama application, for instance:Listing your Catalog Items, associated Terms or Connection Sources Checking the status of your Catalog items Trigger a Profiling of a Catalog item Publish an Entity from a Draft state … and many more!ExampleList all available Catalog items via a query: Make sure you get familiar with this powerful feature. Visit the following page and get familiar with the basics via following a series of simple use cases. Good luck!

Read the metadata from the connected source systems like descriptions, null constraints, policy tags, primary keys in Ataccama one

I have a ‘provider_name’ cleansing component under ‘provider’ component. When I test the ‘provider_name’ cleansing component on DQS in a test plan, the values on pur* and out* fields look good. And the provider component shows the propertied of the name component as but for some reason, none of my changes are reflected or seen when the component is deployed with changes and subject is reprocessed. Am I missing something? I did debug at the name level and the component level, the values come out right but not after being deployed and reprocessed. Any suggestions?

Hi All,as we are adding more data product to our Ataccama One environment als more profiling jobs run every morning. For every succesful job from the processing center we currently get a flash pop up that it ran succesfull. Can we somehow hide these pop-ups? Or only show the failed ones for instance?Regard, Jur Dördregter

Hi, is ataccama one available for deployment in VM?Because of data confidentiality and system requirement, i need to deploy data catalog & governance tool in VM within private network. if available, can someone provide link for documentation for VM deployment?need to check the sizing, required component, etcalso do ataccama one (cloud) support private link to aws cloud?   thank you

Hey community,The term overview screen shows the entries of all types.I would like to implement a ‘term type’-filter (via Application Settings → Search Configurations) on that page. For that I need to know in which entity and property term type has been implemented, but I cannot find that. We have version 13.9.4.Does anyone have a clue?Kind regards,Albert de Ruiter

Hi,  What is Fractional digit used for? Can it help to identify character length within an attribute? 

I'm trying to connect to a SericeNow API to create data quality related incidents. (see: ServiceNow API call keeps running into Connection reset | Community (ataccama.com)).It is now pretty clear this is failing because the proxy isn't letting me through. And it also now seems pretty clear I need to use a certificate to authenticate on the proxy.So I have .crt file that I might use. But where do I change the config of One Desktop so it will use it?Under Window > Preferences > Network Connections you can find the proxy settings:But the proxy settings have no certificate settings: Under Network Connections there is a SSH2 screen, but I have no idea where to enter the location of my .crt file here. Any idea? 

I have tried to implement MS teams notifications for the monitoring projects - but after following the instructions in the user documentation ( https://support.ataccama.com/home/docs/aip/14.3.0/development-guides/one-development-guide/configuring-the-one-web-application/ms-teams-integration ) I don’t get any messages to my teams channel, is there something else that needs to be configured for this to work? 

Hi,does anybody have experience with integrating with service now? We want to create an incident on a dq check that breaches a threshold to raise an incident. Any examples?

We are on version 14.2 and trying to create a connection to Microsoft OneDrive, so we can export some data from RDM to it. We are planning to write the data using onPublish plan.We see that Ataccama ONE supports Onedrive in the ONE webapp (https://support.ataccama.com/home/docs/aip/14.2.0/user-guides/one-web-application-user-guide/knowledge-catalog/data-catalog/working-with-data-sources/microsoft-onedrive-storage-connection)But I cannot find a corresponding connection type in ONE Desktop. In here One drive is not an option: How can we set this up please?

 Hello everyone!In the new version of Ataccama 14.5, how is the configuration done for regular scanning of data schemas to detect the appearance of new tables: metadata import? I need to regularly automatically import tables based on a specific schema that are not in the Catalog Item.I will be very grateful for your help🤗Thank you!

I got 2 questionsFirst: how can I replicate my DQ rules from one environment to another ? (example: from dev to QA)Second: how can I make the rules automatically replicate to new records on a table ? Like if I have a table with 500 rows and I add 50 more rows, I need to re apply the rules to all the table, instead I wanna make it in an incremental way so only my new records would need to have the rules applied.

how to be ataccama data integration(migration) to azure cloud?

We had a internal discussion, but ended up not being 100% sure. So here's the question.When we run DQE on a CI, where are the rules evaluated? Does the DPE get the full data (possibly with filters on the MP?) and the run the rules evaluation IN the DPE. Or does the DPE create a SQL-like statement and does the source DB return the results?As we also run on Hadoop with DPE on Hadoop. Is this the same.

Hi community,I am looking for a bit more clarity about Term Suggestions Synchronization. In the Documentation Portal I read that the synchronization is only relevant after a database restore or ‘by importing any initial content (default, demo, etc.)’.For me it is not clear what is meant with this initial content. Importing a catalog item for the first time, or? Does anyone know?Kind regards,Albert

The performance of one of the subject is bad. This what is happening.A new or existing records loaded and it runs matching against 1000 records (one master and 999 slaves) because they are similar and have same master_id 123. So if we think of overall if 500 records are loaded during an incremental load and each have similar conditions, its ending up touching 500000 records and taking several hours. IS there a way to make the record only try to match against the Master record? or other ways to improve the performance? Please suggest. Thank you.

One of the most common data sources that our users connect to are relational databases, e.g. Oracle, MSSQL, PostgreSQL, etc. For those sources, we usually recommend using JDBC drivers to connect, and use JDBC Reader and JDBC Writer steps to work with the data.But for big data sources, e.g. Databricks, within the Ataccama ONE Desktop environment there are a few different steps available. Ever wondered which one you should choose? Hive Reader and Writer:Hive Reader and Writers are the simplest to configure, but also offer the least options. You will need to specify the exact database, table and column names you want to read from / write to. For the Reader step you can provide some simple where clause in the Filter. Spark SQL Reader:For more complex SQL queries, you can use the Spark SQL Reader. This is not limited to where clauses, but also joins, aggregates etc. Spark Reader and Writer:For even more complex operations, you can use the Spark Reader and Writer steps. They are more complex