Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
On my virtual desktop I have two ways I do an API call to ServiceNow to create an incident.With Postman it is working. I've managed to create an incident in ServiceNow serveral times.With One Desktop, with the same URL, header and JSON body I get Connection reset every time. And the Json call response debug file isn't even created.So here is my Postman setup:Authorization is a basic auth. Headers:When I run this I get the following response:{Β Β "import_set": "ISET0012345",Β Β "staging_table": "u_str_call",Β Β "result": [Β Β Β Β {Β Β Β Β Β Β "transform_map": "STR - Call API",Β Β Β Β Β Β "table": "incident",Β Β Β Β Β Β "display_name": "number",Β Β Β Β Β Β "display_value": "INC0217277",Β Β Β Β Β Β "record_link": "https://mydev.service-now.com/api/now/table/incident/8c47e2e6472fb11016fd2e61e36d4336",Β Β Β Β Β Β "status": "inserted",Β Β Β Β Β Β "sys_id": "8c47e2e6472fb11016fd2e61e36d4336"Β Β Β Β }Β Β ]}Now here is my One Desktop setup:And my component with Json Call:This is my Json Call:An
Querying APIs via GraphQLDid you know that your ONE solution already comes with a preconfigured GraphQL interface that can be used to run API queries in your web application?The GraphQL Playground is available at the following URL:Β <web_app_URL>/playground.Β You can use the queries for a wide range of operations to read or manipulate data in the Ataccama application, for instance:Listing your Catalog Items, associated Terms or Connection Sources Checking the status of your Catalog items Trigger a Profiling of a Catalog item Publish an Entity from a Draft state β¦ and many more!ExampleList all available Catalog items via a query:Β Make sure you get familiar with this powerful feature. Visit the following page and get familiar with the basicsΒ via following a series of simple use cases. Good luck!
Read the metadata from the connected source systems like descriptions, null constraints, policy tags, primary keys in Ataccama one
I have a βprovider_nameβ cleansing component under βproviderβ component. When I test the βprovider_nameβ cleansing component on DQS in a test plan, the values on pur* and out* fields look good. And the provider component shows the propertied of the name component asΒ but for some reason, none of my changes are reflected or seen when the component is deployed with changes and subject is reprocessed. Am I missing something? I did debug at the name level and the component level, the values come out right but not after being deployed and reprocessed. Any suggestions?
Hi All,as we are adding more data product to our Ataccama One environment als more profiling jobs run every morning. For every succesful job from the processing center we currently get a flash pop up that it ran succesfull. Can we somehow hide these pop-ups? Or only show the failed ones for instance?Regard, Jur DΓΆrdregter
Hi, is ataccama one available for deployment in VM?Because of data confidentiality and system requirement, i need to deploy data catalog & governance tool in VM within private network.Β if available, can someone provide link for documentation for VM deployment?need to check the sizing, required component, etcalso do ataccama one (cloud) support private link to aws cloud?Β Β Β thank you
Hey community,The term overview screen shows the entries of all types.I would like to implement a βterm typeβ-filter (via Application Settings βΒ Search Configurations)Β on that page. For that I need to know in which entity and property term type has been implemented, but I cannot find that. We have version 13.9.4.Does anyone have a clue?Kind regards,Albert de Ruiter
Hi,Β Β What is Fractional digit used for? Can it help to identify character length within an attribute?Β
I'm trying to connect to a SericeNow API to create data quality related incidents. (see:Β ServiceNow API call keeps running into Connection reset | Community (ataccama.com)).It is now pretty clear this is failing because the proxy isn't letting me through. And it also now seems pretty clear I need to use a certificate to authenticate on the proxy.So I have .crt file that I might use. But where do I change the config of One Desktop so it will use it?Under Window > Preferences > Network Connections you can find the proxy settings:But the proxy settings have no certificate settings:Β Under Network Connections there is a SSH2 screen, but I have no idea where to enter the location of my .crt file here. Any idea?Β
I have tried to implement MS teams notifications for the monitoring projects - but after following the instructions in the user documentation (Β https://support.ataccama.com/home/docs/aip/14.3.0/development-guides/one-development-guide/configuring-the-one-web-application/ms-teams-integrationΒ ) I donβt get any messages to my teams channel, is there something else that needs to be configured for this to work?Β
Hi,does anybody have experience with integrating with service now? We want to create an incident on a dq check that breaches a threshold to raise an incident. Any examples?
We are on version 14.2 and trying to create a connection to Microsoft OneDrive, so we can export some data from RDM to it. We are planning to write the data using onPublish plan.We see that Ataccama ONE supports Onedrive in the ONE webapp (https://support.ataccama.com/home/docs/aip/14.2.0/user-guides/one-web-application-user-guide/knowledge-catalog/data-catalog/working-with-data-sources/microsoft-onedrive-storage-connection)But I cannot find a corresponding connection type in ONE Desktop. In here One drive is not an option:Β How can we set this up please?
Β Hello everyone!In the new version of Ataccama 14.5, how is the configuration done for regular scanning of data schemas to detect the appearance of new tables: metadata import?Β I need to regularly automatically import tables based on a specific schema that are not in the Catalog Item.I will be very grateful for your helpπ€Thank you!
I got 2 questionsFirst: how can I replicate my DQ rules from one environment to another ? (example: from dev to QA)Second: how can I make the rules automatically replicate to new records on a table ? Like if I have a table with 500 rows and I add 50 more rows, I need to re apply the rules to all the table, instead I wanna make it in an incremental way so only my new records would need to have the rules applied.
how to be ataccama data integration(migration) to azure cloud?
πΒ Links to the legacy documentation portal are no longer available.Β Read about the changes and how to access our documentation here.Hi everyone!Β This week, we are starting a new best practice series on ONE Desktop ππIn the upcoming weeks, we will cover different features, functionalities, and use cases of ONE Desktop and weβd love to hear your tips & tricks, questions, andΒ feedback in the comments as always!Now, letβs dive into a crucial tool that drives your data quality (DQ) and master data management (MDM) solutions β the ONE Desktop.Have you met the ONE Desktop (formerly known as DQC)? It's an Eclipse-based Integrated Development Environment (IDE) specifically designed for crafting top-notch DQ and MDM solutions powered by Ataccama products.Why ONE Desktop? All the core Ataccama products rely on ONE Desktop for seamless development. It's the command center for bringing your data solutions to life.Β A Glimpse of the InterfaceThis post is your compass to navigate through the O
We had a internal discussion, but ended up not being 100% sure. So here's the question.When we run DQE on a CI, where are the rules evaluated? Does the DPE get the full data (possibly with filters on the MP?) and the run the rules evaluation IN the DPE. Or does the DPE create a SQL-like statement and doesΒ the source DB return the results?As we also run on Hadoop with DPE on Hadoop. Is this the same.
Hi everyone,Β Β As the holidays are just around the corner, we wanted to share a piece of news that got us thinking! Our latest digest issue covers the trends in 2023 and we are keen to hear your thoughts on it!Β If you are seeing this for the first time, let me briefly explain our biweekly news digests. Every other week we bring you a piece of select news from the industry and we are keen to hear your thoughts about it πΒ This week on the news:Move to the Cloud, AI and Machine Learning, DevOps, and Data Governance: Four Trends that Defined 2023Β byΒ Kevin KlineΒ publishedΒ in dbta.We are also curious to learn more about what have you been reading recently, or planning to read over the holidays. Enjoy the holidays and let us know in the comments whatβs on your reading listΒ ππ»πποΈ
Hi community,I am looking for a bit more clarity about Term Suggestions Synchronization. In theΒ Documentation PortalΒ I read that the synchronization is only relevant after a database restore or βbyΒ importing any initial content (default, demo, etc.)β.For me it is not clear what is meant with this initial content. Importing a catalog item for the first time, or? Does anyone know?Kind regards,Albert
The performance of one of the subject is bad. This what is happening.A new or existing records loaded and it runs matching against 1000 records (one master and 999 slaves) because they are similar and have same master_id 123. So if we think of overall if 500 records are loaded during an incremental load and each have similar conditions, its ending up touching 500000 records and taking several hours. IS there a way to make the record only try to match against the Master record? or other ways to improve the performance? Please suggest. Thank you.
One of the most commonΒ data sources that our users connect to are relational databases, e.g. Oracle, MSSQL, PostgreSQL, etc. For those sources, we usually recommend using JDBC drivers to connect, and use JDBC Reader and JDBC Writer steps to work with the data.But for big data sources, e.g. Databricks, within the Ataccama ONE Desktop environment there are a few different steps available. Ever wondered which one you should choose?Β Hive Reader and Writer:HiveΒ Reader and Writers are the simplest to configure, but also offerΒ the least options. You will need to specify the exact database, table andΒ column namesΒ you want to read from / write to. For the Reader step you can provide some simple where clause in the Filter.Β Spark SQL Reader:For more complex SQL queries, you can use the Spark SQL Reader. This is not limited to where clauses, but also joins, aggregates etc.Β Spark Reader and Writer:For even more complex operations, you can use the Spark Reader and Writer steps. They are more complex
Ataccama detail document on what all can be done related to snowflake like can we pull tags from snowflake connect to snowflake console from Ataccama?is there any blog or document available on the same. Any limitation related to that
What is the difference between ataccama one desktop and ataccama ONE?Β
Hi we are trying to connect to a AS400 source using JT400 jdbc driver for a customer and keep getting "Unable to initialize pool" is there any specific configuration we are missing in DPE? If anyone has done a similar connection in the past then please do share some inputs. Will be highly appreciated.
Hi everyone!Β In this post, you will find a curated journey to become a Monitoring Projects expert. Be sure to read all the way to find the community best practices & short videosΒ π₯Β First things first πͺΒ Β Watch & learn under 2 minutes β¬ οΈΒ If you have the basics, letβs move on ποΈΒ Β Β Watch & Learn under 2 minutes: Scheduling Monitoring ProjectsΒ More best practices from the communityΒ What are your best practices or use cases creating Monitoring Projects? Let us know in the comments π
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.