Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
I have a use case to use the JDBC writer step to write some data into a MS SQL db.I will need to use the Before and After script feature. (Truncate the table in the before script, then I need to call a stored proc in the after script).And in the after script, I need to construct that based on some value that I calculate in the plan. So it is different every time I run the plan, but I need to keep it consistent.Does this after script support some parameterisation? I have a feeling it wonβt but wanted to double check.
Hi everyone,Β Β Ever thought about where to start with DQ in Ataccama? Worry no more. Follow the journey we have created for you to take your first steps into becoming a DQ wizardΒ Β πͺΒ First things first -Β Start with reviewing our Beginnerβs Guides π§ Β Β Letβs try a few rules βοΈββΒ Β Β Explore some use cases and best practices from the community πΒ Donβt forget to check out our Training Resources page to access video resourcesΒ under 2 minutes on how to create a Detection Rule to Creating DQ Validation RulesΒ π₯Β Next up isβ¦Β Monitoring Projects - so stay tuned.Β Subscribe to our forum to not miss out on the latest articlesπΒ Β
Happy Friday everyone!Β We are here with the newest issue of the Data News Digest ποΈΒ This week on the news is a new researchΒ by Joseph McKendrick βTaking on the Data Quality Challenge in the Age of AIβ produced by Unisphere Research.Β New analytics and AI technology have been one of the highlights in 2023, if not the main discussion topic.Β There is a rising interest and high levels of investment from companiesΒ and while this research touches upon anΒ important conversation it feels like itβs just the beginning. What are your thoughts?Β Any news youβd like to share? Your take on the latest news? What would you like to see more of? Post it in the comments below π
Hi everyone,Β Β Are you just starting out with Data Governance or would like to brush off some of your skills? Check out our learning journey below and follow along to improve your Data Governance skills one article at a timeβ‘Β First things first:Β Letβs start with the basics πΒ Continue with the essentials πΒ Advance your skills πΒ Need some brainstorming? Check out our digest issueΒ π§ Β
I need toΒ standardize volume data in ml .Β Β I have data in galons,liters and mililiters . Can anyone please help me in this .Β Sample Volume DataΒ 450ml2L5galon2.8LΒ Β Thanks in advanceΒ Β Β
Hi, Iβm Oliver. a Solutions Consultant here at Ataccama.Workflows and governance are integral to any form of modern data management, be it MDM or RDM. But with so much to do in a typical workday, how do you respect the time of your end users and ensure they are informed when their input is required?Out of the box, Ataccama MDM and RDM include useful functionality to send emails to defined roles (i.e. groups of users) whenever records are moved through C(R)UD workflows. But what if we need to:Create consolidated, routine summaries for cases where data changes often and frequently? Allow users (e.g. project managers) who are not directly involved in the workflow to see progress? Notify users in different ways (e.g. Microsoft Teams, Slack, or Amazon SNS)? Create dashboards of daily workflow progress to report against?Once again, we can turn to Ataccama Plans & Scheduled Workflows!Β Notification WorkflowsIn this example, consider a pretend client using RDM, with a custom workflow whenev
Hi everyone,Β Β Learning new skills or starting something from scratch can be daunting sometimes. We may feel a bit lost in all the information coming at us or scroll endlessly in the search results. Thatβs why in this post, I want to create a how to get started with ONE Desktop journey, compiling all the articles we have published in the last months.Β According to your experience, you can jump a few articles or click on the one you find the most challenging at the moment. Please also do share yourΒ feedback and questions in the comments section ππ»Β Beginner Friendly - Learn the essentials:Β How to work with plans? akaΒ your canvas on ONE Desktop:Β Β Main elements of ONE Desktop π₯ππ§π¨Β Tips & Tricks:Β Β If you got the basics letβs move on..Β Β Integrations ποΈΒ Best Practices from the community πͺπ»Β Β Β Β Β Β
Hello everyone!I need to find all tables of attributes with no associated terms from the business term group: "FCB 360 Data attributes." The term "FCB 360 Data attributes" has multiple child terms.Is there a way to find tables that have no attribute of an unrelated term from the group of business terms: FCB 360 Data attributes. if it is possible to find at least with DesktopI will be very grateful for your helpπ€Thank you!
Πello,Β everyoneI need to find attributes that are not linked business terms specifically with the name of tables and attributes. Using the "Filter" tab, I wrote such a queryΒ schema is 'cli_dwh' and attributes.any(termInstances.count() == 0) using stepΒ ONE Metadata Reader, but it seems it takes only the schema but skips the business term, gives a list of attributes that are already linked to the business term. Can you give advice on this problem?I will be very grateful for your helpπ€Thank you!
Happy Thursday all!Β In this post, we will break down and go through all the how-toβs of a functionality we all frequently use in Ataccama - access & sharing.Β Sharing access is an essential feature that allows you to provide access to other groups and users at the asset level. By default, only admins or users with the appropriate rights can manage access to data assets. This can be configured through theΒ manageAccessΒ operation settings for each node for each access level.Β Understanding How Sharing WorksΒ When you share access to assets with other groups and users, it's important to understand how sharing functions based on group hierarchy, user roles, and node inheritance. Here are some key points to remember:Notifications: When you share a data asset or make changes to shared access levels, users or groups involved will receive notifications about the access changes. User Access: Sharing access with a user or group grants access to all data assets shared with that group. The access
Β Happy Tuesday community πββοΈΒ This week we have a series of best practices on all things components on ONE Desktop. Component steps, often referred to as simply "components," are instrumental tools that come with unique capabilities. Here, we'll explore what makes components special and how to make the most of them in your data projects.Β What Sets Components ApartComponents are akin to plans but with distinctive attributes: Reusable: Components can be employed repeatedly, functioning like steps within other plan files. Parameterization: Components can have properties within their constituent steps mapped as parameters, allowing external plans to interact with them (learn more in the section on "Mapping Properties as Parameters"). Console Launch: Components can be executed directly from the console, with parameters for added flexibility. Example: The Component in ActionComponent files are identifiable by their ".comp" extension and can play pivotal roles within your data workflows.
WE are trying to do some HandsOn by ourself. As part of it, we wanted the Atacama free version to be installed in Azure and our team can access it. Not sure whether it is possible and how to Install.
Hello folks,Β I am new for working atacccama tool. we are planned into data migration from ataccama 12.4.1 into 12.9.0 version. If anyone please guide me for tool upgrading
HiΒ I am not able to configure Ataccama Server. Can anyone help me on this?Β I am getting below message when I double click on βstart-server.batβΒ Using java at: "C:\ataccama-one-desktop-14.5.0\jre\bin\java.exe"Using DQC Β at: "C:\ataccama-one-desktop-14.5.0\runtime"Using java at: "C:\ataccama-one-desktop-14.5.0\jre\bin\java.exe"Using DQC Β at: "C:\ataccama-one-desktop-14.5.0\runtime"Picked up _JAVA_OPTIONS: -Djavax.net.ssl.trustStore=C:\Windows\Sun\Java\Deployment\trusted.certsPicked up _JAVA_OPTIONS: -Djavax.net.ssl.trustStore=C:\Windows\Sun\Java\Deployment\trusted.certsWed Nov 01 16:25:19 IST 2023 : Could not listen on port 1529 on host localhost:Β java.net.BindException: Address already in use: bind2023-11-01 16:25:20 [INFO] Β Β com.ataccama.dqc.server.bin.OnlineCtl messageId=generic_msg message=Starting server on localhost2023-11-01 16:25:21 [ERROR] Β com.ataccama.dqc.commons.license.LicenseManager messageId=generic_msg message=DQC license not verified! Program will exit.2023-11-01 16:2
I am trying to use Splitter to transform the stringExample : Input: BeWhoYouAreSplitter output - βe ho ou reβ - skipping the first letter as βUpper caseβ is the separatorDesired output - βBe Who You AreβHow do I achieve this? Also if the string is all lower how to split it?Example: Input: βbewhoyouareβdesired output - βBe Who You Areβ
Hello. i have a general material data csv file, and in that i have to check for duplicates based on material data. Currently i'm trying with the matching step by creating partitions and key rules but still i'm not sure about it. So is there anyone knows about solving this process?? Thanks!
Hi everyone,Β Β We are here with Part II of our VCIs best practice series and today we will delve deeper into two significant aspects of working with VCIs - connecting to natively supported data sources and non-natively supported data sources.In the first post, we explored the creation and transformation of Virtual Catalog Items (VCIs) within Ataccama ONE. You can check it out here ππ»Β Connecting to Natively Supported SourcesAtaccama ONE makes it simple to connect with data sources that are natively supported by following these steps: Create a VCI, as explained in the previous section. To read data from a natively supported source, add the "JDBC Reader" step to your plan. Depending on your transformation requirements, you can use the JDBC Reader step alone or combine it with existing catalog items. Configure the "JDBC Reader" step as follows: On the "General" tab, in "Data Source Name," provide the source identifier of the connected database. You can find the source identifier in
Hi everyone,In this post, we will talk about Virtual Catalog Items π¦ You might have participated inΒ our live training session that took place a few months back where we talked about how to create and work with VCIs. You can always watch back the session and check out the live demo hereΒ Β ππ»Virtual Catalog Items (VCIs) provide flexibility and efficiency when working with data in the ONE Desktop platform and in this article you can find best practices for creating and transforming Virtual Catalog Items to make the most of your data management efforts. Letβs start with the basics:Β Why Use Virtual Catalog Items?VCIs are particularly useful in several scenarios: Applying Transformation Logic: When you need to apply ONE Desktop and in-source (SQL) transformation logic before working with raw data. This includes tasks such as filtering data, joining tables, and standardizing values. Integrating Non-Native Sources: When you want to integrate data from sources that are not natively supporte
πΒ Links to the legacy documentation portal are no longer available.Β Read about the changes and how to access our documentation here.Β Hi there!Β Lisa from Ataccama here. Iβm a Solution Consultant and I love exploring the different ways our platform can become part of the business and technology ecosystem for our customers.In this post, I will share a framework for integratingΒ Ataccama with a work management or issue tracking software like Jira. Delivering data quality insights and alerts from Ataccama to an issue tracking tool can help to maintain transparency and accountability, and to facilitate cross-functional team work.Β Letβs explore an example!Β Use caseΒ Ataccamaβs Data Quality Monitoring Projects are a powerful tool for regular data quality evaluation and reporting on the results. You can configure DQM Projects to run periodic evaluation of data against DQ Rules, and provide various insights to the business. Do you need to send a digest whenever fresh DQM results are ready? Or do
Hi everyone, happy Monday!Β In this post, we will go through a few best practices onΒ how you can work with data in ONE Desktop. Before getting into it, donβt forget to check out some posts you might find useful:Β Browsing Data in ONE ExplorerFrom ONE Explorer, you have the ability to access various components of your data, much like you would in the Knowledge Catalog of the ONE Web Application. ONE Explorer in ONE Desktop includes:Catalog Items Components Lookup Items Monitoring Projects Rules Terms Β This seamless access to your data provides a comprehensive overview of your information, enabling you to manage your data assets with precision.Working with Data in ONE DesktopThere are two primary methods for reading and working with your data within ONE Desktop:1. Catalog Item Reader Step:This step allows you to access data from different sources defined in the Metadata Management Module (MMM). When you drag and drop a Catalog Item from MMM into your plan, the Catalog Item Reader step is
Hello,We are trying to give access for invalid samples in our monitoring projects to our colleagues.Β The coleagues are in a role that they have data access to the Catalog items, and data access in the monitoring project, but they still are not able to see the invalid rows.Which access type should be granded for invalid samples in monitoring project ?
Needed to know how to create a rule having an attribute of STRING datatype for extractingΒ current date and past dateΒ in One Web. Tried using date functions in string using advanced expression (today() is ATTRIBUTE) ..showing error in testcase. But when tried using sameΒ functions for DATETIME datatype working fine. Can anyone help?
I have scheduled certain workflows and running on daily. Due to change in component/ plan optimisation I expect run time changes in the workflow comparing to previous version of the workflow., similarly I did for many workflows and would like to see overall performance improvement in the workflow run.Β Is there any way IΒ can go ahead and download or view the finished instances run times Β for all the workflow in a single place?Β
How I can use create sql catalog on s3 files (csv, parquet) in Ataccama One Web Knowledge Catalog.Do Ataccama use AWS S3 CData drivers
Whenever IΒ run the plan file the output file get updated and the older output file data get lost . Is there any way ataccama can keepΒ the files that is generated for all the time the plan file ran ?Β Β Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.