Skip to main content
Solved

data source metadata changes - how to know if the field is newly added or existing field dropped?

Prasad Rani
Data Pioneer
Forum|alt.badge.img+1

Hello:

 

I have a data source with 300+ tables. I have a daily profiling job (sample data).

Sometimes, when a table gets changed, and a new field added/existing field dropped, when i open that table in Data Catalog, and in the “Data” tab, it shows that “N” number of metadata changes happened that are marked with a “yellow triangle” symbol (warning/alert).

But, Iam able to see the list of fields that got changes, but iam not able to figure out if it is a new field added or existing field dropped or existing field changed??

How can i get this data?

 

Best answer by joyce

Hi @Prasad Rani! Table attribute changes can be viewed using Data Observability. This document outlines how to configure Data Observability to track changes within your datasource. For example, I've added a newattribute column and deleted column deletedattribute in a table called jttest1 and the changes are shown in Data Observability (see screenshot). Hope this helps!

 

View original
Did this topic help you find an answer to your question?

J
Ataccamer
Forum|alt.badge.img+3
  • joyceAtaccamer
  • Ataccamer
  • April 2, 2024

Hi @Prasad Rani! Table attribute changes can be viewed using Data Observability. This document outlines how to configure Data Observability to track changes within your datasource. For example, I've added a newattribute column and deleted column deletedattribute in a table called jttest1 and the changes are shown in Data Observability (see screenshot). Hope this helps!

 

Cansu
1 person likes this
  • Cansu
    Cansu
Prasad Rani
Data Pioneer
Forum|alt.badge.img+1

Thanks Joyce.

 

Data Observability, as I understand is a separately licensed product with additional cost, that we may not have purchased.

Catherine
1 person likes this
  • Catherine
    Catherine
Cansu
Community Manager
Forum|alt.badge.img+3
  • CansuCommunity Manager
  • Community Manager
  • April 5, 2024

Hi @Prasad Rani please let me know if you’d like to learn more about Data Observability and I can reach out to your Ataccama representative 🙋‍♀️

Check out our Quick Start Guide to get started on the community 🙋‍♀️
J
1 person likes this
  • J
    joyce

Reply


Most Liked this week

Community Terms of Use & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings