Skip to main content
Solved

How to write data to Parquet file when it is a record deletion event on RDM UI. (in on-publish)

  • September 10, 2023
  • 1 reply
  • 45 views
O
Star Blazer L1
Forum|alt.badge.img+4

Hello Ataccamer,

I am dealing with Parquet file writing in on-publish mode. Could you please suggest how to write data to Parquet file when it is a record deletion event on RDM UI (in on-publish) . As in case of Parquet file it is always first delete the file and then created the file again.

How the CHANGE_TYPE is in {'DELETED'} will work in this case. Any suggestions, please share.

Thanks and regards,

Ojaswini

Best answer by Ojaswini

Found the way through DQC steps and logics.

Thanks. -Ojaswini

View original
Did this topic help you find an answer to your question?

1 reply

O
Star Blazer L1
Forum|alt.badge.img+4
  • OjaswiniStar Blazer L1
  • Author
  • Star Blazer L1
  • 15 replies
  • Answer
  • September 13, 2023

Found the way through DQC steps and logics.

Thanks. -Ojaswini

Cansu
1 person likes this
  • Cansu
    Cansu

Reply


Most Liked this week

Community Terms of Use & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings