Hello all,
i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets.
this is what i see now in ataccama. I want to merge these data to one table.
Thanks for replies, Matus
Best answer by Samuel Muvdi
Hello! Please look into transformations on ONE web app as well as ONE Data tables. Through a combination of these 2 you should be able to union your parquet files in a transformation plan using their partition key, and then create a ONE data table out of the outcome of that union, to be able to see the results tabularized
Best regards-
Samuel :)
Hello! Please look into transformations on ONE web app as well as ONE Data tables. Through a combination of these 2 you should be able to union your parquet files in a transformation plan using their partition key, and then create a ONE data table out of the outcome of that union, to be able to see the results tabularized
Best regards-
Samuel :)
+3Hi
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
