Hello
I am looking to create a One Desktop plan to extract records which are out of sync. I need to compare tables coming from different databases and sources. Or better suggestion to achieve the same.
Need help with this.
Hello
I am looking to create a One Desktop plan to extract records which are out of sync. I need to compare tables coming from different databases and sources. Or better suggestion to achieve the same.
Need help with this.
Hello
thank you for your question. Can you maybe elaborate a bit more on your use-case? Otherwise, the ONE Desktop plans should achieve this using the JDBC Reader steps to connect to your databases, joins to join the data and several different output and transformation steps to gather the output. One thing to look out for is performance; the joins in the application are much slower than the database joins, so in case of joining large datasets, you might face some resource issues.
Is there a specific reason why you want to use the Desktop tool? Is this going to be part of some larger pipeline? Or is it because of the Catalog limitations that currently don’t allow to use one rule on multiple tables at once? For that, you can use the Virtual Catalog Item to prepare the data.
Thank you.
Kind regards
Anna
Thanks Anna. I need to filter records (historical records) from one source (data warehouse) before comparing with different source. Issue is: will need to create virtual catalogs for all tables in first source, which is like 1000+ tables and not good idea to do that. I was planning to create a global filter in DPM (DSL query) which solves my problem where I use Data Recon feature of Web Ui but creates another one where I can’t generally create Virtual catalog items, which extracts selected columns from tables.
I was exploring One Desktop to get actual records which are out of sync. But looks like I need to address first problem to get basic recon values.
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.