Hello, we are working on a transitional plan to have only one landing zone for Infor ETL data; however at this time we have 3. I am working on an ETL, per table, that reads once and writes to the 4 targets with the same input data. We are testing to ensure that the Main Driving table dl document data and all data is in sync with the other 3. My concern is if one of the target fails, but the main driving target doesn't, we will get out of sync. What has others done with ensuring something similar. I have looked at Pentaho documentation that recommends adding a job id field to the tables, checking at end that they are the same record count or max dates/variation number and if not doing a delete to undo.
What has everyone else done? Or is everyone just one source - one target?
