Architecture solution-ETL Middleware
ETL is often made into ELT or even LET! The adverse consequences of this are: 1) the database is bloated, the burden is heavy, and the data management is chaotic; 2) the performance is low, the time cost is high (the database write is very slow), which affects the ETL window time.
Solution: the introduction of out-of-library computing engine-aggregator, directly calculate a variety of data sources, do not rely on the database, the real ETL. Aggregator is a middleware that is good at dealing with complex ETL processes, no longer hard coding, time-saving, labor-saving!
ETL middleware
