https://sapient.pro/blog/data-pipeline-architecture-best-practices
Data Pipeline Architecture: How to Build Reliable Flows from Scraping to Business Intelligence