Airflow can easily integrate with data sources like HTTP APIs, databases ( MySQL, SQLite, Postgres…) and more. It’s a scalable, flexible, extensible and elegant workflow orchestrator, where workflows are designed in Python, and monitored, scheduled and managed with a web UI.

Developed back in 2014 by Airbnb, and later released as open source, Airflow has become a very popular solution, with more than 16 000 stars in GitHub. Which use them, since it facilitates data collection, storage, analysis andĮxploitation, in order to improve business intelligence.Īpache Airflow is an open-source tool to programmatically author, schedule and monitor workflows. ETL processes offer a competitive advantage to the companies Processing it and extracting value from it, storing the results in a data warehouse, so they can be later An ETL workflow involves extracting data from several sources, Workflows helpĭefine, implement and automate these business processes, improving theĮfficiency and synchronization among their components. Orchestrated sequence of steps which conform a business process.