Kirby 2019
Event-driven, distributed, data collection framework

Official website: kirby.readthedocs.io
  • similar to Apache Airflow
  • uses Kafka to store event data, PostgreSQL for jobs
  • built to be highly resilient
  • fully tested and documented
  • realtime monitoring of data flowing through the system
Big Data ETL Open-Source