Transactional Data Pipeline (Tech Challenge)
- Designed a scalable ELT architecture simulating a banking environment with isolated Docker networks to secure transactional source DBs.
- Implemented Docker-out-of-Docker where Airflow manages ephemeral Sibling Containers (Meltano) via host socket.
- Developed Bash scripts for automated environment provisioning and service initialization.