For the last few months, I have been using the Metaflow framework to orchestrate my personal data projects. I made some modifications to the recommended infrastructure design to meet my own requirements, e.g. cost reduction, complexity reduction, and use of Terraform. I also tried to bake in some AWS best-practices from lessons learned professionally.

https://wtanner.github.io/metaflow/terraform/2020/08/02/personal-metaflow.html