Magic: The Gathering

I finished working on my first python cloud project and it marks a milestone for me. This project is about ‘Magic: The Gathering’ - a card game created in the early 90s, which I loved to play with my friends. We went from Pokémon, to Yu-Gi-Oh! to Warhammer 40k. But Magic, really sticked with us.

In this project I went from knowing nothing about a professional cloud and orchestration, to setting up a Google Cloud environment via terraform, orchestrating a data pipeline reading from an API to push data to Google Cloud Storage, to BigQuery, transforming my data with DBT and visualizing my insights in a Looker dashboard. Over the last 5 weeks I spent early mornings, late evenings and weekends, to soak up as much as possible on the technologies used - and it does not stop here.

• Cloud: Google Cloud
• Infrastructure: Terraform
• Orchestration: Prefect
• Data lake: Google Cloud Storage
• Data transformation: DBT
• Data warehouse: BigQuery
• Data visualization: Google Looker Studio

Feel free to review the GitHub repo where I explain the project in much more detail or jump straight into the dashboard.

Update, 27th of April 2023: I completed the Data Engineering Zoomcamp from DataTalksClub and landed 2nd among more than 900 participants with this project on the leadership board. Happy to showcase my certificate.

🏆