PEA Tracker

What does this project do?

This app allows you to track your portfolio performance as well as benchmark it versus a custom index.

PEA, french for Plan Epargne Action, is a special broker account in France with tax advantages.

What technologies were used to make this project?

Extract and load

Custom python scripts using yahoo finance API / scrapy (web crawling) loading data to Big Query.

Transform

DBT and SQL to transform the data directly inside of Big Query (the T of ELT).

Dataviz

Metabase and SQL for the data vizualition part.

Orchestration

Airflow and python to run the data pipeline on a daily schedule.

General diagram

Each component was isolated inside of a docker container and booted up with Docker-compose. Everything is hosted on a cheap VPS.

Airflow DAG

Metabase dashboard