Data Engineering project for tracking internship and job offers
end-to-end ETL pipeline that automatically collects job offers, filters relevant ones (those of interest), and notifies about new opportunities
- HTTP requests and HTML fetch
- web scraping offers
- Pandas data filtering and cleaning
- detecting new offers and updates
- Discord notifying
- Streamlit dashboard
Python | Requests | BeautifulSoup | Pandas | Git | Streamlit