Welcome to our data extraction, transformation, and loading (ETL) application! Developed collaboratively, this app empowers users to gather data from popular travel websites such as eDreams and KAYAK through web scraping techniques. Once the data is harvested, our application processes it into a uniform format, enabling seamless integration with the AirTable database via API. Join us on this journey as we delve into the world of travel data, extracting valuable insights and uncovering hidden gems within our vast collection of information.
- We utilize web scraping to download data from eDreams and KAYAK pages.
- Relevant information about flights, destinations, prices, and travel dates is extracted.
- Downloaded data is processed to standardize its format.
- Transformations are applied to ensure consistency and coherence in the data structure.
- Data is prepared for subsequent loading into the AirTable database.
- The AirTable API is used to load processed data into our centralized database.
- Data is organized and stored orderly for easy access and management.
- Data stored in AirTable is extracted for comprehensive analysis.
- Libraries such as Plotly, Seaborn, Matplotlib, and Folium are employed to create impactful visualizations.
- Trends, patterns, and relationships in the data are explored to extract valuable insights.
- The Foursquare API is utilized to find points of interest at travel destinations.
- Additional information about places of interest, restaurants, activities, and more is added to our dataset.
Join us on this exciting journey as we explore and analyze travel data to discover new experiences and opportunities!
If you have any questions or comments about the operation of ETL process, feel free to contact us.
Hey there! We're a passionate team of developers working together to reach new heights in the tech world 🌎. Focused on innovation and performance, let us introduce you to our awesome team! 💻
- LinkedIn: José Angel Dos Reis Zapata
- GitHub: José Dos Reis - josedosr
- Email: josedosr@hotmail.com
José is our coding rockstar!🤘🏽 With undeniable talent and skills, top-notch ideas and a passion for challenges makes him one of our team's keys to success 🔑. He brings wonderful energy and never gives up!✨
- LinkedIn: Pamela J. Colman V.
- GitHub: Pamela Colman - pamve
- Email: pamvecol@gmail.com
Pamela is our data guru, providing brilliant insights and in-depth analyses that guide our team's success, turning data into impactful decisions! 📈💡
- LinkedIn: Daniel Muñoz Monte
- GitHub: Daniel Muñoz - devmunoz
- Email: daniel.munoz.monte@gmail.com
Daniel is our web development maestro, with exceptional experience, fearlessness to tweak any code, and brilliant ideas that elevate our team to the next level! 💻🚀