Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added .DS_Store
Binary file not shown.
6,920 changes: 6,920 additions & 0 deletions .ipynb_checkpoints/Mini Project-checkpoint.ipynb

Large diffs are not rendered by default.

Binary file added DATA Mini Project.pptx
Binary file not shown.
Binary file added Final Project DATA 400 Presentation.pdf
Binary file not shown.
Binary file added Final Project DATA 400 Progress Presentation.pptx
Binary file not shown.
45 changes: 45 additions & 0 deletions Idea 1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,45 @@
# Idea 1

### Research Question:

How does the sentiment expressed in online customer reviews influence the click-through rate (CTR) of product advertisements on Amazon?

### Data Source:
Amazon Product Advertising API and Amazon Customer Reviews Dataset (on Kaggle)

**Data Retrieval**:
* Amazon Customer Reviews (on Kaggle): This dataset includes:
* Review Text: The actual customer review text (raw text).
* Review Rating: Star rating from 1 to 5.
* Product ID: Unique identifier for each product.
* Review Date: Date when the review was posted.
* Helpful Votes: Number of users who found the review helpful.
* Online Advertising CTR Dataset (Retrieved using the Amazon Product Advertising API): This dataset includes:
* Ad Impressions: Number of times the ad was shown.
* Clicks: Number of times the ad was clicked.
* CTR: Click-through rate, calculated as the ratio of clicks to impressions.
* Product ID: To connect ad data with review sentiment.

### Data Analysis and Modeling:

* Sentiment Analysis: The reviews will be classified into three sentiment categories: positive, neutral, and negative. These sentiment categories will be the independent variable for the model.

**Exploratory Data Analysis (EDA)**:
* Descriptive statistics of CTR, review ratings, and other variables.
* Distributions of variables (review ratings), frequency of words used in the reviews, and visualizations to explore relationships between variables.
* Correlation analysis to identify potential relationships between variables.

**Model Specification**:
* Logistic Regression: This model will be used to predict the likelihood of a product ad receiving clicks based on the sentiment of customer reviews.


### Implications for Stakeholders:

* Advertisers: By understanding how positive or negative sentiment in reviews affects CTR, advertisers can optimize their campaigns by focusing on products with better customer sentiment or tailoring their ads based on review feedback.
* E-commerce Platforms: Platforms like Amazon or other e-commerce sites can use sentiment data to refine their recommendation systems and ad placements, increasing relevance and improving user experience.
* Consumers: A more personalized advertising experience, driven by customer feedback, can lead to better product recommendations and ads that reflect consumer preferences.

### Ethical, Legal, and Societal Implications:
* Privacy: The data used for analysis will be aggregated and anonymized, ensuring no personally identifiable information (PII) is exposed.
* Avoiding Bias: Care will be taken to avoid biases in the models, particularly around certain types of products or demographics that may skew sentiment analysis results.
* Transparency: In a real world application, it would be important to maintain transparency with consumers about how their reviews are being used to influence ad placement, fostering trust between the platform and users.
27 changes: 27 additions & 0 deletions Idea 2.md

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This idea is interesting as it can help Ferrari make more rational decisions regarding tyre/pit stop strategy. One thing to notice is that there have been some changes in terms of type of tyre from 2014 to 2024. Example: In 2018, there were super-hard and ultra-soft tyres. This might create some discrepancies in your data.

Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Idea 2
### Research Question:
How can Formula 1 teams optimize race strategies (pit stops, tire choices, and lap timings) based on track conditions (temperature, weather, etc.) to improve performance and outcomes?

### Data Source:
Data will be retrieved using the Ergast Developer API (the API is deprecated, but it will still be updated until the end of the 2024 season. For alternative options there are F1 databases on Kaggle, and the open source database f1db), which provides access to detailed historical F1 race data. The project will utilize data from the last 10 F1 World Championships (from 2014 - V6 engine era). Key variables include:
* Pit Stop Data: Time of pit stop according to the race (pit on which lap), tire type on each stint, and number of pit stops.
* Track Conditions: Temperature, wind speed, humidity, and rain data.
* Race Results: Starting and finishing positions, lap times, race duration.
* Tire Strategy: The type of tire used during the race (soft, medium, hard) and the order in which they are used.
* Driver Performance: Driver lap times and overall performance in the race as well as in the championships.

### Data Processing and Model Specification:
I will perform exploratory data analysis (EDA) to identify correlations between track conditions and race outcomes. Based on the insights, I will employ a combination of regression models and classification algorithms:
* Linear Regression to predict optimal pit stop times.
* Decision Trees to recommend the best tire strategies based on weather patterns.

### Implications for Stakeholders:
This project will help F1 teams optimize their race strategies by predicting the best possible outcomes given specific track conditions. It can:
* Minimize pit stop times and avoid unnecessary stops.
* Optimize tire choices to suit the conditions, thus improving lap times.
* Provide teams with a data-driven approach to enhance performance.

### Ethical, Legal, and Societal Implications:
* Environmental Impact: Optimizing tire usage reduces waste, which aligns with FIA’s sustainability goals.
* Fan Experience: Help F1 fans gain a deeper understanding of race strategy and how different factors of a race can affect which strategy is optimal. This will highlight a much underrated interesting aspect of the sport, which might appeal to new groups of fans, thus create opportunity for the sport to expand to new markets.
* Data Privacy: Ensure all data retrieval follows the API's and the FIA's legal guidelines, protecting driver and team information.
32 changes: 32 additions & 0 deletions Idea 3.md

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a creative idea. However, I think that the question covers a broad scope. You might want to consider narrowing it down to one key aspect to make the analysis more targeted.

Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
# Idea 3

### Research Question:
What are the current market conditions for the open-source software market? Specifically, which open-source projects and applications are gaining attention, and how can we predict their future growth? By focusing on trends, geographic locations, and the popularity of specific projects, this research aims to forecast the potential for growth in various open-source technologies.

### Data Source:
The data will be sourced from Google Trends using their API. This dataset provides key variables such as:
* Interest Over Time: A measure of how frequently a specific search term (in this case, open-source projects) is queried on Google over a defined period.
* Geographic Location: Regional data that shows where certain open-source projects are being searched for and gaining popularity.
* Related Topics and Queries: Insights into other open-source tools or projects that are linked to the main search term. To enhance prediction accuracy, I will create additional variables such as project release date, GitHub star growth rates, and community engagement metrics by scraping repositories and open-source news platforms.

### Data Analysis and Modeling:
**Exploratory Data Analysis (EDA):**
* Visualization of trends over time for specific projects to identify growth patterns.
* Geographic analysis to determine which regions are driving the most interest in open-source projects.
* Analysis of related queries and topics to uncover emerging trends in the open-source community.

**Model Specification:**
* Time Series Analysis: ARIMA models will be used to forecast the growth of search interest over time for open-source projects.
* Classification Models: Random Forest classifiers to predict which projects are most likely to grow based on current trends and community activity.
* Clustering: K-Means clustering to group projects by similar growth patterns or geographic popularity.

### Implications for Stakeholders:
* Open-Source Developers: Understanding which projects are growing can guide development focus and resource allocation.
* Businesses and Investors: Insights into trending projects can inform investment decisions in the open-source space.
* Tech Communities: Knowing which regions are showing increased interest in open-source software can help tailor community-building efforts and localization of projects.

### Ethical, Legal, and Societal Implications:
* Attribution and Licensing: Open-source projects typically use licenses like MIT, Apache, or GPL. When analyzing these projects and incorporating findings into a commercial context, it’s essential to respect and acknowledge these licenses, ensuring that any insights derived from open-source data comply with the licensing terms.
* Digital Divide: This project may highlight how interest in open-source projects varies across different regions. If the data shows that wealthier or more developed regions dominate interest in open-source technologies, it could highlight and potentially exacerbate the digital divide. This raises questions about how to foster open-source engagement in underrepresented regions and whether there should be efforts to democratize access to open-source tools and knowledge.
* Workforce and Employment: If certain open-source technologies gain significant attention and experience rapid growth, this could shift demand in the tech workforce. It’s important to consider how this shift may impact developers, particularly those who specialize in less-popular open-source projects or technologies. It could also contribute to the growing trend of automation, potentially displacing traditional jobs in some sectors.
* Community Impact: Open-source projects thrive on contributions from a wide range of individuals, often in a decentralized manner. Predicting which projects will grow could lead to commercialization efforts that might alter the ethos of the open-source community, creating tension between profit-driven growth and community-driven development. Ensuring that the collaborative spirit of open-source remains intact is crucial to maintaining the health of these communities.
Loading