-
Notifications
You must be signed in to change notification settings - Fork 13
Progress Presentation #23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
westrc
wants to merge
6
commits into
ernbilen:main
Choose a base branch
from
westrc:main
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
6 commits
Select commit
Hold shift + click to select a range
10e99c4
Add files via upload
westrc 704b930
Merge pull request #1 from ernbilen/main
westrc 3bed6e4
Add files via upload
westrc afa662e
Add files via upload
westrc 6c06538
Merge pull request #2 from ernbilen/main
westrc 2f12e5c
Add files via upload
westrc File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Binary file not shown.
Binary file not shown.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| #DATA 400: Idea 1 | ||
| ####Ryan West | ||
|
|
||
| ## Part 1: Research Question | ||
|
|
||
| One of the largest fields of biology that uses data analysis is that of bioinformatics. One large field of bioinformatics is that of differential gene expression analysis, which compares the gene expression of specified conditions to typical gene expressions. The NCBI keeps records of large amounts of trial data. I chose to answer the question: *What affect does IBD (Crohn’s disease) have on gene expression when compared to healthy individuals?* | ||
|
|
||
| ## Part 2: Dataset | ||
|
|
||
| The dataset that I’ve chosen comes from an RNA-seq analysis of adipose tissue-derived stem cells from individuals with inactive and active Crohn’s, along with healthy individuals. The dataset is available in an annotated form from the NCBI’s GEO database, or in its raw FASTQ format from the NCBI’s SRA database. I have yet to decide which format I will use, as both have their benefits and issues. | ||
|
|
||
| The raw FASTQ file contains the individual transcriptomes associated with each person who was analyzed in the study. This would provide a great opportunity to analyze raw data including its clean-up, but the files total around 15 Gb. The annotated file would skip some preprocessing and would be much smaller. | ||
|
|
||
| The dataset includes the transcriptomes of the patients analyzed, along with basic information about each patient, such as sex, age, and cohort. There will need to be more columns added to compare each sample to each other, with their associated p-values. | ||
|
|
||
| ## Part 3: Differential Gene Analysis | ||
|
|
||
| The main purpose of differential gene analysis is to determine which genes are significantly up/down regulated when compared to a ‘normal’ transcriptome. The data will need to be processed and normalized, which is usually done in the program FastQC. If any issues are identified, the data is typically trimmed using Trimmomatic. | ||
|
|
||
| The next step would be to align the samples to the human reference genome, which can be done in R using HISAT2. From here, we can get feature counts to be used in analysis. This data can be placed directly into R for analysis with the DESeq (or edgeR) packages, which have been designed to read gene expression. | ||
|
|
||
| I will create various heat maps and charts to show the statistical analysis of which genes are significantly differentially expressed. Another chart which is typically created is a volcano plot to visualize up/down regulation. Typically, this information would be important in understanding pathways in diseases for a whole host of reasons, potentially for new drugs to treat patients. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,35 @@ | ||
| # Idea 2: 1000 Genomes Project | ||
|
|
||
| ## 1) Research Question | ||
|
|
||
| Where is hypertension most common, and what genetic characteristics are associated with developing hypertension? (This question could be asked about nearly any genetic condition; I have chosen hypertension.) | ||
|
|
||
| ## 2) Data Source | ||
|
|
||
| The 1000 Genomes Project was conducted between 2008 and 2015 with the goal of documenting genetic variation across diverse populations. The human genome contains approximately 3 billion DNA base pairs; this project aimed to document the genome of 1000 people. 1KGP keeps its information freely available online for research purposes. This contains filterable versions of genetic material and can be grouped by world region. We can get information on known genetic mutations from ClinVar to know where in the genome (out of 3 billion bases) we should be looking. | ||
|
|
||
| ## 3) Discussion | ||
|
|
||
| We can filter and trim this data down to the genes that we need to find when known malignant genes are overexpressed in the population groups discussed above. There are a few R packages to help with this (like PLINK), and further statistical analysis can be done in R (like Chi-square) to better determine allelic frequency. There are also pathway databases which could be used to illustrate how the specific genes we’re looking at are involved in cellular processes and what happens when variations are found. | ||
|
|
||
| We could also create a heatmap showing which genes are significantly overexpressed in different regions of the world. There likely are not any ethical implications for this, as they have already been handled by 1KGP. There is no personally identifying information associated with anything in the data to be analyzed. This analysis could be helpful to find interesting patterns amongst populations and can better our understanding of where and why some conditions are prevalent. | ||
|
|
||
| # Idea 3: Sentiment Analysis | ||
|
|
||
| ## 1) Research Question | ||
|
|
||
| How can Utz Quality Foods better prioritize call center agents’ time? | ||
|
|
||
| ## 2) Data Source | ||
|
|
||
| Utz Quality Foods’ Zendesk instance. All the problems that consumers have ever had with Utz going back approximately 5 years are stored. They are accessible via API and are delivered in JSON format, making analysis on them quite easy. This data contains many different topics, and there are around a few hundred variables. Large chunks of these variables are usually listed as NA or are blank, but analysis would likely be quite easy on this data. | ||
|
|
||
| ## 3) Discussion | ||
|
|
||
| Utz’s customer data is currently quite messy. A large portion of this project would be cleaning up the data and constructing better workflows, with the potential for more powerful analysis later (perhaps too far outside of the realm of a mini project). | ||
|
|
||
| My project would have two goals: route tickets to agents with the most specialized skills and better prioritize tickets. Currently, Utz’s consumer data receives requests from customers and dumps it all in one place with the same priority. It would be extremely beneficial to perform some type of sentiment analysis on the text body (combined with customer-selected options) to automatically assign priority labels to these requests so that agents are working on the most urgent requests first (while also keeping time in mind). | ||
|
|
||
| Additionally, analysis of this text (again combined with selected variables/tags) would allow us to better group requests and deliver them to more appropriate agents. This will greatly improve organization for Utz. | ||
|
|
||
| One huge concern is that of ethics: some of the data is confidential or at the very least sensitive, so this model would likely only be able to be shared internally or with portions of it redacted. |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Interesting ideas. For idea 2, I think that managing and filtering large-scale genomic data requires significant expertise. Ensure you have a clear plan for handling such a large dataset and addressing missing data. And for idea 3, I'm curious about how you’ll evaluate the success of your system. Will it be based on reduced response time or improved customer satisfaction?