This project focuses on automatic classification of sentences in medical abstracts using different deep learning and machine learning approaches.
We experiment with multiple NLP models ranging from simple baselines to advanced embedding and positional encoding techniques.
Given a medical abstract, classify each sentence into one of the following categories:
- Background
- Objective
- Methods
- Results
- Conclusions
This helps in quick scientific literature understanding (SkimLit task).
The way I learnt project is explained step-by-step in the following video series (In Burmese):
Introduction to dataset and baseline machine learning model. https://youtu.be/1evvGMdTgY4
Using Conv1D models for text classification. https://youtu.be/ZmaiD9Y1S0w
Word embeddings and hybrid NLP architectures. https://youtu.be/DupFb4CWGOM
Adding positional encoding for better sequence understanding. Connecting...
This project includes:
- Baseline TF-IDF + classical ML model
- 1D Convolutional Neural Network (Conv1D)
- Word Embedding models (Keras / TensorFlow Hub)
- Hybrid models (token + character inputs)
- Positional embeddings for sequence awareness
SkimLit_Medical_Abstract_Classification/
│
├── skimlit_model1.keras # Trained deep learning model
├── app.py # Streamlit web app
├── requirements.txt
├── notebooks/
└── README.md