🚀 An intelligent healthcare web application that detects ear diseases from otoscopic images using Deep Learning, Explainable AI, and LLM-based insights.
EarCare AI Clinic is a full-stack AI-powered system designed to assist doctors and patients in diagnosing ear diseases quickly and accurately.
The system analyzes ear (otoscopic) images using a deep learning model and provides:
- Disease prediction
- Confidence score
- Visual explanation (Grad-CAM)
- Human-readable medical insights
AI-powered ear disease detection system that combines deep learning, explainable AI, and real-time web deployment to assist doctors and improve patient diagnosis.
- 🔍 AI-based Disease Detection
- 🧠 Explainable AI (Grad-CAM heatmaps)
- 📊 Confidence Score + Risk Analysis
- 💬 LLM-based Medical Explanation
- 📁 Patient History Tracking
- 🔐 JWT Authentication (Login/Signup/Logout)
- 📱 Modern Responsive UI (React + Tailwind)
- ⚡ Fast Prediction (<5 seconds)
- User uploads ear image or captures via camera
- Image is sent to backend (Flask API)
- Deep Learning model (EfficientNet) processes image
- Model outputs:
- Predicted disease
- Confidence score
- Grad-CAM generates heatmap (focus region)
- LLM generates easy-to-understand explanation
- Results displayed on frontend dashboard
- Dataset: Otoscopic Ear Images
- Total Images: 3000
- Classes: 5 (Balanced dataset)
- Format: JPEG (.jpg)
| Class | Images |
|---|---|
| Acute Otitis Media | 600 |
| Cerumen Impaction | 600 |
| Chronic Otitis Media | 600 |
| Myringosclerosis | 600 |
| Normal | 600 |
- Model: EfficientNet (Transfer Learning)
- Framework: TensorFlow / Keras
- Image Size: 224 × 224
- Transfer Learning
- Data Augmentation
- Batch Training
- Hyperparameter Tuning
- Initial Accuracy: ~10–15%
- Final Accuracy: ~98%
- Validation Accuracy: ~95–97%
High accuracy achieved due to balanced dataset, transfer learning, and optimized training pipeline.
We use Grad-CAM to visualize model attention:
- Highlights important regions in the image
- Improves trust and interpretability
- Useful for medical validation
- Converts predictions into human-readable medical insights
- Provides:
- Disease explanation
- Risk level
- Suggested next steps
User → Upload Image → Flask API → EfficientNet Model → Prediction → Grad-CAM → LLM → Frontend Dashboard
- React.js
- Tailwind CSS
- Flask
- TensorFlow / Keras
- EfficientNet
- MongoDB
- JWT (Access + Refresh Tokens)
- Grad-CAM
- LLM Integration
Add your project screenshots here:
- UI Dashboard
- Image Upload Interface
- Prediction Output
- Grad-CAM Heatmap
- ⚡ Diagnosis in under 5 seconds
- 👨⚕️ Assists doctors (not replacement)
- 🧑🤝🧑 Easy for patients to understand
- 🌍 Useful in rural / low-resource areas
- Performance depends on image quality
- Not a replacement for professional diagnosis
- Requires further validation on real-world data
- Mobile application deployment
- Integration with hospital systems
- Use of advanced models (ResNet, Vision Transformers)
- Larger and more diverse dataset
- SRV
This project is for academic and research purposes only.
- Medical imaging datasets
- Deep learning research community
- Open-source tools and libraries
If you found this project useful, consider giving it a ⭐ on GitHub!