This project is a General Health Query Chatbot built using a Large Language Model (LLM).
It provides friendly and safe health-related information based on user queries.
- LLM-powered responses
- Safety filter (blocks harmful medical advice)
- Fast inference using 4-bit quantization
- Fully local (no paid API required)
- Mistral-7B-Instruct (Quantized 4-bit version from Hugging Face)
- User enters a health-related query
- Backend sends prompt to LLM
- Model generates response
- Safety filter ensures safe output
- Response displayed