| title | Fraud Sentinel AI |
|---|---|
| emoji | 🛡️ |
| colorFrom | red |
| colorTo | blue |
| sdk | streamlit |
| sdk_version | 1.43.0 |
| app_file | app.py |
| pinned | false |
FraudSentinel AI is a state-of-the-art, multi-layered voice analysis platform engineered to definitively detect and intercept sophisticated phone scams. By merging ultra-fast phonetic transcription with deep semantic heuristics and Agentic LLM reasoning, the system generates real-time, explainable threat assessments for any audio interaction.
🚀 Experience the live, unified dashboard in action:
👉 Launch FraudSentinel AI on Hugging Face
Our system does not rely on simple word matching. It utilizes a synchronized multi-agent heuristic pipeline to analyze the psychological intent and semantic risk of a conversation:
- 🎙️ Speech-to-Text Pipeline: Utilizes
faster-whisperfor highly optimized, offline transcription. - 📖 Semantic Engine: Deploys
sentence-transformersto map conversational flow against high-risk scam embeddings. - ⚖️ Rule-Based Heuristics: Instantly flags critical trigger phrases (e.g., "gift card", "arrest warrant", "remote access").
- 🎭 Social Engineering Analyzer: Detects psychological manipulation tactics like synthetic urgency, authority impersonation, and forced isolation.
- 🤖 LLM Agentic Reasoning: Connects to via API OpenRouter to deploy advanced reasoning algorithms, contextualizing the conversation to eliminate false positives.
⚠️ Final Risk Orchestrator: Fuses the sub-agent scores into a unified, actionable Threat Level (Safe, Suspicious, High Risk, Critical).
graph TD
A[Raw Audio / Live Call] -->|Whisper Transcription| B(Transcribed Text)
B --> C{Agentic Orchestrator}
C -->|Transformer Embeddings| D[Semantic Detector]
C -->|Pattern Matching| E[Rule-Based Engine]
C -->|Tactic Modeling| F[Social Engineering Detector]
C -->|Contextual Reasoning| G[LLM API Engine]
D --> H[Risk Fusion Engine]
E --> H
F --> H
G --> H
H --> I((Final Threat Report))
You can easily run the FraudSentinel engine locally on your machine for maximum privacy and execution speed.
- Python 3.9+
- FFmpeg (Required for audio processing)
-
Clone the highly secure repository:
git clone https://github.com/coolss21/Agentic_AI_Scam_Call_Detection.git cd Agentic_AI_Scam_Call_Detection -
Install the unified dependencies:
pip install -r requirements.txt
-
Configure the AI Environment: Create a
.envfile in the root directory and add your OpenRouter key:OPEN_ROUTER_API_KEY=your_api_key_here
-
Launch the Core Interface:
streamlit run app.py
The interface is wrapped in a breathtaking Cyber-Security styled glassmorphism aesthetic. The custom CSS automatically adapts to the analysis logic, deploying cinematic micro-animations, glowing risk-level indicators, and an ultra-modern dark mode palette guaranteed to impress.
This repository is architected carefully for academic and commercial cyber-security evaluations. All pull requests are welcome.
Defending the vulnerable, one conversation at a time.