Empowering Deaf, Hard-of-Hearing & Neurodiverse Students with Real-Time AI Support. HearLink is a cloud-native, production-ready EdTech solution that transforms classrooms into inclusive learning spaces using multilingual speech-to-text, emotion detection, and AI-generated learning aids.
🚀 Top 83 Project - Pragati META AI Hackathon 2025
| Resource | Link |
|---|---|
| 🖥️ Live Web App | Try HearLink Now |
| 🌍 Main Repository | GitHub - HearLink Main |
| 📽️ Pitch Deck | View Pitch Deck |
| Live prototype Video | Video |
| Feature | Description |
|---|---|
| 🎤 Real-Time Multilingual Speech-to-Text | Converts classroom speech into real-time captions across 50+ languages using fine-tuned Whisper models. |
| 😊 Emotion Detection (Live) | Uses camera-based AI to detect student emotions like confusion, frustration, and boredom. Sends alerts to teachers. |
| 📚 AI-Generated Study Materials | Transcribes lectures to generate notes, quizzes, flashcards, and summaries in multiple languages via Ollama. |
| 🧠 Teacher Decision Support | Real-time analytics on student engagement. Suggests minor/major interventions based on detected emotion levels. |
| 💻 Device-Agnostic Access | Web-based platform works on laptops, tablets; mobile version in development. |
| 📈 Feedback & Reports | Dashboards for teachers show individual student progress and emotional engagement history. |
| Upcoming Feature | Description |
|---|---|
| 🧑🏫 Full-Class Emotion Analytics | Group emotion tracking and class-wide participation dashboards. |
| 📱 Mobile App | Cross-platform Flutter app to support smartphones and at-home learners. |
| 💡 Smart Assistive Hardware | Affordable wearable or classroom devices for deaf students. |
| 🔗 EdTech Integration | Plug-and-play API support for Google Classroom, Moodle, Microsoft Teams. |
| Component | Tech |
|---|---|
| Speech-to-Text | Whisper (fine-tuned), E2E Cloud |
| Emotion Detection | Custom FER model |
| AI/LLM | Ollama, Gemini for teacher insights |
| Frontend | React (Web), Flutter (Mobile) |
| Backend | Flask |
| Database | PostgreSQL, S3-compatible object storage |
| Analytics | Superset, Metabase |
| Demo/UI | Streamlit (initial versions) |
| Strategy | Model |
|---|---|
| B2B SaaS | Subscription tiers: Basic, Pro, Enterprise |
| B2G | Government partnerships for wide rollout |
| D2C (Coming) | Paid app for learners + parent dashboards |
| CSR & NGOs | Affordable deployment in underserved schools |
| Ethical Data Insights | Anonymized, compliant reports for policy makers |
- Hosted on: E2E Networks (cost-efficient, India-optimized)
- Cloud-native: Horizontal scaling, serverless options
- Edge-Optimized: Future-ready for on-device emotion analysis
- Regionally Tuned Models: Support for local dialects and accents
- API-First Architecture: Simple integration with any LMS or EdTech system
✅ Production-Ready – Already operational in classrooms
✅ Inclusive Design – Deaf, neurodiverse, and multilingual students supported
✅ Multi-AI Fusion – Speech, Vision, and NLP blended seamlessly
✅ Scalable & Sustainable – Tiered business model, affordable for public schools
✅ Impact-Oriented – Real feedback, real use cases, real change
🎖️ Selected in Top 83 Projects at META AI Pragati Hackathon 2025, India’s premier AI innovation event supporting real-world problem solving in education.
📬 Email: [email protected]
👥 Team HearLink Members
Swarnojit Maitra (Team Leader)
Priyadeep Mullick
Titiksha Chakraborty
Arpan Chowdhury
📣 We're open to partnerships with schools, NGOs, EdTech firms, and government bodies.