🛠 Prototype built as a Progressive Web App (PWA) for desktop & mobile - https://access-ai-unify.lovable.app/
Got selected for Algoverse Hackathon final round.
Access+ is a cross-platform accessibility solution designed to empower users with hearing, visual, and cognitive impairments. With AI-powered features and a clean, simplified interface, Access+ enhances usability across digital platforms—bringing independence and inclusivity to every user.
🦻 For Users with Hearing Impairments :
Real-Time AI Captioning: Transcribes audio from any app (video calls, YouTube, podcasts) into live captions.
Emotion Recognition (Voice/Video): Detects emotions in speakers’ tone or facial expressions and displays visual cues.
Sound Event Detection: Alerts users to critical sounds (doorbells, alarms, sirens) using device microphone.
Sign Language Interpreter: Converts sign language (via webcam) to text and vice versa for seamless communication.
👁️ For Users with Visual Impairments :
AI-Powered Screen Reader: Reads out on-screen content intelligently, summarizing web pages and PDFs.
Scene Description: Uses the camera to describe surroundings and highlight objects (e.g., “A person standing near a red car”).
Gesture-Based Navigation: Navigate apps/websites using predefined hand gestures tracked by the camera.
Braille Support: Integrates with refreshable braille displays and on-screen braille keyboards.
🧠 For Users with Cognitive Impairments :
Simplified UI Mode: Removes clutter from websites and apps, presenting an easy-to-use, distraction-free interface.
Routine & Reminder Assistant: Visual daily planner with cues, timers, and step-by-step task sequencing.
Emotion-Aware Assistant: Detects distress and provides calming content or alerts caregivers.
Language Simplifier: Automatically rewrites complex text (legal, medical, academic) into simple language.
♿ Unified Features for All :
Voice & Eye Tracking Control: Full device interaction using only voice or eye movement.
Customizable Profiles: Create and switch between accessibility profiles tailored to individual needs.
Cross-Device Sync: Settings and preferences sync across desktop and mobile.
- ScamShield (Digital Safety): Flags suspicious links, scam pop-ups, and warns users before submitting sensitive data.
The only requirement is having Node.js & npm installed - install with nvm
Follow these steps:
# Step 1: Clone the repository using the project's Git URL.
git clone <YOUR_GIT_URL>
# Step 2: Navigate to the project directory.
cd <YOUR_PROJECT_NAME>
# Step 3: Install the necessary dependencies.
npm i
# Step 4: Start the development server with auto-reloading and an instant preview.
npm run devThis project is built with:
- Vite
- TypeScript
- React
- shadcn-ui
- Tailwind CSS -TensorFlow, PyTorch, Mediapipe, Whisper(not in prototype) -Firebase / MongoDB
- Deployment by lovable
✅ Installable on desktop & mobile ✅ Works offline for key features ✅ Lightweight & no need for browser extension permissions
Access+ reduces digital barriers and empowers differently-abled users to interact with technology independently. It unifies accessibility features into one platform, eliminating the need for fragmented tools.
- Sign-in option
- Screen reader reads the screen but only upto an extent
- Simplification of UI (but only basic mode)
🖋️ Zarine Hayat – Concept & Design & Idea
💻 Lovable – Development Partner
Plakshi Yadav - Pitching
MIT License