🚀 AIVA is a multimodal AI assistant that processes face and speech input to understand user emotion and generate intelligent responses in real time.
AIVA (AI Virtual Assistant) is an AI-based system that combines:
- 🎥 Computer Vision (Face Detection)
- 🎤 Speech Recognition (Audio → Text)
- 🧠 NLP (Text Understanding + Response Generation)
- 🖥️ Interactive UI (Streamlit)
It enables real-time human-computer interaction using both visual and voice inputs.
- 🎥 Real-time face detection using webcam
- 🎤 Speech-to-text conversion
- 🧠 NLP-based response generation
- 💬 Intelligent response engine
- ⚡ Fast and lightweight processing
- 🖥️ Interactive Streamlit interface
| ⚙️ Category | 🚀 Technology |
|---|---|
| Language | Python |
| Computer Vision | OpenCV (Haarcascade) |
| Audio Input | PyAudio |
| Speech Recognition | SpeechRecognition |
| NLP | Basic NLP techniques |
| UI Framework | Streamlit |
- Implemented in
face_detect.py - Uses Haarcascade with OpenCV
- Detects faces in real-time from webcam
- Implemented in
audio_emotion.py - Captures audio using PyAudio
- Converts speech to text using SpeechRecognition
- Implemented in
response_engine.py - Processes text input
- Generates intelligent responses based on user speech
app.pyintegrates:- Face detection
- Speech processing
- NLP response
- Provides an interactive UI using Streamlit
- 🎥 Detected face (visual confirmation)
- 🗣️ Recognized speech (text)
- 💬 AI-generated response
- ⚡ Real-time interaction
AIVA/
│
├── model/ # Stored ML/NLP models
│
├── app.py # Main Streamlit application
├── face_detect.py # Face detection module
├── audio_emotion.py # Audio processing & speech recognition
├── response_engine.py # NLP response logic
│
├── requirements.txt # Dependencies
├── README.md # Project documentation
└── .gitignore # Ignored files