Skip to content

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🎙️🧠 AIVA – AI Virtual Assistant

Python OpenCV PyAudio SpeechRecognition NLP Streamlit

🚀 AIVA is a multimodal AI assistant that processes face and speech input to understand user emotion and generate intelligent responses in real time.


📌 Overview

AIVA (AI Virtual Assistant) is an AI-based system that combines:

  • 🎥 Computer Vision (Face Detection)
  • 🎤 Speech Recognition (Audio → Text)
  • 🧠 NLP (Text Understanding + Response Generation)
  • 🖥️ Interactive UI (Streamlit)

It enables real-time human-computer interaction using both visual and voice inputs.


✨ Features

  • 🎥 Real-time face detection using webcam
  • 🎤 Speech-to-text conversion
  • 🧠 NLP-based response generation
  • 💬 Intelligent response engine
  • ⚡ Fast and lightweight processing
  • 🖥️ Interactive Streamlit interface

🧠 Tech Stack

⚙️ Category 🚀 Technology
Language Python
Computer Vision OpenCV (Haarcascade)
Audio Input PyAudio
Speech Recognition SpeechRecognition
NLP Basic NLP techniques
UI Framework Streamlit

⚙️ How It Works

🎥 Face Detection

  • Implemented in face_detect.py
  • Uses Haarcascade with OpenCV
  • Detects faces in real-time from webcam

🎤 Audio Emotion / Speech Processing

  • Implemented in audio_emotion.py
  • Captures audio using PyAudio
  • Converts speech to text using SpeechRecognition

🧠 NLP & Response Engine

  • Implemented in response_engine.py
  • Processes text input
  • Generates intelligent responses based on user speech

🖥️ Main Application

  • app.py integrates:
    • Face detection
    • Speech processing
    • NLP response
  • Provides an interactive UI using Streamlit

🎯 Output

  • 🎥 Detected face (visual confirmation)
  • 🗣️ Recognized speech (text)
  • 💬 AI-generated response
  • ⚡ Real-time interaction

📊 Project Structure

AIVA/
│
├── model/                 # Stored ML/NLP models
│
├── app.py                 # Main Streamlit application
├── face_detect.py         # Face detection module
├── audio_emotion.py       # Audio processing & speech recognition
├── response_engine.py     # NLP response logic
│
├── requirements.txt       # Dependencies
├── README.md              # Project documentation
└── .gitignore             # Ignored files

👩‍💻 Authors

Komal Singh GitHub

Pranjal Singh GitHub

About

An AI-powered assistant that uses computer vision and voice analysis to detect user emotions and provide intelligent, context-aware responses through a Streamlit-based interface.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages