1 Branch 0 Tags

Name		Name	Last commit message	Last commit date
Latest commit Raghav010 Update README.md Dec 26, 2023 062e993 · Dec 26, 2023 History 21 Commits
App		App	dockerized the application and fixed bugs	Nov 8, 2023
build_utils		build_utils	dockerized the application and fixed bugs	Nov 8, 2023
mashqa_data		mashqa_data	codebase cleaned.	Nov 6, 2023
media		media	cleaned code, and modified README	Nov 6, 2023
.dockerignore		.dockerignore	changed docker pull cmd	Nov 10, 2023
.gitignore		.gitignore	dockerized the application and fixed bugs	Nov 8, 2023
Dockerfile		Dockerfile	dockerized the application and fixed bugs	Nov 8, 2023
README.md		README.md	Update README.md	Dec 26, 2023
backend.py		backend.py	dockerized the application and fixed bugs	Nov 8, 2023
dbGen.py		dbGen.py	cleaned code, and modified README	Nov 6, 2023
docker-run.sh		docker-run.sh	changed docker pull cmd	Nov 10, 2023
install.sh		install.sh	dockerized the application and fixed bugs	Nov 8, 2023
medmini.pdf		medmini.pdf	cleaned code, and modified README	Nov 6, 2023
medmini.py		medmini.py	dockerized the application and fixed bugs	Nov 8, 2023
run.sh		run.sh	modified readme	Nov 9, 2023
todo		todo	modified readme	Nov 9, 2023

Repository files navigation

MedMini

Runs within < 3GB RAM | 0 vRAM

Inference Time < 3 sec

A Lightweight architecture for an Answering System on medical data based on LLMs, designed to run on edge devices.

Entirely on-device processing

Model Size on Disk: 500 + 250 MB

Installation Instructions

Quickstart - Docker Memory Heavy

Download the docker-run.sh file from the repository
sudo chmod +x docker-run.sh
sudo ./docker-run.sh

Uninstalling
- sudo docker image rm medmini

Raw Install Best Performance

git clone https://github.com/sarthakchittawar/Medmini.git
sudo chmod +x install.sh ; ./install.sh
sudo chmod +x run.sh ; ./run.sh
Need to have a ubuntu>=22.04 or debian>=12 based distro

Future work

Improve the RAG algorithm without compromising on efficiency