Deploy a chatbot with Huggingface Inference API

This repository contains the code to deploy a Mistral-based chatbot using Docker Compose and Huggingface Inference API.

Technological stack

As shown in the figure below the following frameworks have been used in this project:

git clone https://github.com/robertanto/local-chatbot-ui.git
cd local-chatbot-ui

Create a Huggingface API token as shown here and insert it in the docker-compose.yaml file.
Run the containers

docker compose up -d

You can interact with the chatbot at http://localhost:7860/.

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
GradioUI		GradioUI
HFInferenceAPI		HFInferenceAPI
assets		assets
.gitignore		.gitignore
README.md		README.md
docker-compose.yaml		docker-compose.yaml