Architecture

Overview

Embabel LLM Database is a REST repository for storing and retrieving model information. The primary sources for the repository include the llm-stats.com Github Repository and the AWS Bedrock Model API

Components

Embabel LLM Core

• core libraries and domain model

Embabel LLM Agent

• Embabel Agent responsible for loading and maintaining the repository
• Agent validates the need to update the registry and handles parsing of different sources
• Agent does not use an LLM itself for parsing*

Embabel LLM Server

• Embabel Repository based on REST API principles
• Due to the slow rate of change, uses a filesystem persistent store (JSON format)
• Limited API exposure for model access and searching

*may change in the future