Skip to content

Latest commit

 

History

History

litellm

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
dev
dev
 
 
src
src
 
 
.eslintrc.js
.eslintrc.js
 
 
README.md
README.md
 
 
config.d.ts
config.d.ts
 
 
package.json
package.json
 
 

README.md

LiteLLM Plugin for Backstage

This plugin integrates LiteLLM key management functionality into your Backstage instance, allowing users to generate and manage API keys for LiteLLM services directly from the Backstage UI.

https://youtu.be/V9RXk5SJcCo

image

Requirements

  • LiteLLM instance
  • Backstage instance with microsoft auth provider configured.

Features

  • Generate LiteLLM API keys with custom names
  • Team and budget verification
  • Instant code samples for different programming languages
  • Automatic user creation in LiteLLM (using Azure Active Directory email format as the user_id)

Installation

From your Backstage root directory:

yarn add --cwd packages/app @litellm/plugin-litellm

Configuration

Add the following to your app-config.yaml:

app:
  litellm:
    baseUrl: 'https://your-litellm-instance.com' # URL to your LiteLLM instance
    adminKey: 'your-organization-api-key' # Your LiteLLM admin/organization API key
    teamId: 'your-team-id' # Your LiteLLM team ID
    budgetId: 'your-budget-id' # Your LiteLLM budget ID
    maxBudgetPerUser: 5 # Maximum budget per user

Adding to your Backstage application

Add the plugin to your app

Add the LiteLLM page to your Backstage application by modifying your packages/app/src/App.tsx file:

import { LitellmPage } from '@litellm/plugin-litellm';

// Inside your App component's route definitions:
<Route path="/litellm" element={<LitellmPage />} />

Add a navigation item (optional)

Modify your packages/app/src/components/Root/Root.tsx to add a navigation item:

import SmartToyIcon from '@material-ui/icons/Train';

// Inside your sidebar items:
<SidebarItem icon={SmartToyIcon} to="litellm" text="LiteLLM Keys" />

Usage

Once installed and configured, users can:

  1. Navigate to the LiteLLM page
  2. Enter a name for their API key
  3. Generate a key
  4. Use provided code samples to integrate with their applications

License

Apache-2.0

Additional Resources