index.md

LLM Interface Documentation

Welcome to the documentation for the LLM Interface package. This documentation provides comprehensive guides on how to set up, configure, and use the LLM Interface with various Language Model providers.

Table of Contents

• Introduction
• Installation
• API Keys
• Usage
  • LLMInterface
    • getAllModelNames()
    • getEmbeddingsModelAlias(interfaceName, alias)
    • getInterfaceConfigValue(interfaceName, key)
    • getModelAlias(interfaceName, alias)
    • setApiKey(interfaceNames, apiKey)
    • setEmbeddingsModelAlias(interfaceName, alias, name)
    • setModelAlias(interfaceName, alias, name)
    • configureCache(cacheConfig = {})
    • flushCache()
    • sendMessage(interfaceName, message, options = {}, interfaceOptions = {})
    • streamMessage(interfaceName, message, options = {})
    • embeddings(interfaceName, embeddingString, options = {}, interfaceOptions = {})
    • chat.completions.create(interfaceName, message, options = {}, interfaceOptions = {})
  • LLMInterfaceSendMessage
    • LLMInterfaceSendMessage(interfaceName, apiKey, message, options = {}, interfaceOptions = {})
  • LLMInterfaceStreamMessage
    • LLMInterfaceStreamMessage(interfaceName, apiKey, message, options = {})
  • Message Object
    • Structure of a Message Object
  • Options Object
    • Structure of an Options Object
  • Interface Options Object
    • Structure of an Interface Options Object
  • Caching
    • Simple Cache
      • Example Usage
    • Flat Cache
      • Installation
      • Example Usage
    • Cache Manager
      • Installation
      • Example Usage
      • Advanced Backends
        • Redis
        • Memcached
        • MongoDB
    • Memory Cache
      • Example Usage
  • Support
  • Model Aliases
  • Embeddings Model Aliases
  • Jailbreaking
  • Glossary
  • Examples

Introduction

The LLM Interface npm module provides a unified interface for interacting with various large language models (LLMs). This documentation covers setup, configuration, usage, and examples to help you integrate LLMs into your projects efficiently.

Installation

API Keys

To interact with different LLM providers, you will need API keys. Refer to API Keys for detailed instructions on obtaining and configuring API keys for supported providers.

Usage

The Usage section contains detailed documentation on how to use the LLM Interface npm module. This includes:

LLMInterface

• getAllModelNames()
• getEmbeddingsModelAlias(interfaceName, alias)
• getInterfaceConfigValue(interfaceName, key)
• getModelAlias(interfaceName, alias)
• setApiKey(interfaceNames, apiKey)
• setEmbeddingsModelAlias(interfaceName, alias, name)
• setModelAlias(interfaceName, alias, name)
• configureCache(cacheConfig = {})
• flushCache()
• sendMessage(interfaceName, message, options = {}, interfaceOptions = {})
• streamMessage(interfaceName, message, options = {})
• embeddings(interfaceName, embeddingString, options = {}, interfaceOptions = {})
• chat.completions.create(interfaceName, message, options = {}, interfaceOptions = {})

LLMInterfaceSendMessage

• LLMInterfaceSendMessage(interfaceName, apiKey, message, options = {}, interfaceOptions = {})

This is a legacy function and will be depreciated.

LLMInterfaceStreamMessage

• LLMInterfaceStreamMessage(interfaceName, apiKey, message, options = {})

This is a legacy function and will be depreciated.

Message Object

• Structure of a Message Object

Options Object

• Structure of an Options Object

Interface Options Object

• Structure of an Interface Options Object

Caching

• Simple Cache
  • Example Usage
• Flat Cache
  • Installation
  • Example Usage
• Cache Manager
  • Installation
  • Example Usage
  • Advanced Backends
    • Redis
    • Memcached
    • MongoDB
• Memory Cache
  • Example Usage

Support

A complete list of supported providers is availabe here.

Model Aliases

The LLMInterface supports multiple model aliases for different providers. See Models for a list of model aliases and their descriptions.

For more detailed information, please refer to the respective sections in the documentation.

Jailbreaking

If you'd like to attempt to jailbreak your AI model you try a version of the message obeject found here.

Thanks to Shuttle AI for the original concept!

Glossary

A glossary of terms is available here.

Examples

Check out Examples for practical demonstrations of how to use the LLM Interface npm module in various scenarios.