ai21.md

AI21 Studio

AI21 Studio is a platform developed by AI21 Labs that provides developers with access to powerful language models like jamba-instruct through APIs. These models enable various text generation and comprehension features for numerous applications. AI21 Studio emphasizes flexibility, allowing developers to fine-tune models for specific tasks, and cost-effectiveness, with its unique tokenization that offers more text per token compared to other providers. Their comprehensive suite includes tools for summarization, paraphrasing, grammar correction, and more, making it a valuable resource for developers seeking to integrate advanced language capabilities into their projects.

Interface Name

• ai21

Example Usage

const { LLMInterface } = require('llm-interface');

LLMInterface.setApiKey({'ai21': process.env.AI21_API_KEY});

async function main() {
  try {
    const response = await LLMInterface.sendMessage('ai21', 'Explain the importance of low latency LLMs.');
    console.log(response.results);
  } catch (error) {
    console.error(error);
    throw error;
  }
}

main();

Model Aliases

The following model aliases are provided for this provider.

• default: jamba-instruct
• large: jamba-instruct
• small: jamba-instruct
• agent: jamba-instruct

Embeddings Model Aliases

• Model aliases not provided. Please check the AI21 Studio documentation for more information.

Options

The following parameters can be passed through options.

• logprobs: Details not available, please refer to the LLM provider documentation.
• max_tokens: Details not available, please refer to the LLM provider documentation.
• n: Details not available, please refer to the LLM provider documentation.
• stop: Details not available, please refer to the LLM provider documentation.
• stream: Details not available, please refer to the LLM provider documentation.
• temperature: Details not available, please refer to the LLM provider documentation.
• top_logprobs: Details not available, please refer to the LLM provider documentation.
• top_p: Details not available, please refer to the LLM provider documentation.

Features

• Streaming
• Embeddings

Getting an API Key

Commercial with Free Trial: The AI21 API is a commercial product but offers a free trial with $90 in credits. No credit card is required initially.

To get an API key, first create an AI21 Studio account, then visit the link below.

• https://studio.ai21.com/account/api-key?source=docs

AI21 Studio Documentation

AI21 Studio documentation is available here.