togetherai.md

Together AI

Together is an AI company that develops large language models (LLMs). It provides various platforms and models, such as OpenChatKit, RedPajama, and GPT-JT, to empower developers and researchers in the field of natural language processing (NLP). Together's focus is on open-source AI research and infrastructure, enabling collaboration and innovation in the rapidly growing AI landscape.

Interface Name

• togetherai

Example Usage

const { LLMInterface } = require('llm-interface');

LLMInterface.setApiKey({'togetherai': process.env.TOGETHERAI_API_KEY});

async function main() {
  try {
    const response = await LLMInterface.sendMessage('togetherai', 'Explain the importance of low latency LLMs.');
    console.log(response.results);
  } catch (error) {
    console.error(error);
    throw error;
  }
}

main();

Model Aliases

The following model aliases are provided for this provider.

• default: google/gemma-7b
• large: mistralai/Mixtral-8x22B
• small: google/gemma-2b
• agent: Qwen/Qwen1.5-14B

Embeddings Model Aliases

• default: bert-base-uncased
• large: BAAI/bge-large-en-v1.5
• small: BAAI/bge-base-en-v1.5

Options

The following parameters can be passed through options.

• max_tokens: Details not available, please refer to the LLM provider documentation.
• response_format: Details not available, please refer to the LLM provider documentation.
• stream: Details not available, please refer to the LLM provider documentation.
• temperature: Details not available, please refer to the LLM provider documentation.
• tool_choice: Details not available, please refer to the LLM provider documentation.
• tools: Details not available, please refer to the LLM provider documentation.

Features

• Native JSON Mode
• Streaming
• Tools
• Embeddings

Getting an API Key

Commercial with Free Trial: The Together AI API is a commercial product but offers a $5.00 credit to get started. No credit card is required initially.

To get an API key, first create a Together AI account, then visit the link below.

• https://api.together.xyz/settings/api-keys

Together AI Documentation

Together AI documentation is available here.