Skip to content

Latest commit

 

History

History
73 lines (46 loc) · 2.61 KB

friendliai.md

File metadata and controls

73 lines (46 loc) · 2.61 KB

FriendliAI

FriendliAI

FriendliAI is a company focused on making generative AI accessible to all businesses. They provide efficient and scalable solutions for deploying and managing generative AI models, eliminating the complexities often associated with this technology. FriendliAI offers various products, such as Friendli Container, Friendli Dedicated Endpoints, and Friendli Serverless Endpoints, to cater to different needs and budgets. Their mission is to empower companies to innovate and achieve their goals through the effective use of generative AI.

Interface Name

  • friendliai

Example Usage

const { LLMInterface } = require('llm-interface');

LLMInterface.setApiKey({'friendliai': process.env.FRIENDLIAI_API_KEY});

async function main() {
  try {
    const response = await LLMInterface.sendMessage('friendliai', 'Explain the importance of low latency LLMs.');
    console.log(response.results);
  } catch (error) {
    console.error(error);
    throw error;
  }
}

main();

Model Aliases

The following model aliases are provided for this provider.

  • default: mixtral-8x7b-instruct-v0-1
  • large: meta-llama-3-70b-instruct
  • small: meta-llama-3-8b-instruct
  • agent: gemma-7b-it

Options

The following parameters can be passed through options.

  • frequency_penalty: Details not available, please refer to the LLM provider documentation.
  • max_tokens: Details not available, please refer to the LLM provider documentation.
  • n: Details not available, please refer to the LLM provider documentation.
  • presence_penalty: Details not available, please refer to the LLM provider documentation.
  • response_format: Details not available, please refer to the LLM provider documentation.
  • stop: Details not available, please refer to the LLM provider documentation.
  • stream: Details not available, please refer to the LLM provider documentation.
  • temperature: Details not available, please refer to the LLM provider documentation.
  • timeout_microseconds: Details not available, please refer to the LLM provider documentation.

Features

  • Native JSON Mode
  • Streaming

Getting an API Key

Commercial with Free Trial: The Friendli AI API is a commercial product but offers a $5.00 credit to get started.

To get an API key, first create a FriendliAI account, then visit the link below.

FriendliAI Documentation

FriendliAI documentation is available here.