Skip to content

Latest commit

 

History

History
71 lines (45 loc) · 2.72 KB

novitaai.md

File metadata and controls

71 lines (45 loc) · 2.72 KB

Novita AI

Novita AI is a platform that provides a comprehensive suite of APIs for various artificial intelligence applications. It offers over 100 APIs, including image generation and editing with access to thousands of models, as well as training APIs for building custom models. Novita AI aims to simplify the process of integrating AI into various products and services, eliminating the need for expensive GPUs and complex infrastructure. It provides a cost-effective and user-friendly solution for developers and businesses to leverage AI capabilities for their specific needs.

Interface Name

  • novitaai

Example Usage

const { LLMInterface } = require('llm-interface');

LLMInterface.setApiKey({'novitaai': process.env.NOVITAAI_API_KEY});

async function main() {
  try {
    const response = await LLMInterface.sendMessage('novitaai', 'Explain the importance of low latency LLMs.');
    console.log(response.results);
  } catch (error) {
    console.error(error);
    throw error;
  }
}

main();

Model Aliases

The following model aliases are provided for this provider.

  • default: meta-llama/llama-3-8b-instruct
  • large: meta-llama/llama-3-70b-instruct
  • small: meta-llama/llama-3-8b-instruct
  • agent: meta-llama/llama-3-70b-instruct

Options

The following parameters can be passed through options.

  • frequency_penalty: Details not available, please refer to the LLM provider documentation.
  • logit_bias: Details not available, please refer to the LLM provider documentation.
  • max_tokens: Details not available, please refer to the LLM provider documentation.
  • n: Details not available, please refer to the LLM provider documentation.
  • presence_penalty: Details not available, please refer to the LLM provider documentation.
  • repetition_penalty: Details not available, please refer to the LLM provider documentation.
  • stop: Details not available, please refer to the LLM provider documentation.
  • stream: Details not available, please refer to the LLM provider documentation.
  • temperature: Details not available, please refer to the LLM provider documentation.
  • top_p: Details not available, please refer to the LLM provider documentation.

Features

  • Streaming

Getting an API Key

Commercial with Free Trial: The Novita AI API is a commercial product but offers $0.50 of free credit to get started.

To get an API key, first create a Novita AI account, then visit the link below.

Novita AI Documentation

Novita AI documentation is available here.