Skip to content

Latest commit

 

History

History
72 lines (43 loc) · 2.42 KB

cloudflareai.md

File metadata and controls

72 lines (43 loc) · 2.42 KB

Cloudflare AI

Cloudflare AI

Cloudflare, Inc. is a leading web performance and security company that offers a range of services to enhance website speed, reliability, and protection. Their Cloudflare AI platform focuses on leveraging artificial intelligence and machine learning to optimize content delivery, mitigate threats, and improve user experiences. Cloudflare AI's capabilities include content-based asset creation, intelligent routing, automated threat detection, and personalized content recommendations, all aimed at making the internet faster, safer, and more efficient for businesses and users alike.

Interface Name

  • cloudflareai

Example Usage

const { LLMInterface } = require('llm-interface');

LLMInterface.setApiKey({'cloudflareai': [process.env.CLOUDFLAREAI_ACCOUNT_ID]});

async function main() {
  try {
    const response = await LLMInterface.sendMessage('cloudflareai', 'Explain the importance of low latency LLMs.');
    console.log(response.results);
  } catch (error) {
    console.error(error);
    throw error;
  }
}

main();

Model Aliases

The following model aliases are provided for this provider.

  • default: @cf/meta/llama-3-8b-instruct
  • large: @hf/thebloke/llama-2-13b-chat-awq
  • small: @cf/tinyllama/tinyllama-1.1b-chat-v1.0
  • agent: @cf/meta/llama-3-8b-instruct

Embeddings Model Aliases

  • default: @cf/baai/bge-base-en-v1.5
  • large: @cf/baai/bge-large-en-v1.5
  • small: @cf/baai/bge-small-en-v1.5

Options

The following parameters can be passed through options.

  • max_tokens: Details not available, please refer to the LLM provider documentation.
  • temperature: Details not available, please refer to the LLM provider documentation.

Features

  • Functions
  • Embeddings

Getting an API Key

Free Tier Available: The Cloudflare AI API offers a free tier and commercial accounts. A credit card is not required for the free tier.

To get an API key, first create a Cloudflare AI account, then visit the link below.

Cloudflare AI Documentation

Cloudflare AI documentation is available here.