Skip to content

feat: add support for NVIDIA NIM provider in LLM system#820

Open
Aaryan Bansal (NotUnHackable) wants to merge 1 commit intobrowseros-ai:devfrom
NotUnHackable:feature/nvidia-nim-support
Open

feat: add support for NVIDIA NIM provider in LLM system#820
Aaryan Bansal (NotUnHackable) wants to merge 1 commit intobrowseros-ai:devfrom
NotUnHackable:feature/nvidia-nim-support

Conversation

@NotUnHackable
Copy link
Copy Markdown

@NotUnHackable Aaryan Bansal (NotUnHackable) commented Apr 26, 2026

Add NVIDIA NIM AI API Support
Summary
Adds support for NVIDIA NIM (NVIDIA Inference Microservices) as a new LLM provider in BrowserOS.
Changes
Files modified:

  • packages/shared/src/schemas/llm.ts - Added nvidia-nim provider constant and schema
  • packages/shared/src/constants/urls.ts - Added NVIDIA NIM API endpoint
  • apps/agent/lib/llm-providers/types.ts - Added nvidia-nim to ProviderType
  • apps/agent/lib/llm-providers/providerTemplates.ts - Added NVIDIA NIM template
  • apps/agent/lib/llm-providers/providerIcons.tsx - Added icon mapping
  • apps/server/src/lib/clients/llm/provider.ts - Added provider factory
  • apps/server/src/agent/provider-factory.ts - Added agent factory
    Usage
  • Default Base URL: https://integrate.api.nvidia.com/v1
  • Default Model: nvidia/llama-3.1-nemotron-nano-8b-instruct
  • API Keys: Get at https://build.nvidia.com/settings/api-keys
  • Docs: https://docs.nvidia.com/nim/
    Notes
  • Uses OpenAI-compatible API (via @ai-sdk/openai-compatible)
  • Free tier: 1,000 inference credits on signup (40 RPM rate limit)
  • Supports 100+ models including Nemotron, Kimi, MiniMax, GLM

Copilot AI review requested due to automatic review settings April 26, 2026 17:13
@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps Bot commented Apr 26, 2026

PR author is not in the allowed authors list.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 26, 2026

All contributors have signed the CLA. Thank you!
Posted by the CLA Assistant Lite bot.

@NotUnHackable
Copy link
Copy Markdown
Author

I have read the CLA Document and I hereby sign the CLA

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants