Skip to content
@xorbitsai

Xorbits

Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.
README.md

XorbitsAI

Xorbits makes it easy to scale ML and DS workloads, from data loading to preprocessing, tuning, training, and model serving.

Slack Twitter

  • xorbits: Scalable Python DS & ML, in an API compatible & lightning fast way.
  • xinference: a powerful and versatile library designed to serve language, speech recognition, and multimodal models.
  • xoscar: Python actor framework for heterogeneous computing.

Pinned Loading

  1. inference inference Public

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-re…

    Python 8.8k 766

  2. xllamacpp xllamacpp Public

    Forked from shakfu/cyllama

    xllamacpp - a Python wrapper of llama.cpp

    C++ 66 8

  3. inference-client inference-client Public

    Python 9 8

  4. xoscar xoscar Public

    Python actor framework for heterogeneous computing.

    Python 166 26

  5. xinference-helm-charts xinference-helm-charts Public

    Smarty 12 13

  6. xorbits xorbits Public

    Scalable Python DS & ML, in an API compatible & lightning fast way.

    Python 1.2k 70

Repositories

Showing 10 of 15 repositories
  • inference Public

    Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

    xorbitsai/inference’s past year of commit activity
    Python 8,778 Apache-2.0 766 138 (1 issue needs help) 33 Updated Nov 24, 2025
  • xllamacpp Public Forked from shakfu/cyllama

    xllamacpp - a Python wrapper of llama.cpp

    xorbitsai/xllamacpp’s past year of commit activity
    C++ 66 MIT 10 4 0 Updated Nov 19, 2025
  • xorbits Public

    Scalable Python DS & ML, in an API compatible & lightning fast way.

    xorbitsai/xorbits’s past year of commit activity
    Python 1,204 Apache-2.0 70 106 (10 issues need help) 13 Updated Nov 17, 2025
  • inference-client Public
    xorbitsai/inference-client’s past year of commit activity
    Python 9 Apache-2.0 8 0 0 Updated Nov 17, 2025
  • xinference-helm-charts Public
    xorbitsai/xinference-helm-charts’s past year of commit activity
    Smarty 12 Apache-2.0 13 0 0 Updated Nov 15, 2025
  • xoscar Public

    Python actor framework for heterogeneous computing.

    xorbitsai/xoscar’s past year of commit activity
    Python 166 Apache-2.0 26 16 5 Updated Oct 28, 2025
  • enterprise-docs Public

    Official enterprise version docs.

    xorbitsai/enterprise-docs’s past year of commit activity
    1 1 0 0 Updated Sep 26, 2025
  • doc-insights Public
    xorbitsai/doc-insights’s past year of commit activity
    Python 2 1 0 0 Updated Nov 25, 2023
  • Audits-Demo Public
    xorbitsai/Audits-Demo’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Nov 20, 2023
  • benchmarks Public

    Performance benchmarks that Xorbits vs other libraries.

    xorbitsai/benchmarks’s past year of commit activity
    Python 9 Apache-2.0 3 0 1 Updated Oct 20, 2023
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…