Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added docs/assets/architecture.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
35 changes: 35 additions & 0 deletions docs/en/overview/architecture.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---
title: Architecture
weight: 10
---

The diagram below illustrates the architecture of the Alauda AI platform.

![architecture](../../assets/architecture.png)

NOTE: Alauda AI uses some general Kubernetes, ACP components including:

* ALB
* Erebus
* kube-apiserver (kubernetes component)


| Component | Description | Type | License |
| --- | --- | --- | --- |
| Lich | Alauda AI UI console | Self-developed | |
| aml-operator | Manages installation and life cycles of Alauda AI components | Self-developed | |
| aml-apiserver | Extends kubernetes api-server and provide authorization enhancements for Alauda AI API access | Self-developed | |
| skipper & oauth2-proxy | Proxies traffic from the global cluster to workload clusters. Traffic is authenticated by oauth2-proxy | Open source | Apache Version 2.0 |
| aml-controller | Manages Alauda AI namespaces on workload clusters. Namespaces will be automatically configured a Model Repo space and corresponding resources. | Self-developed | |
| aml-api-deploy | Provides high-level APIs for "Lich" | Self-developed | |
| Gitlab (with Minio or S3) | Model repository backend storage and version tracking. | Open source | MIT |
| kserve-controller | (Optionally with knative serving and istio enabled) Manages AI inference services and inference service runtimes. | Open source | Apache Version 2.0 |
| workspace-controller | Manages workbench instances (jupyter notebooks, codeserver) | Open source | Apache Version 2.0 |
| Volcano | Plugin to provide co-scheduling (gang-scheduling) features for AI training jobs. Also manages "volcanojob" resource to run general training workloads. | Open source | Apache Version 2.0 |
| MLFlow | Track training, evaluation jobs by storing, visualizing metrics and artifacts | Open source | Apache Version 2.0 |
| Fine Tuning | Experimental UI providing no-code LLM fine tunning job creation and management | Self-developed | |
| Kubeflow | Open source plugin providing MLOps features including: Notebooks, Tensorboard, Kubeflow pipeline, training operator. | Open source | Apache Version 2.0 |
| Label Studio | Open source plugin for dataset labeling | Open source | Apache Version 2.0 |
| Dify | Open source plugin for creating LLM Agents, RAG applications using a web UI | Open source | ```<br>a modified version of the Apache License 2.0<br>``` |
| Evidently | Open source plugin for monitoring online inference service performance and data drifts | Open source | Apache Version 2.0 |
| GPU device plugins | HAMi and nvidia gpu device plugin | Open source | Apache Version 2.0 |