diff --git a/docs/assets/architecture.png b/docs/assets/architecture.png new file mode 100644 index 0000000..76efee7 Binary files /dev/null and b/docs/assets/architecture.png differ diff --git a/docs/en/overview/architecture.mdx b/docs/en/overview/architecture.mdx new file mode 100644 index 0000000..59c759d --- /dev/null +++ b/docs/en/overview/architecture.mdx @@ -0,0 +1,35 @@ +--- +title: Architecture +weight: 10 +--- + +The diagram below illustrates the architecture of the Alauda AI platform. + +![architecture](../../assets/architecture.png) + +NOTE: Alauda AI uses some general Kubernetes, ACP components including: + +* ALB +* Erebus +* kube-apiserver (kubernetes component) + + +| Component | Description | Type | License | +| --- | --- | --- | --- | +| Lich | Alauda AI UI console | Self-developed | | +| aml-operator | Manages installation and life cycles of Alauda AI components | Self-developed | | +| aml-apiserver | Extends kubernetes api-server and provide authorization enhancements for Alauda AI API access | Self-developed | | +| skipper & oauth2-proxy | Proxies traffic from the global cluster to workload clusters. Traffic is authenticated by oauth2-proxy | Open source | Apache Version 2.0 | +| aml-controller | Manages Alauda AI namespaces on workload clusters. Namespaces will be automatically configured a Model Repo space and corresponding resources. | Self-developed | | +| aml-api-deploy | Provides high-level APIs for "Lich" | Self-developed | | +| Gitlab (with Minio or S3) | Model repository backend storage and version tracking. | Open source | MIT | +| kserve-controller | (Optionally with knative serving and istio enabled) Manages AI inference services and inference service runtimes. | Open source | Apache Version 2.0 | +| workspace-controller | Manages workbench instances (jupyter notebooks, codeserver) | Open source | Apache Version 2.0 | +| Volcano | Plugin to provide co-scheduling (gang-scheduling) features for AI training jobs. Also manages "volcanojob" resource to run general training workloads. | Open source | Apache Version 2.0 | +| MLFlow | Track training, evaluation jobs by storing, visualizing metrics and artifacts | Open source | Apache Version 2.0 | +| Fine Tuning | Experimental UI providing no-code LLM fine tunning job creation and management | Self-developed | | +| Kubeflow | Open source plugin providing MLOps features including: Notebooks, Tensorboard, Kubeflow pipeline, training operator. | Open source | Apache Version 2.0 | +| Label Studio | Open source plugin for dataset labeling | Open source | Apache Version 2.0 | +| Dify | Open source plugin for creating LLM Agents, RAG applications using a web UI | Open source | ```
a modified version of the Apache License 2.0
``` | +| Evidently | Open source plugin for monitoring online inference service performance and data drifts | Open source | Apache Version 2.0 | +| GPU device plugins | HAMi and nvidia gpu device plugin | Open source | Apache Version 2.0 | \ No newline at end of file