Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 0 additions & 56 deletions .github/workflows/build-devmode.yaml

This file was deleted.

11 changes: 0 additions & 11 deletions .github/workflows/platform-release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -37,17 +37,6 @@ jobs:
- name: Checkout
uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1

## install build dependencies for frontend generation
- name: Install Node.js
uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7.0.0
with:
node-version-file: './frontend/dev-mode/.nvmrc'

- name: Install pnpm
uses: pnpm/action-setup@ea17c68df8912ef543352723c149a84f56e3d413 # v6.1.0
with:
package_json_file: './docs/package.json'

- name: Setup Go
uses: actions/setup-go@b7ad1dad31e06c5925ef5d2fc7ad053ef454303e # v7.0.0
with:
Expand Down
5 changes: 0 additions & 5 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,3 @@
kit
kit.exe
dist/
pkg/lib/harness/generated/downloads/
pkg/lib/harness/ui.tar.gz
pkg/lib/harness/llamafile
pkg/lib/harness/checksums.txt
pkg/lib/harness/llamafile.tar.gz
15 changes: 1 addition & 14 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -106,17 +106,6 @@ go test ./pkg/cmd/pack -v
go install .
```

### Frontend Dev Mode UI

```bash
cd frontend/dev-mode
pnpm install
pnpm dev # Development server
pnpm build # Production build
pnpm type-check # TypeScript checking
pnpm lint # ESLint with auto-fix
```

### Documentation Site

```bash
Expand All @@ -136,7 +125,6 @@ pnpm docs:preview # Preview built docs
- **Libraries**: Core functionality in `pkg/lib/`:
- `kitfile/`: Kitfile manifest parsing, validation, and generation
- `repo/local/` & `repo/remote/`: Repository management for local storage and OCI registries
- `harness/`: LLM integration with llamafile for local inference
- `filesystem/`: File operations, caching, and ignore patterns
- `network/`: Authentication and network operations

Expand All @@ -146,9 +134,8 @@ pnpm docs:preview # Preview built docs
- **Kitfile**: YAML manifest format defining ModelKit contents (spec in `pkg/artifact/kitfile.md`)
- **Repository Management**: Uses OCI layout for local storage, compatible with container registries

### Frontend Components
### Documentation

- **Dev Mode UI**: Vue 3 + TypeScript SPA for local LLM interaction in `frontend/dev-mode/`
- **Documentation**: VitePress-based site in `docs/` with comprehensive guides and API reference

### CLI Command Pattern
Expand Down
6 changes: 0 additions & 6 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,12 +55,6 @@ If you think there's something else you can help with please contact us in the [
go mod tidy
```

1. Generate the dev mode harness and ui

```shell
go generate ./...
```

1. Build the Kit CLI: Compile the source code into an executable named kit:

```shell
Expand Down
2 changes: 0 additions & 2 deletions cmd/root.go
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,6 @@ import (
"os"
"path/filepath"

"github.com/kitops-ml/kitops/pkg/cmd/dev"
"github.com/kitops-ml/kitops/pkg/cmd/diff"
"github.com/kitops-ml/kitops/pkg/cmd/info"
"github.com/kitops-ml/kitops/pkg/cmd/inspect"
Expand Down Expand Up @@ -163,7 +162,6 @@ func addSubcommands(rootCmd *cobra.Command) {
rootCmd.AddCommand(login.LoginCommand())
rootCmd.AddCommand(logout.LogoutCommand())
rootCmd.AddCommand(version.VersionCommand())
rootCmd.AddCommand(dev.DevCommand())
rootCmd.AddCommand(kitinit.InitCommand())
rootCmd.AddCommand(diff.DiffCommand())
rootCmd.AddCommand(kitimport.ImportCommand())
Expand Down
54 changes: 5 additions & 49 deletions docs/src/docs/deploy.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,11 @@
---
title: Deploying AI with KitOps - Kubernetes, Containers, and Local LLMs
description: Learn how to securely deploy AI/ML models to Kubernetes, container runtimes, or run LLMs. Includes init containers, custom Dockerfiles, and dev workflows.
keywords: deploy modelkit, kitops deployment, run ml model in kubernetes, init container ml model, containerized ai model, kitops docker, run llm locally, gguf llm deploy, kit dev start, oci model deployment, ml model runtime, mlops deployment cli, modelpack
title: Deploying AI with KitOps - Kubernetes and Containers
description: Learn how to securely deploy AI/ML models to Kubernetes or other container runtimes. Includes init containers and custom Dockerfiles.
keywords: deploy modelkit, kitops deployment, run ml model in kubernetes, init container ml model, containerized ai model, kitops docker, oci model deployment, ml model runtime, mlops deployment cli, modelpack
---
# Deploying KitOps ModelKits

This page outlines how to deploy models stored in KitOps ModelKits either:
1. To [Kubernetes or other shared container runtimes](#deploying-to-kubernetes-or-containers) (compatible with all model types)
1. To [run an LLM locally](#running-llms-locally) (using `kit dev`)
This page outlines how to deploy models stored in KitOps ModelKits to [Kubernetes or other shared container runtimes](#deploying-to-kubernetes-or-containers) (compatible with all model types).

## Deploying to Kubernetes or Containers

Expand Down Expand Up @@ -122,49 +120,7 @@ Example `dockerfile` for a custom container that has `my-modelkit` built into it

**Questions or suggestions?** Drop an [issue in our GitHub repository](https://github.com/kitops-ml/kitops/issues) or join [our Discord server](https://discord.gg/Tapeh8agYy) to get support or share your feedback.

## Running LLMs Locally

If you're using Kit with LLMs you can quickly run the model locally to speed integration, testing, or experimentation.

::: tip
Kit dev currently only works with `GGUF` serialized models, if you'd like to expand its support for other types please create a [feature issue](https://github.com/kitops-ml/kitops/issues) and describe your planned approach.
:::

To run the ModelKit locally, first create a new directory for your LLM:

```sh
mkdir kitdev
cd kitdev
```

Now unpack an LLM ModelKit - there are several on [Jozu Hub](https://jozu.ml/discover), but here we're using Phi3 Mini because of its size:


```sh
kit unpack jozu.ml/jozu/phi3:3.8b-mini-instruct-4k-q4_K_M
```

Now start your LLM dev server locally using the [kit dev start command](../cli/cli-reference/#kit-dev-start):

```sh
kit dev start .
```

In the command output you'll see a URL you can use to interact with the LLM (there's a command flag to always use the same port). You can control parameters of the model, change the prompt, or chat with the LLM.

If you need to get logs use the [dev logs command](../cli/cli-reference/#kit-dev-logs):

```sh
kit dev logs
```

When you're done don't forget to stop the Kit dev server:

```sh
kit dev stop
```

---

**Have feedback or questions?**
Open an [issue on GitHub](https://github.com/kitops-ml/kitops/issues) or [join us on Discord](https://discord.gg/Tapeh8agYy).
Open an [issue on GitHub](https://github.com/kitops-ml/kitops/issues) or [join us on Discord](https://discord.gg/Tapeh8agYy).
2 changes: 0 additions & 2 deletions docs/src/docs/kitfile/kf-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -169,5 +169,3 @@ docs:
---

**Questions or suggestions?** Drop an [issue in our GitHub repository](https://github.com/kitops-ml/kitops/issues) or join [our Discord server](https://discord.gg/Tapeh8agYy) to get support or share your feedback.

<!-- AGENT_MODIFIED: Human review required before merge -->
2 changes: 0 additions & 2 deletions docs/src/docs/next-steps.md
Original file line number Diff line number Diff line change
Expand Up @@ -395,6 +395,4 @@ mymodel champion Rajat Finetuning_SLM 13.1 MiB sha256:f268a74f

You can learn more about all the Kit CLI commands from our [command reference doc](../cli/cli-reference/).

To learn about how to run an LLM locally using Kit, see our [Kit Dev](../deploy/#running-llms-locally) documentation.

Thanks for taking some time to play with Kit. We'd love to hear what you think. Feel free to drop us an [issue in our GitHub repository](https://github.com/kitops-ml/kitops/issues) or join [our Discord server](https://discord.gg/Tapeh8agYy).
5 changes: 0 additions & 5 deletions frontend/dev-mode/.editorconfig

This file was deleted.

63 changes: 0 additions & 63 deletions frontend/dev-mode/.eslintrc.cjs

This file was deleted.

30 changes: 0 additions & 30 deletions frontend/dev-mode/.gitignore

This file was deleted.

1 change: 0 additions & 1 deletion frontend/dev-mode/.nvmrc

This file was deleted.

26 changes: 0 additions & 26 deletions frontend/dev-mode/README.md

This file was deleted.

8 changes: 0 additions & 8 deletions frontend/dev-mode/env.d.ts

This file was deleted.

7 changes: 0 additions & 7 deletions frontend/dev-mode/global.d.ts

This file was deleted.

Loading
Loading