Skip to content

Codegen/rag agents #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Codegen/rag agents #3

wants to merge 4 commits into from

Conversation

MSCetin37
Copy link
Owner

Description

The summary of the proposed changes as long as the relevant motivation and context.

Issues

List the issue or RFC link this PR is working on. If there is no such link, please mark it as n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

@MSCetin37 MSCetin37 force-pushed the codegen/rag_agents branch from 29aa189 to 2a52094 Compare March 25, 2025 19:14
@MSCetin37 MSCetin37 force-pushed the codegen/rag_agents branch 5 times, most recently from 586c97d to 5f6222d Compare April 4, 2025 23:35

#### Deploy CodeGen on Xeon

Find the corresponding [compose.yaml](./docker_compose/intel/cpu/xeon/compose.yaml). User could start CodeGen based on TGI or vLLM service:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should link Gaudi not Xeon

Copy link
Collaborator

@okhleif-IL okhleif-IL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Gaudi readme has all Xeon links, left comments on each

@MSCetin37 MSCetin37 force-pushed the codegen/rag_agents branch 8 times, most recently from 876c68b to 9a2d9cf Compare April 8, 2025 23:39
Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

update the env variables

Signed-off-by: Mustafa <[email protected]>

update compose.yaml

Signed-off-by: Mustafa <[email protected]>

compose.yaml updates

Signed-off-by: Mustafa <[email protected]>

update readme file

Signed-off-by: Mustafa <[email protected]>

update readme

Signed-off-by: Mustafa <[email protected]>

Gradio UI for CodeGen (#4)

* update the compose file

Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

added microservice ports

Signed-off-by: okhleif-IL <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

Initial commit for Gradio UI

Signed-off-by: okhleif-IL <[email protected]>

New UI

Signed-off-by: okhleif-IL <[email protected]>

prepare for merge

Signed-off-by: okhleif-IL <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

UI Updates

Signed-off-by: okhleif-IL <[email protected]>

added dockerfile

Signed-off-by: okhleif-IL <[email protected]>

removed files dataframe

Signed-off-by: okhleif-IL <[email protected]>

updated file upload

Signed-off-by: okhleif-IL <[email protected]>

added checkbox for agent

Signed-off-by: okhleif-IL <[email protected]>

key_index_name --> index_name

Signed-off-by: okhleif-IL <[email protected]>

added / removed print statements

Signed-off-by: okhleif-IL <[email protected]>

Support for data streaming (from Melanie)

Signed-off-by: okhleif-IL <[email protected]>

fixed file not supported bug

Signed-off-by: okhleif-IL <[email protected]>

added refresh button to index

Signed-off-by: okhleif-IL <[email protected]>

simplified README

Signed-off-by: okhleif-IL <[email protected]>

* updated readme and fixed merge

Signed-off-by: okhleif-IL <[email protected]>

* reverted changes

Signed-off-by: okhleif-IL <[email protected]>

---------

Signed-off-by: okhleif-IL <[email protected]>
Co-authored-by: Mustafa <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

update gaudi test and compose

Signed-off-by: Mustafa <[email protected]>

update gaudi test and compose

Signed-off-by: Mustafa <[email protected]>

update gaudi compose

Signed-off-by: Mustafa <[email protected]>

update readme

Signed-off-by: Mustafa <[email protected]>

update readme

Signed-off-by: Mustafa <[email protected]>

ui changes after rebase (#6)

* parent 580d33b
author Mustafa <[email protected]> 1739513513 -0800
committer Mustafa <[email protected]> 1743715605 -0700

parent 580d33b
author Mustafa <[email protected]> 1739513513 -0800
committer Mustafa <[email protected]> 1743714982 -0700

update the compose file

Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

update the env variables

Signed-off-by: Mustafa <[email protected]>

update compose.yaml

Signed-off-by: Mustafa <[email protected]>

compose.yaml updates

Signed-off-by: Mustafa <[email protected]>

update readme

Signed-off-by: Mustafa <[email protected]>

update the compose file

Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

added microservice ports

Signed-off-by: okhleif-IL <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

Initial commit for Gradio UI

Signed-off-by: okhleif-IL <[email protected]>

New UI

Signed-off-by: okhleif-IL <[email protected]>

prepare for merge

Signed-off-by: okhleif-IL <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

UI Updates

Signed-off-by: okhleif-IL <[email protected]>

added dockerfile

Signed-off-by: okhleif-IL <[email protected]>

removed files dataframe

Signed-off-by: okhleif-IL <[email protected]>

updated file upload

Signed-off-by: okhleif-IL <[email protected]>

added checkbox for agent

Signed-off-by: okhleif-IL <[email protected]>

key_index_name --> index_name

Signed-off-by: okhleif-IL <[email protected]>

added / removed print statements

Signed-off-by: okhleif-IL <[email protected]>

Support for data streaming (from Melanie)

Signed-off-by: okhleif-IL <[email protected]>

fixed file not supported bug

Signed-off-by: okhleif-IL <[email protected]>

added refresh button to index

Signed-off-by: okhleif-IL <[email protected]>

simplified README

Signed-off-by: okhleif-IL <[email protected]>

updated readme and fixed merge

Signed-off-by: okhleif-IL <[email protected]>

reverted changes

Signed-off-by: okhleif-IL <[email protected]>

bug fixes and ui updates

Signed-off-by: okhleif-IL <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

fixed output for index uses

Signed-off-by: okhleif-IL <[email protected]>

added services for gaudi

Signed-off-by: okhleif-IL <[email protected]>

update gaudi test and compose

Signed-off-by: Mustafa <[email protected]>

added error handling for exceeded token size

Signed-off-by: okhleif-IL <[email protected]>

update the compose file

Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

update the env variables

Signed-off-by: Mustafa <[email protected]>

update compose.yaml

Signed-off-by: Mustafa <[email protected]>

compose.yaml updates

Signed-off-by: Mustafa <[email protected]>

update readme file

Signed-off-by: Mustafa <[email protected]>

update readme

Signed-off-by: Mustafa <[email protected]>

Gradio UI for CodeGen (#4)

* update the compose file

Signed-off-by: Mustafa <[email protected]>

initial

Signed-off-by: Mustafa <[email protected]>

added microservice ports

Signed-off-by: okhleif-IL <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

update for codegen

Signed-off-by: Mustafa <[email protected]>

Initial commit for Gradio UI

Signed-off-by: okhleif-IL <[email protected]>

New UI

Signed-off-by: okhleif-IL <[email protected]>

prepare for merge

Signed-off-by: okhleif-IL <[email protected]>

add agents

Signed-off-by: Mustafa <[email protected]>

env updates

Signed-off-by: Mustafa <[email protected]>

update codegen

Signed-off-by: Mustafa <[email protected]>

merged to main

Signed-off-by: Mustafa <[email protected]>

updates

Signed-off-by: Mustafa <[email protected]>

UI Updates

Signed-off-by: okhleif-IL <[email protected]>

added dockerfile

Signed-off-by: okhleif-IL <[email protected]>

removed files dataframe

Signed-off-by: okhleif-IL <[email protected]>

updated file upload

Signed-off-by: okhleif-IL <[email protected]>

added checkbox for agent

Signed-off-by: okhleif-IL <[email protected]>

key_index_name --> index_name

Signed-off-by: okhleif-IL <[email protected]>

added / removed print statements

Signed-off-by: okhleif-IL <[email protected]>

Support for data streaming (from Melanie)

Signed-off-by: okhleif-IL <[email protected]>

fixed file not supported bug

Signed-off-by: okhleif-IL <[email protected]>

added refresh button to index

Signed-off-by: okhleif-IL <[email protected]>

simplified README

Signed-off-by: okhleif-IL <[email protected]>

* updated readme and fixed merge

Signed-off-by: okhleif-IL <[email protected]>

* reverted changes

Signed-off-by: okhleif-IL <[email protected]>

---------

Signed-off-by: okhleif-IL <[email protected]>
Co-authored-by: Mustafa <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

add cpu xeon test

Signed-off-by: Mustafa <[email protected]>

codegen code cleaning

Signed-off-by: Mustafa <[email protected]>

xeon --> gaudi

Signed-off-by: okhleif-IL <[email protected]>

made tests like codegen ragagents branch

Signed-off-by: okhleif-IL <[email protected]>

added back \n

Signed-off-by: okhleif-IL <[email protected]>

* code updates

Signed-off-by: Mustafa <[email protected]>

---------

Signed-off-by: okhleif-IL <[email protected]>
Signed-off-by: Mustafa <[email protected]>

code udates for test-xeon

Signed-off-by: Mustafa <[email protected]>

update test files for gauidi

Signed-off-by: Mustafa <[email protected]>

Documentation Updates, Screenshots and Improvements (#7)

* Improved README and added information

Signed-off-by: okhleif-IL <[email protected]>

* removed stray $

Signed-off-by: okhleif-IL <[email protected]>

* renamed dummy file names

Signed-off-by: okhleif-IL <[email protected]>

* codegen_ui_gradio.py comment + print cleanup

Signed-off-by: okhleif-IL <[email protected]>

---------

Signed-off-by: okhleif-IL <[email protected]>

update README file

Signed-off-by: Mustafa <[email protected]>

update README file

Signed-off-by: Mustafa <[email protected]>

updates readme files

Signed-off-by: Mustafa <[email protected]>

add images

Signed-off-by: Mustafa <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

update README file

Signed-off-by: Mustafa <[email protected]>

update the test files

Signed-off-by: Mustafa <[email protected]>

update the test files

Signed-off-by: Mustafa <[email protected]>

update the test files

Signed-off-by: Mustafa <[email protected]>

update the test files - add services

Signed-off-by: Mustafa <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

update test-gaudi

Signed-off-by: Mustafa <[email protected]>

update test-gaudi

Signed-off-by: Mustafa <[email protected]>

update test files

Signed-off-by: Mustafa <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

update build.yaml

Signed-off-by: Mustafa <[email protected]>

update tests

Signed-off-by: Mustafa <[email protected]>

update tests

Signed-off-by: Mustafa <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

update test-files

Signed-off-by: Mustafa <[email protected]>

[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci
@MSCetin37 MSCetin37 force-pushed the codegen/rag_agents branch from 16cf76b to e0929cb Compare April 9, 2025 06:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants