Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: create jupyter-lab deployment #18

Open
wants to merge 53 commits into
base: rh-main
Choose a base branch
from
Open

chore: create jupyter-lab deployment #18

wants to merge 53 commits into from

Conversation

ruromero
Copy link
Collaborator

No description provided.

ruromero and others added 30 commits December 12, 2024 21:25
@ruromero
chore(deps): add tekton and kustomize resources
5a060a7 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: add id and timestamps to output file
76ab83f 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: add http output plugin
7ef4977 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: log input file only for non http requests
f8acd5f 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore: deploy latest tag
c5b34f6 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore(deps): add nginx cache
f02499b 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
fix: depsdev url encoding in the golang packages
c87a41f 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: use pydantic default factory
da3ea4d 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
fix: dns was not properly being resolved
17cdaf2 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore(deps): add nim-llm and nim-embed deployments
5e93255 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat!: support zip artifact resources
6fabe33 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@zvigrinberg @ruromero
fix: configure local Llama 3-1-8b LLM to work with nginx
ac54749 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
refactor: parameterize openai_upstream from environment
ba4b0f8 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
fix: address required changes
2d26749 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: add instruction to deploy helm chart of nim-meta/llama3.1-8b
84e14ab 
chore: delete non-working nim-llm' manifest + patch

Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: add instructions to deploy llama-3.1-8b-instruct LLM
6802712 
refactor: use less confusing env name NGINX_UPSTREAM_OPENAI for self hosted LLM base url

Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@ruromero
feat: remove unnecessary stage
90b1b42 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@zvigrinberg @ruromero
feat: make VulnerableDependencyChecker facility pluggable
024b641 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>

fix: adjust description of new switch field

Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>

chore: change pipeline configuration  to disable usage of  dependency checker tool

Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
refactor: rename to use_dependency_checker
d28307b 
fix: add a field which was omitted by mistake from class
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: new general configuration setting - use_dependency_checker
e02c491 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ashsong-nv @ruromero
Update configs/schemas/config.schema.json
f73f200 
update the schema' new field addition to the auto-generated version.

Co-authored-by: Ashley Song <165685692+ashsong-nv@users.noreply.github.com>
@ruromero
fix: vulnerable_dependencies are expected in the dataFrame
c3a37a4 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@zvigrinberg @ruromero
fix: make broken 'openai' model type to work with the agent
64f15b2 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@ruromero
chore(deps): use shared nim and refactor kustomize resources
2b31095 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
fix: lock httpx dependency version and fix incompatibility with other…
cf04d4d 
… models

Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: implement plugin based intel retrieval
a0f0565 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@zvigrinberg @ruromero
fix: a little typo
162f664 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
feat: add new overlay of llama-3.1-70b-4bit
d6d1314 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
fix: only create openai_llm for openai model service type
f5f8ad6 
     and reference the service type of agent model in config

Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: point to agent-morpheus-models module to deploy self hosted LLMs
f3681de 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
zvigrinberg and others added 23 commits December 12, 2024 21:43
@zvigrinberg @ruromero
docs: add documentation to install helm chart of self hosted models
a1b7fb9 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
chore: change to remote submodule
c4efce9 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: fix link for installing LLMs and models helm chart
b78a865 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: refine the instruction to install chart
5c0fb62 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
fix: pointer of git submodule to latest one
45effa4 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
chore: fix LLM service name for upstream OPENAI
68ea029 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
docs: add instruction to force update to latest version of git submodule
8c2ddb6 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
refactor: use a single variable for both types of llm service objects
3026da2 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@IlonaShishov @ruromero
fix: ensure agent checks for vulnerable functions/methods if mentione…
4bed0c6 
…d in CVE
@zvigrinberg @ruromero
fix: agent crash when startuping pipeline
0f7e5d6 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@zvigrinberg @ruromero
fix: agent loop not working
80906d9 
Signed-off-by: Zvi Grinberg <zgrinber@redhat.com>
@ruromero
feat: remove local nim configuration in favor of the 7b config
808cc83 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore: update deployment instructions
0a6e9cc 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore: update deployment instructions
f227161 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
feat: do not retry for client exceptions
55dd0b1 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
fix: escape backslashes in intel descriptions
e136c12 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
Merge branch '4xx-retry-upstream' into rh-main
9548cd0
@ruromero
Merge branch 'parse-intel-upstream' into rh-main
bc19755
@vbelouso
fix: add ES module support to JavaScript parser
52f1490 
Signed-off-by: Vladimir Belousov <vbelouso@redhat.com>
@ruromero
chore: increase nginx cache pvc
efd6f2a 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
Merge pull request NVIDIA-AI-Blueprints#17 from vbelouso/js-fix
37e461f 
Add ES module support to JavaScript parser
@ruromero
feat: make retry_on_client_errors configurable
6a69faa 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero
chore: create jupyter-lab deployment
fe0eda9 
Signed-off-by: Ruben Romero Montes <rromerom@redhat.com>
@ruromero ruromero requested a review from zvigrinberg December 20, 2024 08:24
zvigrinberg
zvigrinberg approved these changes Dec 24, 2024
View reviewed changes
Copy link
Collaborator

@zvigrinberg zvigrinberg left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
tested on cluster and it works as expected - a jupyter lab is provisioned and accessible via route without password - good enough for tests and experimentation purposes.

@ruromero Before merging, let's discuss something when you're back.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zvigrinberg zvigrinberg zvigrinberg approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@ruromero @zvigrinberg @IlonaShishov @vbelouso