vllm 0.8.0

vllm 0.8.0

Deployed b194822 with MkDocs version: 1.6.1

upgrade vllm (#692)

Merge branch 'main' into dmchoi/vllm-0.6.6.post1

Deployed 2e65012 with MkDocs version: 1.6.1

Fix metric metadata handling (#691)

upgrade vllm

skip cov

Fix metric metadata handling

Deployed 358abbf with MkDocs version: 1.6.1

MLI-3627 Multinode SGLang runbook (#690)

lint

# Please enter the commit message for your changes. Lines starting #…

lint

update readme

nits

add files

fix gevent import order

Add imports

Update celery forwarder to use greenlets instead of processes

Update celery forwarder to use greenlets instead of processes

Update celery forwarder to use greenlets instead of processes

Deployed a33d5c2 with MkDocs version: 1.6.1

fix edge case where max_tokens is not provided in requests (#688)

fix edge case where max_tokens is not provided in requests