New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update TensorRT-LLM #1918

Merged

kaiyux merged 1 commit into main from preview/main

Jul 9, 2024

Member

kaiyux commented Jul 9, 2024 •

edited

Loading

Model Support
- Added LLaVa-1.6 (LLaVa-NeXT) multimodal support, see “LLaVA, LLaVa-NeXT and VILA” section in examples/multimodal/README.md.
Features
- Supported Starcoder2 SmoothQuant. (smoothquant on starcoder2 #1886)


          open source d5f5542d2f1e10c4a6b60be56838ac79a9668665

88edb1f

Shixiaowei02 approved these changes

View reviewed changes

kaiyux merged commit a96ccca into main

kaiyux deleted the preview/main branch

July 9, 2024 06:42

littletomatodonkey commented Jul 11, 2024

I feel like you never considered backward compatibility during development; the code interface changes too frequently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet