Files

 main

/

examples

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

kaiyux

Update TensorRT-LLM (NVIDIA#2873)

Mar 11, 2025

9b931c0 · Mar 11, 2025

History

History

This branch is 52 commits behind NVIDIA/TensorRT-LLM:main.

/

examples

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
apps		apps	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
arctic		arctic	Update TensorRT-LLM (NVIDIA#1793)	Jun 18, 2024
auto_deploy		auto_deploy	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
baichuan		baichuan	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
bert		bert	Update TensorRT-LLM (NVIDIA#2582)	Dec 17, 2024
bindings/executor		bindings/executor	Update TensorRT-LLM (NVIDIA#2582)	Dec 17, 2024
blip2		blip2	Update TensorRT-LLM (NVIDIA#1168)	Feb 27, 2024
bloom		bloom	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
chatglm		chatglm	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
cogvlm		cogvlm	Update TensorRT-LLM (NVIDIA#2562)	Dec 11, 2024
commandr		commandr	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
cpp/executor		cpp/executor	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
cpp_library		cpp_library	Update TensorRT-LLM (NVIDIA#1274)	Mar 12, 2024
dbrx		dbrx	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
deepseek_v1		deepseek_v1	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
deepseek_v2		deepseek_v2	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
deepseek_v3		deepseek_v3	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
disaggregated		disaggregated	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
dit		dit	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
dora		dora	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
draft_target_model		draft_target_model	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
eagle		eagle	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
enc_dec		enc_dec	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
exaone		exaone	Update TensorRT-LLM (NVIDIA#2333)	Oct 15, 2024
falcon		falcon	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
gemma		gemma	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
gpt		gpt	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
gptj		gptj	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
gptneox		gptneox	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
granite		granite	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
grok		grok	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
infinitebench		infinitebench	Update TensorRT-LLM (NVIDIA#1725)	Jun 4, 2024
internlm		internlm	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
internlm2		internlm2	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
jais		jais	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
language_adapter		language_adapter	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
llama		llama	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
llm-api		llm-api	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
llm-eval/lm-eval-harness		llm-eval/lm-eval-harness	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
lookahead		lookahead	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
mamba		mamba	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
medusa		medusa	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
mixtral		mixtral	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
mllama		mllama	Update TensorRT-LLM (NVIDIA#2582)	Dec 17, 2024
mmdit		mmdit	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
model_api		model_api	Update TensorRT-LLM (NVIDIA#2502)	Nov 26, 2024
mpt		mpt	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
multimodal		multimodal	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
nemotron		nemotron	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
nemotron_nas		nemotron_nas	Update TensorRT-LLM (NVIDIA#2562)	Dec 11, 2024
openai_triton		openai_triton	Update TensorRT-LLM (NVIDIA#2792)	Feb 18, 2025
opt		opt	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
phi		phi	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
prompt_lookup		prompt_lookup	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
python_plugin		python_plugin	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
pytorch		pytorch	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
quantization		quantization	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
qwen		qwen	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
qwen2audio		qwen2audio	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
qwenvl		qwenvl	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
recurrentgemma		recurrentgemma	Fix .gitmodules (NVIDIA#2852)	Mar 4, 2025
redrafter		redrafter	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
sample_weight_stripping		sample_weight_stripping	Update TensorRT-LLM (NVIDIA#2008)	Jul 23, 2024
scaffolding		scaffolding	Update TensorRT-LLM (NVIDIA#2820)	Feb 25, 2025
sdxl		sdxl	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
skywork		skywork	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
smaug		smaug	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
stdit		stdit	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
whisper		whisper	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
constraints.txt		constraints.txt	Update TensorRT-LLM (NVIDIA#2873)	Mar 11, 2025
eval_long_context.py		eval_long_context.py	Update TensorRT-LLM (NVIDIA#2008)	Jul 23, 2024
generate_checkpoint_config.py		generate_checkpoint_config.py	Update TensorRT-LLM (NVIDIA#2562)	Dec 11, 2024
generate_xgrammar_tokenizer_info.py		generate_xgrammar_tokenizer_info.py	Update TensorRT-LLM (NVIDIA#2783)	Feb 13, 2025
hf_lora_convert.py		hf_lora_convert.py	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
mmlu.py		mmlu.py	Update TensorRT-LLM (NVIDIA#2460)	Nov 19, 2024
mmlu_llmapi.py		mmlu_llmapi.py	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
run.py		run.py	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
summarize.py		summarize.py	Update TensorRT-LLM (NVIDIA#2755)	Feb 11, 2025
utils.py		utils.py	Update TensorRT-LLM (NVIDIA#2849)	Mar 4, 2025
View all files