Skip to content

Add A4X MAX Aggregated Serving recipe for TensorRT-LLM on GKE#249

Merged
syangx39 merged 2 commits into
AI-Hypercomputer:mainfrom
alisachen-666:dsr1-a4xmax-sglang
Jul 1, 2026
Merged

Add A4X MAX Aggregated Serving recipe for TensorRT-LLM on GKE#249
syangx39 merged 2 commits into
AI-Hypercomputer:mainfrom
alisachen-666:dsr1-a4xmax-sglang

Conversation

@alisachen-666

Copy link
Copy Markdown
Contributor

Add A4X MAX Aggregated Serving recipe for TensorRT-LLM on GKE

@alisachen-666

alisachen-666 commented Jun 25, 2026

Copy link
Copy Markdown
Contributor Author

Hi @Chris113113 @syangx39 Please review this PR. Thanks!

Comment thread inference/a4xmax/aggregated-serving/tensorrt-llm/README.md
Comment thread inference/a4xmax/aggregated-serving/tensorrt-llm/README.md
Comment thread inference/a4xmax/aggregated-serving/tensorrt-llm/README.md
Comment thread inference/a4xmax/aggregated-serving/tensorrt-llm/README.md
@syangx39 syangx39 merged commit eef14ea into AI-Hypercomputer:main Jul 1, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants