How to benchmark LLMs deployed on Amazon SageMaker
Learn how to benchmark LLMs on Amazon SageMaker endpoints. We will be benchmarking Llama 2 13B chat model on Amazon SageMaker Endpoint using awscurl.
0 Comments
November 24, 2023
How to Benchmark LLMs deployed on Amazon SageMaker - TutLinks