nvidia/model-optimizer

nvidia/model-optimizer는 여러 모델 최적화 기법으로 추론 프레임워크에 배포할 체크포인트를 만드는 Python 라이브러리다.

GitHub 설명: A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.