[Doc]: nvidia ammo has been renamed

[stas00]

📚 The doc issue

https://docs.vllm.ai/en/latest/quantization/fp8_e4m3_kvcache.html is outdated wrt nvidia ammo

From: NVIDIA/TensorRT-LLM#1368 (comment)

The AMMO toolkit has been renamed to "TensorRT model optimizer" and the documentation is available at https://nvidia.github.io/TensorRT-Model-Optimizer/ . Examples related with Model Optimizer is available at https://github.com/NVIDIA/TensorRT-Model-Optimizer?tab=readme-ov-file

I'm following the breadcrumbs - will update if I can figure out the up-to-date instructions.

Suggest a potential alternative/fix

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[stas00]

So the new installation process is:

pip install "nvidia-modelopt[all]" --extra-index-url https://pypi.nvidia.com

Pre-compile/build the tool (could take a long time to finish):

python -c "import modelopt.torch.quantization.extensions as ext; print(ext.cuda_ext); print(ext.cuda_ext_fp8)"

[github-actions]

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!