Skip to content

TensorRT OSS v10.5.0

Compare
Choose a tag to compare
@moraxu moraxu released this 10 Oct 19:47
c8a5043

Release 10.5-GA

Key Features and Updates:

  • Demo changes
  • Sample changes
    • None
  • Plugin changes
    • Migrated IPluginV2-descendent versions of bertQKVToContextPlugin (1, 2, 3) to newer versions (4, 5, 6 respectively) which implement IPluginV3.
    • Note:
      • The newer versions preserve the attributes and I/O of the corresponding older plugin version
      • The older plugin versions are deprecated and will be removed in a future release
  • Quickstart guide
    • None
  • Parser changes
    • Added support for real-valued STFT operations
    • Improved error handling in IParser

Known issues:

  • Demos:
    • TensorRT engine might not be build successfully when using --fp8 flag on H100 GPUs.