TensorRT 插件自动生成工具 TensorRT Plugin Auto-generation Tool

, Deep Learning Compiler Engineer, Tencent
, AI Developer Technology Engineer, NVIDIA
Writing a TensorRT plugin requires solid CUDA programming skills and considerable time to make the plugin work properly and optimized. We'll demonstrate an end-to-end tool to generate a user-specific op to a TensorRT plugin, enabled by Relay and AutoScheduler of TVM. This tool can help AI developers to get rid of the tedious handwritten TensorRT plugin and convert their models to TensorRT automatically.
活动: GTC Digital Spring
日期: March 2022
行业: 所有行业
话题: Deep Learning - Inference
级别: 中级技术
语言: 英语
所在地: