AI/ML Speech Recognition/Inferencing: NVIDIA Riva on Red Hat OpenShift with PowerFlex

Speech recognition delivers significant value in the areas of automotive, customer services, and smart home devices. Achieving a high level of accuracy in speech recognition can be challenging. NVIDIA Riva is a GPU-accelerated SDK for building speech AI applications that can be customized to deliver real-time performance. Riva offers pre-trained speech models in NVIDIA NGC that can be fine-tuned on a custom dataset. Models can be exported, optimized, and deployed as a speech service on-premises or in the cloud with a single command using Helm charts. Riva’s high-performance inference is powered by NVIDIA TensorRT optimizations and served using the NVIDIA Triton Inference Server, which are both part of the NVIDIA AI platform. NVIDIA Riva, part of the NVIDIA AI platform, is a GPU-accelerated speech AI SDK for building and deploying fully customizable, real-time AI pipelines that deliver world-class accuracy in all clouds, on-premises, at the edge, and on embedded devices. Our white paper describes a solution for automated speech recognition and inference with NVIDIA GPUs leveraging NVIDIA Riva services on Red Hat OpenShift, along with Dell PowerFlex software-defined infrastructure.