VDP supports both real-time and on-demand inference.
Blazingly fast speed or super cost efficiency? It’s on your call.
Real-time inference speed bundles with the genuine Vision AI model performance. You can get the fastest inference result ever with VDP from a model serving’s point of view. Thanks to the integrated Triton Inference Server and the high-performant Go backends.
On-demand inference performs batch operation. You can get the most economic inference cost for non-time-critical vision tasks. Schedule your inference tasks and access the structured data results in your data warehouse later.
1 comment
[ 3.5 ms ] story [ 15.3 ms ] threadBlazingly fast speed or super cost efficiency? It’s on your call.
Real-time inference speed bundles with the genuine Vision AI model performance. You can get the fastest inference result ever with VDP from a model serving’s point of view. Thanks to the integrated Triton Inference Server and the high-performant Go backends.
On-demand inference performs batch operation. You can get the most economic inference cost for non-time-critical vision tasks. Schedule your inference tasks and access the structured data results in your data warehouse later.
Give a star on GitHub : https://lnkd.in/eAdURFfJ Join our Discord : https://lnkd.in/eh-za9MA