Do we have official Golang support for ONNXRuntime?

[mingzhizheng-outreach]

Hi Team,

I try to build a model service using Golang and host a ONNX model built offline, but I can't find any Golang support for ONNXRuntime. Do we have official Golang support for ONNXRuntime? Do we have plan to support Golang for ONNXRuntime?

Thanks!

[hariharans29]

No official support for Golang at this time and no plans as yet to support it. Contributions are welcome though.

[pranavsharma]

You can use Nvidia Triton as a model service if you don't want to build it yourself.

[mingzhizheng-outreach]

Thanks for the suggestion, @pranavsharma / @hariharans29 ! I have tried out the Triton solution, it works for me

[ytaous]

Leaving it open for now for visibility.

[loeffel-io]

+1

[mirecl]

+1

[loeffel-io]

after some research i used https://developer.nvidia.com/nvidia-triton-inference-server
its amazing

[Fly-Playgroud]

+1

[pablodz]

goroutines can solve a lot of troubles

[mirecl]

+1

[mvestnik]

+1