You can use apache tvm [1] to get a static runtime. I'm not sure of the state of sparsification acceleration support, but at least quantization is supported.

Edit: it's in C++ and has rust bindings [2]

[1] https://tvm.apache.org/

[2] https://github.com/apache/tvm/tree/main/rust