Status/Health of RIVA models

AI & Data Science Deep Learning (Training & Inference) Riva
1

Hi is there any whay to check if the ststus or the health of models loaded.
For example, if at some point the inference server stops, is there any way to know that.

2

Hi @aman.rai1

Thanks for your interest in Riva,
I will check for more inputs from the team,

But for now you can get the status by running the below docker command

docker logs riva-speech

Thanks

3

Hi @rvinobha

yes, I have been using the same, but I would love to have something which is just as easy as pinging the server and analysing ther response code rather than monitoring the logs 24/7.

Thanks

4

There’s a health proto? You can ping the /health endpoint. Check out grpccurl on github and you’ll be able to list the available endpoints

5

Did you find a way to check the status?

6

Hi @nharo

Apologies for the delay,

I will check with the team again and confirm if we have anything

Thanks

7

Riva implements GRPC health checking . Using a tool like grpcurl you can easily check this from command line, or via k8s with liveness probes

 ~/bin/grpcurl -plaintext ${URI}:${PORT} list
 ~/bin/grpcurl -plaintext ${URI}:${PORT} list grpc.health.v1.Health
 ~/bin/grpcurl -plaintext ${URI}:${PORT} grpc.health.v1.Health.Check

Watch a container for changes:

~/bin/grpcurl -plaintext ${URI}:${PORT} grpc.health.v1.Health.Watch

~/bin/grpcurl -plaintext ${URI}:${PORT} describe  grpc.health.v1.HealthCheckRequest
grpc.health.v1.HealthCheckRequest is a message:
message HealthCheckRequest {
  string service = 1;
}
1 Like