I want to run python code on the Host which connects thru to Triton on Docker. I’ve done it with Flask and Google Cloud, and I just want to know if there are any additional steps accessing Jetson-Voice container on NGC.
I looked in the jetson-voice Docker container, but this seems like an HTTP Post stub instead.
Thanks,
Tony.
/workspace/src/asr/jarvis/speech_utils.py
if mode == “streaming”:
# Create gRPC stub for communicating with the server
print('opening GRPC channel ’ + str(url))
channel = grpc.insecure_channel(url,
options=[(‘grpc.keepalive_time_ms’, 10000),
(‘grpc.keepalive_timeout_ms’, 10000),
(‘grpc.keepalive_permit_without_calls’, True)])
self.grpc_stub = grpc_service_pb2_grpc.GRPCServiceStub(channel)
request = grpc_service_pb2.StatusRequest(model_name=model_name)
response = self.grpc_stub.Status(request)
server_status = response.server_status