How to test triton-inference-server with jmeter

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Hi,all
I want to test HTTP server with jmeter. I know ip and port is ip:8000.
But if the model input is 24x24，model-name is yolov5. How should I write the message body data of the post request ？

3

Please specify details your use case.

But if the model input is 24x24，model-name is yolov5. How should I write the message body data of the post request ？

Please specify more details, what do you mean " the message body data of the post request "?

4

Hi,
When I send post request with jmeter, Input data is like this as follow:
{
“data” :
[
{
“INPUT0” : {“b64”: “YmFzZTY0IGRlY29kZXI=”},
“INPUT1” : {“b64”: “YmFzZTY0IGRlY29kZXI=”}
},
{
“INPUT0” : {“b64”: “YmFzZTY0IGRlY29kZXI=”},
“INPUT1” : {“b64”: “YmFzZTY0IGRlY29kZXI=”}
},
{
“INPUT0” : {“b64”: “YmFzZTY0IGRlY29kZXI=”},
“INPUT1” : {“b64”: “YmFzZTY0IGRlY29kZXI=”}
},
…
]
}

But the triton server told me:
Error Count:1
Data type (“text”|“bin”|“”):text
Response code:400
Response message:Bad Request

Is my Body data is wrong?
Thanks

5

What is Apache JMeter?

Apache JMeter is pure Java-based open-source software designed to load test functional behavior and measure performance. You can use JMeter to analyze and measure the performance of web applications or a variety of services. JMeter was originally used for testing Web Applications or FTP applications. Nowadays, it is used for functional testing, database server testing, etc.

I am not sure Jmeter can be used to test triton inference server http or some others latency or throughput. you can refer to the link you provided for your purpose.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.