Extremely slow TF Lite inference on Jetson Xavier NX

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

I wonder if there is any possibility to significantly speed up the inferencing of the TF Lite model on Jetson boards.

I’ve been doing comparison tests of YOLOv8 exported to various formats and e.g. TF Lite float32 model inference on 640x640 images takes an insane 10s+ on Xavier NX 🤯

I searched for similar topics here on the forum, of course TF Lite on Jetson has no real meaning, it is only a synthetic benchmark, I found only one relevant one. The topic was closed with the comment that at that time (2022) no support for running TF Lite with GPU was available.
The only relevant source is the official documentation of the new LiteRT, formerly TF Lite, which describes the possibility of GPU acceleration but only for iOS/Android platforms. Is this really the case, or is there already some official undocumented solution for TF Lite acceleration on Jetson?

3

Hi,

Do you infer it with CPU?
This can be checked by monitoring the GPU utilization with tegrastats.

$ sudo tegrastats

On Jetson, it’s more recommended to try our TensorRT library as it is optimized for both memory usage and performance.

Thanks.

4

Hi @ AastaLLL,
thank you for your response. I use a custom script (see below) to monitor CPU/GPU utilization, which calls the jetson-stats API. Anyway, the GPU utilization is at 0 percent. Tensorflow is installed from a pre-built wheel as documented here.

def monitor_to_file(output_file, stop_event):
    with jtop() as jetson:  # Init jtop API
        if jetson.ok():
            with open(output_file, "w") as f:
                f.write("timestamp,cpu_usage,gpu_usage\n")  # Header CSV
                while not stop_event.is_set():
                    data = jetson.stats
                    timestamp = time.time()
                    # Calculate avg CPU utilization
                    cpu_cores = [value for key, value in data.items() if key.startswith("CPU")]
                    cpu_avg_usage = sum(cpu_cores) / len(cpu_cores) if cpu_cores else 0                    
                    # GPU Usage
                    gpu_usage = data.get("GPU", "N/A")
                    # Write to log file
                    f.write(f"{timestamp},{cpu_avg_usage},{gpu_usage}\n")
                    f.flush()
                    time.sleep(1)  # Monitoring interval

I was also intrigued to see that the inference of the same YOLO TFLite model runs much faster on Raspberry Pi 5, almost 10x!!!

And it is also striking that the inference on the quantized model runs once so much longer.

I wonder what could be the problem? The arm8.2 CPU instruction set does not support the necessary vector operations? TFLite can’t be accelerated by running on GPU?

5

Hi

The package from our link has CUDA support.
Do you run the model on GPU?

Could you follow the below link to see if you can get GPU works?

Thanks.

6

Hi @ AastaLLL,

thanks for the link. As you can see, CUDA is supported on the installed version of Tensorflow.

Python 3.8.10 (default, Nov  7 2024, 13:10:47) 
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf
>>> print("Num GPUs Available: ", len(tf.config.list_physical_devices('GPU')))
Num GPUs Available:  1
>>> print(tf.__version__)
2.12.0

TF Lite runtime is installed as well.

Name: tflite-runtime
Version: 2.13.0

I use this simple way of inferencing the Tensorflow Lite model.

from ultralytics import YOLO
model = YOLO('model_float32.tflite')
# frame comes from the cv2 cap.read() function executing in a loop
model.predict(frame, imgsz=640, conf=0.25)

TF Lite runtime doesn’t support GPU, at least there is no delegate for this compute unit that can use GPU for acceleration.

But I’m still concerned about the unanswered question, why does it run so extremely slow even on 6 CPU cores?

7

Hi,

Do you infer the model with GPU or multiple CPUs?
Could you run the following command concurrently to see what kind of hardware is used?

$ sudo tegrastats

Thanks.

8

Hi @AastaLLL,

sorry, I don’t understand what you mean by this question?

Do you infer the model with GPU or multiple CPUs?

If you meant power efficiency profiles, I use mode ID = 8 (20W 6CORE), since TF Lite can’t use the GPU, let all 6 CPUs go to their full potential.

Here is a printout from tegrastats log, logging was running concurrently with python script for inference.

01-15-2025 23:32:49 RAM 637/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [6%@1420,70%@1420,6%@1420,6%@1420,36%@1420,7%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:50 RAM 666/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:51 RAM 704/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:52 RAM 733/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:53 RAM 754/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:54 RAM 771/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:55 RAM 782/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:56 RAM 880/7513MB (lfb 1401x4MB) SWAP 0/3756MB (cached 0MB) CPU [4%@1420,7%@1420,44%@1420,5%@1420,56%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:57 RAM 997/7513MB (lfb 1398x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:58 RAM 1158/7513MB (lfb 1358x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,7%@1420,100%@1420,0%@1420,0%@1420,1%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:32:59 RAM 1211/7513MB (lfb 1344x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:00 RAM 1211/7513MB (lfb 1344x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:01 RAM 1213/7513MB (lfb 1344x4MB) SWAP 0/3756MB (cached 0MB) CPU [98%@1420,0%@1420,2%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:02 RAM 1213/7513MB (lfb 1344x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:03 RAM 1213/7513MB (lfb 1344x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:04 RAM 1214/7513MB (lfb 1343x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:05 RAM 1216/7513MB (lfb 1343x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:06 RAM 1219/7513MB (lfb 1342x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:07 RAM 1219/7513MB (lfb 1342x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:08 RAM 1219/7513MB (lfb 1342x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:09 RAM 1220/7513MB (lfb 1342x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:10 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [100%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:11 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [11%@1420,3%@1420,88%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:12 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:13 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:14 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:15 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:16 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:17 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:18 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:19 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:20 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:21 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:22 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:23 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [3%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:24 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,1%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:25 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:26 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:27 RAM 1231/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:28 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,1%@1420,100%@1420,0%@1420,1%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:29 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:30 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:31 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,2%@1420,0%@1420,98%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:32 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:33 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:34 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:35 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,2%@1420,6%@1420,1%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:36 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:37 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:38 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:39 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:40 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:41 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:42 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:43 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:44 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:45 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:46 RAM 1232/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:47 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,1%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:48 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:49 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:50 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:51 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:52 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:53 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:54 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:55 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:56 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:57 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:58 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:33:59 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:00 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,1%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:01 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:02 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:03 RAM 1233/7513MB (lfb 1339x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:04 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:05 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:06 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:07 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:08 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:09 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,100%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:10 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,2%@1420,0%@1420,97%@1420,2%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:11 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [98%@1420,1%@1420,1%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:12 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [33%@1420,3%@1420,4%@1420,67%@1420,2%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:13 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:14 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:15 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:16 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:17 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:18 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:19 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:20 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:21 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:22 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:23 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:24 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:25 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:26 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:27 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:28 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:29 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:30 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:31 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:32 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:33 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:34 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:35 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:36 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:37 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:38 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:39 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:40 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:41 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:42 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:43 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:44 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:45 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:46 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:47 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:48 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:49 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [6%@1420,1%@1420,0%@1420,100%@1420,1%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:50 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:51 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:52 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:53 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:54 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:55 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:56 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:57 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:58 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:34:59 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:00 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:01 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,3%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:02 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:03 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:04 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:05 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:06 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:07 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:08 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:09 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,1%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:10 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [2%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:11 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:12 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:13 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,100%@1420,0%@1420,1%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:14 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:15 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:16 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:17 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:18 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:19 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:20 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:21 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:22 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:23 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:24 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:25 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,99%@1420,5%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:26 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:27 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:28 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:29 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:30 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:31 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:32 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:33 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:34 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:35 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:36 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:37 RAM 1234/7513MB (lfb 1338x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:38 RAM 638/7513MB (lfb 1395x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,100%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:39 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,3%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:40 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:41 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:42 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:43 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:44 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:45 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:46 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:47 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:48 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,1%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:49 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [1%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
01-15-2025 23:35:50 RAM 577/7513MB (lfb 1396x4MB) SWAP 0/3756MB (cached 0MB) CPU [0%@1420,0%@1420,0%@1420,0%@1420,0%@1420,0%@1420] EMC_FREQ 0% GR3D_FREQ 0% thermal@25C
9

Hi,

Based on the output, the inference only run on a single CPU and no GPU is used at all.

Just one CPU core is in use

CPU [0%@1420,0%@1420,100%@1420,0%@1420,0%@1420,0%@1420]

GPU utilization is 0%

0% GR3D_FREQ

This should be the reason why the latency is long.
To get a better performance, please try to run your model with more hardware resources.

You might consider our TensorRT library which has optimized for the Jetson’s GPU.

Thanks.

10

Hi @AastaLLL,

as I wrote in the initial comment, I’m making a benchmark study and trying to figure out why TensorFlow Lite inference runs so slow on CPUs. So for now, let’s not deal with exporting to TensoRT for the goal of increasing performance.

And thus the reason that inference is slow is that only 1 CPU core is active. That’s clear, but in contrast to my setup. Below is a dump from /etc/nvpmodel.conf and for POWER_MODEL ID=8 it is valid that all 6 CPUs should be online. That’s why I don’t understand that it runs on one core.

Do you have any experience that TF Lite runtime can utilize multicore processor completely, or does it run only within one core?

What did you mean by

try to run a model with more hardware resources

Thanks in advance.

< POWER_MODEL ID=8 NAME=MODE_20W_6CORE >
CPU_ONLINE CORE_0 1
CPU_ONLINE CORE_1 1
CPU_ONLINE CORE_2 1
CPU_ONLINE CORE_3 1
CPU_ONLINE CORE_4 1
CPU_ONLINE CORE_5 1
TPC_POWER_GATING TPC_PG_MASK 1
GPU_POWER_CONTROL_ENABLE GPU_PWR_CNTL_EN on
CPU_DENVER_0 MIN_FREQ 1190400
/etc/nvpmodel.confCPU_DENVER_0 MAX_FREQ 1420800
CPU_DENVER_1 MIN_FREQ 1190400
CPU_DENVER_1 MAX_FREQ 1420800
CPU_DENVER_2 MIN_FREQ 1190400
CPU_DENVER_2 MAX_FREQ 1420800
GPU MIN_FREQ 0
GPU MAX_FREQ 1109250000
GPU_POWER_CONTROL_DISABLE GPU_PWR_CNTL_DIS auto
EMC MAX_FREQ 1866000000
NAFLL_DLA MAX_FREQ 1100800000
NAFLL_DLA_FALCON MAX_FREQ 640000000
DLA0_CORE MAX_FREQ 1100800000
DLA1_CORE MAX_FREQ 1100800000
DLA0_FALCON MAX_FREQ 640000000
DLA1_FALCON MAX_FREQ 640000000
NAFLL_PVA_VPS MAX_FREQ 819200000
NAFLL_PVA_CORE MAX_FREQ 601600000
PVA0_VPS0 MAX_FREQ 819200000
PVA0_VPS1 MAX_FREQ 819200000
PVA1_VPS0 MAX_FREQ 819200000
PVA1_VPS1 MAX_FREQ 819200000
PVA0_AXI MAX_FREQ 601600000
PVA1_AXI MAX_FREQ 601600000
CVNAS MAX_FREQ 576000000
NVDEC MAX_FREQ 793600000
NVDEC1 MAX_FREQ 793600000
NVENC MAX_FREQ 729600000
NVENC1 MAX_FREQ 729600000
NVJPG MAX_FREQ 460800000
SE1 MAX_FREQ 704000000
SE2 MAX_FREQ 704000000
11

Hi @AastaLLL, just let me add that I’ve tried all the modes in the power models for Jetson Xavier NX, as listed here. In each mode, only one CPU core is ALWAYS being utilized during inference.

Alternatively, can you think of anything that might influence this behaviour? Is it still worth trying to set something? I’d need to close this topic already.
If there is no other way, could you confirm the information, which can be cited as a relevant source, that the Tensorflow Lite runtime on Jetson Xavier NX cannot run on multiple cores?

Thanks for your cooperation.

12

Hi,

Not sure if TensorFlow Lite supports run inference on multiple CPUs.
If yes, you should be able to enable it on Jetson.

If you want to check if TensorFlow Lite has a different support matrix for Jetson.
It’s more recommended to check with them as they should have more info about their software.

Thanks.