Graph Composer 3.0.0 tmp file error

Simple graph that is just a Video Test Source to a Xv based Video Renderer.
It seems to be deploying the graph to a tmp folder and then cannot find it.
There is no sign of this folder in /tmp.
Where should I look for the cause of this behavior?

When run, the logs show:
DEBUG:Registry:Graph successfully installed to /tmp/gxf_140564694236112
E0810 13:01:45.631275940 3983 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
2023-08-10 13:01:45.637 INFO gxf/gxe/gxe.cpp@182: Creating context
2023-08-10 13:01:45.641 ERROR gxf/std/extension_loader.cpp@114: Failed to load extension /tmp/gxf_140564694236112/gxf/std/libgxf_std.so Error: libcudart.so.12: cannot open shared object file: No such file or directory
2023-08-10 13:01:45.641 ERROR gxf/gxe/gxe.cpp@242: LoadExtensionManifest Error: GXF_EXTENSION_FILE_NOT_FOUND

Thanks,
Phil

Can the sample graphs in /opt/nvidia/deepstream/deepstream/reference_graphs/ work?

The reference graphs produce the same error.

Below is the full log for one of the reference graphs:
DEBUG:Registry:Installing graph in dir /tmp//.nvgraph.k2rk6pko
2023-08-11 10:39:07,697 - Registry - INFO - Installing graph …
INFO:Registry:Installing graph …
DEBUG:Registry:List of all extensions dependencies needed:
[ExtensionRecord(name=‘NvDsMuxDemuxExt’, version=‘1.3.0’, uuid=‘89b8398c-5820-4051-835c-a91f2d49766b’), ExtensionRecord(name=‘NvDsBaseExt’, version=‘1.4.0’, uuid=‘56d7e3ec-62c6-4652-bcc8-4f1c3b00df03’), ExtensionRecord(name=‘NvDsOutputSinkExt’, version=‘1.3.0’, uuid=‘3fc9ad87-03e7-47a8-bbfc-8501c3f7ff2f’), ExtensionRecord(name=‘NvDsInferenceUtilsExt’, version=‘1.3.0’, uuid=‘27856a43-5ad4-4d8e-be36-0ec2cf9bbb58’), ExtensionRecord(name=‘NvDsInferenceExt’, version=‘1.3.0’, uuid=‘0b02963e-c24e-4c13-ace0-c4cdf36c7c71’), ExtensionRecord(name=‘NvDsSampleModelsExt’, version=‘1.3.0’, uuid=‘909dc1ea-c654-44c1-97a3-0b8fec12141a’), ExtensionRecord(name=‘NvDsVisualizationExt’, version=‘1.3.0’, uuid=‘25903cd4-fc5c-4139-987b-47bb27e8b424’), ExtensionRecord(name=‘NvDsSourceExt’, version=‘1.3.0’, uuid=‘a632d022-3425-4848-9074-e6483ef74366’)]
DEBUG:Registry:Complete dependency graph {
“NvDsSourceExt:1.3.0”: [
“NvDsBaseExt:1.4.0”,
“HttpExtension:0.2.0”
],
“NvDsBaseExt:1.4.0”: [
“NvDsInterfaceExt:1.3.0”,
“StandardExtension:2.3.0”,
“MultimediaExtension:2.3.0”
],
“NvDsOutputSinkExt:1.3.0”: [
“NvDsBaseExt:1.4.0”
],
“HttpExtension:0.2.0”: [
“StandardExtension:2.3.0”
],
“NvDsInterfaceExt:1.3.0”: ,
“StandardExtension:2.3.0”: ,
“MultimediaExtension:2.3.0”: [
“StandardExtension:2.3.0”
],
“NvDsMuxDemuxExt:1.3.0”: [
“NvDsBaseExt:1.4.0”
],
“NvDsInferenceUtilsExt:1.3.0”: [
“NvDsBaseExt:1.4.0”,
“NvDsInferenceExt:1.3.0”,
“NvDsSourceExt:1.3.0”
],
“NvDsInferenceExt:1.3.0”: [
“NvDsBaseExt:1.4.0”
],
“NvDsSampleModelsExt:1.3.0”: [
“NvDsInferenceExt:1.3.0”
],
“NvDsVisualizationExt:1.3.0”: [
“NvDsOutputSinkExt:1.3.0”
]
}
DEBUG:Registry:Dependent extensions required [‘NvDsInterfaceExt:1.3.0’, ‘StandardExtension:2.3.0’, ‘MultimediaExtension:2.3.0’, ‘NvDsBaseExt:1.4.0’, ‘NvDsMuxDemuxExt:1.3.0’, ‘NvDsOutputSinkExt:1.3.0’, ‘NvDsInferenceExt:1.3.0’, ‘HttpExtension:0.2.0’, ‘NvDsSourceExt:1.3.0’, ‘NvDsInferenceUtilsExt:1.3.0’, ‘NvDsSampleModelsExt:1.3.0’, ‘NvDsVisualizationExt:1.3.0’]
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=‘11.8’, cudnn=None, tensorrt=None, deepstream=None, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=‘12.1’, cudnn=None, tensorrt=None, deepstream=None, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=None, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=None, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
DEBUG:Registry:Found a close match TargetConfig(platform=PlatformConfig(arch=‘x86_64’, os=‘linux’, distribution=‘ubuntu_20.04’), compute=ComputeConfig(cuda=None, cudnn=None, tensorrt=None, deepstream=‘6.3’, triton=None, vpi=None))
2023-08-11 10:39:07,722 - Registry - INFO -
Requested target configuration:
arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 12.1 cudnn: 8.8.1 tensorrt: 8.5.3 deepstream: 6.2.1 vpi: 2.3.1

Selected extension variants:
NvDsInterfaceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
StandardExtension
Version: 2.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 12.1
MultimediaExtension
Version: 2.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04
NvDsBaseExt
Version: 1.4.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsMuxDemuxExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsOutputSinkExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsInferenceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
HttpExtension
Version: 0.2.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04
NvDsSourceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsInferenceUtilsExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsSampleModelsExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsVisualizationExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3

INFO:Registry:
Requested target configuration:
arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 12.1 cudnn: 8.8.1 tensorrt: 8.5.3 deepstream: 6.2.1 vpi: 2.3.1

Selected extension variants:
NvDsInterfaceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
StandardExtension
Version: 2.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 cuda: 12.1
MultimediaExtension
Version: 2.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04
NvDsBaseExt
Version: 1.4.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsMuxDemuxExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsOutputSinkExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsInferenceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
HttpExtension
Version: 0.2.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04
NvDsSourceExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsInferenceUtilsExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsSampleModelsExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3
NvDsVisualizationExt
Version: 1.3.0 Variant: arch: x86_64 os: linux distribution: ubuntu_20.04 deepstream: 6.3

DEBUG:Registry:Importing ext libs from ngc repo for NvDsInterfaceExt
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/f787f50d-9004-4e85-88b9-1ed1894257f2/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/f787f50d-9004-4e85-88b9-1ed1894257f2.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for StandardExtension
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/8ec2d5d6-b5df-48bf-8dee-0252606fdd7e/2.3.0/linux/x86_64/ubuntu_20.04-cuda-12.1/8ec2d5d6-b5df-48bf-8dee-0252606fdd7e.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for MultimediaExtension
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/6f2d1afc-1057-481a-9da6-a5f61fed178e/2.3.0/linux/x86_64/ubuntu_20.04/6f2d1afc-1057-481a-9da6-a5f61fed178e.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsBaseExt
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/56d7e3ec-62c6-4652-bcc8-4f1c3b00df03/1.4.0/linux/x86_64/ubuntu_20.04-ds-6.3/56d7e3ec-62c6-4652-bcc8-4f1c3b00df03.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsMuxDemuxExt
DEBUG:Registry:Downloading file /home/phil/.cache/nvgraph_registry/ngc-public/89b8398c-5820-4051-835c-a91f2d49766b/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/89b8398c-5820-4051-835c-a91f2d49766b.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsOutputSinkExt
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/3fc9ad87-03e7-47a8-bbfc-8501c3f7ff2f/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/3fc9ad87-03e7-47a8-bbfc-8501c3f7ff2f.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsInferenceExt
DEBUG:Registry:Downloading file /home/phil/.cache/nvgraph_registry/ngc-public/0b02963e-c24e-4c13-ace0-c4cdf36c7c71/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/0b02963e-c24e-4c13-ace0-c4cdf36c7c71.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for HttpExtension
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/22a21c97-f20b-4c03-b277-6e6f52303328/0.2.0/linux/x86_64/ubuntu_20.04/22a21c97-f20b-4c03-b277-6e6f52303328.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsSourceExt
DEBUG:Registry:Using cached variant /home/phil/.cache/nvgraph_registry/ngc-public/a632d022-3425-4848-9074-e6483ef74366/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/a632d022-3425-4848-9074-e6483ef74366.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsInferenceUtilsExt
DEBUG:Registry:Downloading file /home/phil/.cache/nvgraph_registry/ngc-public/27856a43-5ad4-4d8e-be36-0ec2cf9bbb58/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/27856a43-5ad4-4d8e-be36-0ec2cf9bbb58.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsSampleModelsExt
DEBUG:Registry:Downloading file /home/phil/.cache/nvgraph_registry/ngc-public/909dc1ea-c654-44c1-97a3-0b8fec12141a/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/909dc1ea-c654-44c1-97a3-0b8fec12141a.tar.gz
DEBUG:Registry:Importing ext libs from ngc repo for NvDsVisualizationExt
DEBUG:Registry:Downloading file /home/phil/.cache/nvgraph_registry/ngc-public/25903cd4-fc5c-4139-987b-47bb27e8b424/1.3.0/linux/x86_64/ubuntu_20.04-ds-6.3/25903cd4-fc5c-4139-987b-47bb27e8b424.tar.gz
DEBUG:Registry:Graph successfully installed to /tmp/gxf_140564211349600
E0811 10:39:28.019704224 3982 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
2023-08-11 10:39:28.022 INFO gxf/gxe/gxe.cpp@182: Creating context
2023-08-11 10:39:28.024 ERROR gxf/std/extension_loader.cpp@114: Failed to load extension /tmp/gxf_140564211349600/gxf/std/libgxf_std.so Error: libcudart.so.12: cannot open shared object file: No such file or directory
2023-08-11 10:39:28.024 ERROR gxf/gxe/gxe.cpp@242: LoadExtensionManifest Error: GXF_EXTENSION_FILE_NOT_FOUND

How did you install Graph Composer? Have you followed the steps to install DeepStream before Graph Composer? Quickstart Guide — DeepStream 6.3 Release documentation

Seems your extensions are not corerct. Can you sync your extensions again?

registry repo clean
registry cache -c
registry repo sync -n ngc-public

Thanks. After running those commands, there was a warning that some extensions failed to sync and referenced the log file nvgraph_registry.log.

In that file, after the list of extensions that synced successfully, there were several that had errors of this pattern:
2023-08-14 09:21:49,827 - Registry - DEBUG - Downloading file /home/phil/.cache/nvgraph_registry/UcxExtension/0.0.5/0.0.5-linux-aarch64_sbsa-ubuntu_20.04-cuda-11.8/target.yaml
2023-08-14 09:21:49,828 - Registry - INFO - Updating database …
2023-08-14 09:21:49,915 - Registry - DEBUG - Incompatible gxf core version
2023-08-14 09:21:49,915 - Registry - DEBUG - Registry gxf core version: 3.0.0 Extension gxf core version: 2.5.0
2023-08-14 09:21:49,915 - Registry - DEBUG - Skipping extension NvDsBaseExt version 1.2.0
2023-08-14 09:21:49,994 - Registry - DEBUG - Incompatible gxf core version
2023-08-14 09:21:49,994 - Registry - DEBUG - Registry gxf core version: 3.0.0 Extension gxf core version: 2.5.0
2023-08-14 09:21:49,994 - Registry - DEBUG - Skipping extension NvDsCloudMsgExt version 1.1.0
2023-08-14 09:21:50,184 - Registry - DEBUG - Extension dependency not found None version: 2.3.0
2023-08-14 09:21:50,184 - Registry - DEBUG - Extension dependency not found None version: 2.3.0
2023-08-14 09:21:50,184 - Registry - DEBUG - Extension dependency not found None version: 1.3.0
2023-08-14 09:21:50,193 - Registry - DEBUG - Extension dependency not found StandardExtension version: 2.3.0
2023-08-14 09:21:50,193 - Registry - DEBUG - Extension dependency not found MultimediaExtension version: 2.3.0
2023-08-14 09:21:50,193 - Registry - DEBUG - Extension dependency not found NvDsInterfaceExt version: 1.3.0

Is this 3.0.0 to 2.5.0 mismatch what might be causing the issue? If so, are there steps to bring these into alignment?

Thanks,
Phil

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

Every extension has several versions, different extension versions for different Graph Composer versions. The log is OK.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.