Understanding wqdump output

Infrastructure & Networking DOCA Enterprise Networking
1

What does following output means,
wqdump -d /dev/mst/mt4123_pciconf0 --source FullQp --dump
ALL_VALID_QPNS

Numbers of valid contexts (in the range 0x0 - 0xffffff):
gvmi 0x0000 index 0x00000001
gvmi 0x0000 index 0x00000004
gvmi 0x0000 index 0x00000005
gvmi 0x0000 index 0x00000006
gvmi 0x0000 index 0x0000000a
gvmi 0x0000 index 0x0000000c
gvmi 0x0000 index 0x00000017
gvmi 0x0000 index 0x0000001a
gvmi 0x0000 index 0x0000001b
gvmi 0x0000 index 0x00000020
gvmi 0x0000 index 0x00000022
gvmi 0x0000 index 0x00000042
gvmi 0x0000 index 0x00000045
gvmi 0x0000 index 0x00001046
gvmi 0x0000 index 0x00001047
gvmi 0x0000 index 0x00001048
gvmi 0x0000 index 0x00001049
gvmi 0x0000 index 0x0000104b
gvmi 0x0000 index 0x0000104c
gvmi 0x0000 index 0x0000104d
gvmi 0x0000 index 0x0000104e
gvmi 0x0000 index 0x0000104f
gvmi 0x0000 index 0x00001051
gvmi 0x0000 index 0x00001052
gvmi 0x0000 index 0x00001053
gvmi 0x0000 index 0x00001054
gvmi 0x0000 index 0x00001055
gvmi 0x0000 index 0x00001057
gvmi 0x0000 index 0x00001058
gvmi 0x0000 index 0x00001059
gvmi 0x0000 index 0x0000105a
gvmi 0x0000 index 0x0000105b
gvmi 0x0000 index 0x0000105d
gvmi 0x0000 index 0x0000105e
gvmi 0x0000 index 0x0000105f
gvmi 0x0000 index 0x00001060
gvmi 0x0000 index 0x00001061
gvmi 0x0000 index 0x00001063
gvmi 0x0000 index 0x00001064
gvmi 0x0000 index 0x00001065
gvmi 0x0000 index 0x00001066
gvmi 0x0000 index 0x00001067
gvmi 0x0000 index 0x00001069
gvmi 0x0000 index 0x0000106a
gvmi 0x0000 index 0x0000106b
gvmi 0x0000 index 0x0000106c
gvmi 0x0000 index 0x0000106d
gvmi 0x0000 index 0x0000106f
gvmi 0x0000 index 0x00001070
gvmi 0x0000 index 0x00001071
gvmi 0x0000 index 0x00001072
gvmi 0x0000 index 0x00001073
gvmi 0x0000 index 0x00001075
gvmi 0x0000 index 0x00001076
gvmi 0x0000 index 0x00001077
gvmi 0x0000 index 0x00001078
gvmi 0x0000 index 0x00001079
gvmi 0x0000 index 0x0000107b
gvmi 0x0000 index 0x0000107c
gvmi 0x0000 index 0x0000107d
gvmi 0x0000 index 0x0000107e
gvmi 0x0000 index 0x0000107f
gvmi 0x0000 index 0x00001081
gvmi 0x0000 index 0x00001082
gvmi 0x0000 index 0x00001083
gvmi 0x0000 index 0x00001084
gvmi 0x0000 index 0x00001085
gvmi 0x0000 index 0x00001087
gvmi 0x0000 index 0x00001088
gvmi 0x0000 index 0x00001089
gvmi 0x0000 index 0x0000108a
gvmi 0x0000 index 0x0000108b
gvmi 0x0000 index 0x0000108d
gvmi 0x0000 index 0x0000108e
gvmi 0x0000 index 0x0000108f
gvmi 0x0000 index 0x00001090
gvmi 0x0000 index 0x00001091
gvmi 0x0000 index 0x00001093
gvmi 0x0000 index 0x00001094
gvmi 0x0000 index 0x00001095
gvmi 0x0000 index 0x00001096
gvmi 0x0000 index 0x00001097
gvmi 0x0000 index 0x00001099
gvmi 0x0000 index 0x0000109a
gvmi 0x0000 index 0x0000109b
gvmi 0x0000 index 0x0000109c
gvmi 0x0000 index 0x0000109d
gvmi 0x0000 index 0x0000109f
gvmi 0x0000 index 0x000010a0
gvmi 0x0000 index 0x000010a1
gvmi 0x0000 index 0x000010a2
gvmi 0x0000 index 0x000010a3
gvmi 0x0000 index 0x000010a5
gvmi 0x0000 index 0x000010a6
gvmi 0x0000 index 0x000010a7
gvmi 0x0000 index 0x000010a8
gvmi 0x0000 index 0x000010a9
gvmi 0x0000 index 0x000010ab
gvmi 0x0000 index 0x000010ac
gvmi 0x0000 index 0x000010ad
gvmi 0x0000 index 0x000010ae
gvmi 0x0000 index 0x000010af
gvmi 0x0000 index 0x000010b1
gvmi 0x0000 index 0x000010b2
gvmi 0x0000 index 0x000010b3
gvmi 0x0000 index 0x000010b4
gvmi 0x0000 index 0x000010b5
gvmi 0x0000 index 0x000010b7
gvmi 0x0000 index 0x000010b8
gvmi 0x0000 index 0x000010b9
gvmi 0x0000 index 0x000010ba
gvmi 0x0000 index 0x000010bb
gvmi 0x0000 index 0x000010bd
gvmi 0x0000 index 0x000010be
gvmi 0x0000 index 0x000010bf
gvmi 0x0000 index 0x000010c0
gvmi 0x0000 index 0x000010c1
gvmi 0x0000 index 0x000010c3
gvmi 0x0000 index 0x000010c4
gvmi 0x0000 index 0x000010c5
gvmi 0x0000 index 0x000010c6
gvmi 0x0000 index 0x000010c7
gvmi 0x0000 index 0x000010c9
gvmi 0x0000 index 0x000010ca
gvmi 0x0000 index 0x000010cb
gvmi 0x0000 index 0x000010cc
gvmi 0x0000 index 0x000010cd
gvmi 0x0000 index 0x000010cf
gvmi 0x0000 index 0x000010d0
gvmi 0x0000 index 0x000010d1
gvmi 0x0000 index 0x000010d2
gvmi 0x0000 index 0x000010d3
gvmi 0x0000 index 0x000010d5
gvmi 0x0000 index 0x000010d6
gvmi 0x0000 index 0x000010d7
gvmi 0x0000 index 0x000010d8
gvmi 0x0000 index 0x000010d9
gvmi 0x0000 index 0x000010db
gvmi 0x0000 index 0x000010dc
gvmi 0x0000 index 0x000010dd
gvmi 0x0000 index 0x000010de
gvmi 0x0000 index 0x000010df
gvmi 0x0000 index 0x000010e1
gvmi 0x0000 index 0x000010e2
gvmi 0x0000 index 0x000010e3
gvmi 0x0000 index 0x000010e4
gvmi 0x0000 index 0x000010e5
gvmi 0x0000 index 0x000010e7
gvmi 0x0000 index 0x000010e8
gvmi 0x0000 index 0x000010e9
gvmi 0x0000 index 0x000010ea
gvmi 0x0000 index 0x000010eb
gvmi 0x0000 index 0x000010ed
gvmi 0x0000 index 0x000010ee
gvmi 0x0000 index 0x000010ef
gvmi 0x0000 index 0x000010f0
gvmi 0x0000 index 0x000010f1
gvmi 0x0000 index 0x000010f3
gvmi 0x0000 index 0x000010f4
gvmi 0x0000 index 0x000010f5
gvmi 0x0000 index 0x000010f6
gvmi 0x0000 index 0x000010f7
gvmi 0x0000 index 0x000010f9
gvmi 0x0000 index 0x000010fa
gvmi 0x0000 index 0x000010fb
gvmi 0x0000 index 0x000010fc
gvmi 0x0000 index 0x000010fd
gvmi 0x0000 index 0x000010ff
gvmi 0x0000 index 0x00001100
gvmi 0x0000 index 0x00001101
gvmi 0x0000 index 0x00001102
gvmi 0x0000 index 0x00001103
gvmi 0x0000 index 0x00001105
gvmi 0x0000 index 0x00001106
gvmi 0x0000 index 0x00001107
gvmi 0x0000 index 0x00001108
gvmi 0x0000 index 0x00001109
gvmi 0x0000 index 0x0000110b
gvmi 0x0000 index 0x0000110c
gvmi 0x0000 index 0x0000110d
gvmi 0x0000 index 0x0000110e
gvmi 0x0000 index 0x0000110f
gvmi 0x0000 index 0x00001111
gvmi 0x0000 index 0x00001112
gvmi 0x0000 index 0x00001113
gvmi 0x0000 index 0x00001114
gvmi 0x0000 index 0x00001115
gvmi 0x0000 index 0x00001117
gvmi 0x0000 index 0x00001118
gvmi 0x0000 index 0x00001119
gvmi 0x0000 index 0x0000111a
gvmi 0x0000 index 0x0000111b
gvmi 0x0000 index 0x0000111d
gvmi 0x0000 index 0x0000111e
gvmi 0x0000 index 0x0000111f
gvmi 0x0000 index 0x00001120
gvmi 0x0000 index 0x00001121
gvmi 0x0000 index 0x00001123
gvmi 0x0000 index 0x00001124
gvmi 0x0000 index 0x00001125
gvmi 0x0000 index 0x00001126
gvmi 0x0000 index 0x00001127
gvmi 0x0000 index 0x00001129
gvmi 0x0000 index 0x0000112a
gvmi 0x0000 index 0x0000112b
gvmi 0x0000 index 0x0000112c
gvmi 0x0000 index 0x0000112d
gvmi 0x0000 index 0x0000112f
gvmi 0x0000 index 0x00001130
gvmi 0x0000 index 0x00001131
gvmi 0x0000 index 0x00001132
gvmi 0x0000 index 0x00001133
gvmi 0x0000 index 0x00001135
gvmi 0x0000 index 0x00001136
gvmi 0x0000 index 0x00001137
gvmi 0x0000 index 0x00001138
gvmi 0x0000 index 0x00001139
gvmi 0x0000 index 0x0000113b
gvmi 0x0000 index 0x0000113c
gvmi 0x0000 index 0x0000113d
gvmi 0x0000 index 0x0000113e
gvmi 0x0000 index 0x0000113f
gvmi 0x0000 index 0x00001141
gvmi 0x0000 index 0x00001142
gvmi 0x0000 index 0x00001143
gvmi 0x0000 index 0x00001144
gvmi 0x0000 index 0x00001145
gvmi 0x0000 index 0x00001147
gvmi 0x0000 index 0x00001148
gvmi 0x0000 index 0x00001149
gvmi 0x0000 index 0x0000114a
gvmi 0x0000 index 0x0000114b
gvmi 0x0000 index 0x0000114d
gvmi 0x0000 index 0x0000114e
gvmi 0x0000 index 0x0000114f
gvmi 0x0000 index 0x00001150
gvmi 0x0000 index 0x00001151
gvmi 0x0000 index 0x00001153
gvmi 0x0000 index 0x00001154
gvmi 0x0000 index 0x00001155
gvmi 0x0000 index 0x00001156
gvmi 0x0000 index 0x00001157
gvmi 0x0000 index 0x00001159
gvmi 0x0000 index 0x0000115a
gvmi 0x0000 index 0x0000115b
gvmi 0x0000 index 0x0000115c
gvmi 0x0000 index 0x0000115d
gvmi 0x0000 index 0x0000115f
gvmi 0x0000 index 0x00001160
gvmi 0x0000 index 0x00001161
gvmi 0x0000 index 0x00001162
gvmi 0x0000 index 0x00001163
gvmi 0x0000 index 0x00001165
gvmi 0x0000 index 0x00001167

This is not matching to rdma res , since this interface i havent created any QP ( other than GSI which is default)
rdma res
roce0: pd 3 cq 4 qp 1 cm_id 0 mr 0 ctx 0 srq 2

2

Hi palok,

Thank you for posting your inquiry to the NVIDIA Developer Forums.

The discrepancy is expected behavior, not an error. The wqdump utility is a low-level firmware debugging tool that reports all valid QP contexts maintained by the device firmware, which includes:

Hardware reserved QPs - Internal queue pairs used for device operations.
Firmware management QPs - QPs for internal firmware communication and control.
System QPs - Including GSI QP (QP0/QP1 for management).
User-visible QPs - Only these are reported by rdma res.

The rdma res command shows only user-space accessible RDMA resources managed by the kernel verbs layer, which is why it reports “qp 1” (the GSI QP). The 232 contexts shown by wqdump starting from index 0x1046-0x1167 are in the firmware’s internal QP number space and are not exposed to userspace.

The --source FullQp --dump ALL_VALID_QPNS command scans the entire QP context space (0x0 - 0xffffff range).

All reported indices have gvmi 0x0000 indicating contexts in the default GVMI (global virtual memory index - 64b virtual address implemented by HCA associated with driver).

The index range (0x1046 onwards) suggests firmware-reserved QP space. separate from userspace QPs.

Best regards,
NVIDIA Enterprise Experience

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.