Unexpected error when running nsys on V100. I didn’t expect this bug when running the same nsys with K80.
**** start command configuration ****
force-overwrite = false
stop-on-exit = true
export_sqlite = false
stats = false
capture-range = none
stop-on-range-end = false
Beta: ftrace events:
ftrace-keep-user-config = false
trace-GPU-context-switch = false
/build/agent/work/20a3cfcd1c25021d/QuadD/Common/StreamSections/StreamWithSections.cpp(710): Throw in function void QuadDCommon::serializeProtobufToStream(std::ostream&, const google::protobuf::Message&)
Dynamic exception type: boost::exception_detail::clone_impl<QuadDCommon::ProtobufSerializeException>
std::exception::what: ProtobufSerializeException
[boost::errinfo_api_function_*] = serializeProtobufToStream
Here is the system and GPU info
[yiminc@n241 ~]$ cat /etc/os-release
NAME="Red Hat Enterprise Linux Server"
VERSION="7.9 (Maipo)"
ID="rhel"
ID_LIKE="fedora"
VARIANT="Server"
VARIANT_ID="server"
VERSION_ID="7.9"
PRETTY_NAME="Red Hat Enterprise Linux"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:7.9:GA:server"
HOME_URL="https://www.redhat.com/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 7"
REDHAT_BUGZILLA_PRODUCT_VERSION=7.9
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="7.9"
[yiminc@n241 ~]$ nvidia-smi
Fri Nov 5 11:18:24 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 460.32.03 Driver Version: 460.32.03 CUDA Version: 11.2 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla V100-SXM2... Off | 00000000:18:00.0 Off | 0 |
| N/A 41C P0 59W / 300W | 705MiB / 32510MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 10258 C ...lia/julia-1.5.1/bin/julia 355MiB |
| 0 N/A N/A 10560 C ...lia/julia-1.5.1/bin/julia 347MiB |
+-----------------------------------------------------------------------------+```