Usage Limit on DLI Data Science course

On the " Accelerating End-to-End Data Science Workflows" course on the machine learning section I’ve hit a usage limit and have yet to complete the notebook. When running the 6 or 7th section of the notebook I encountered an error when using the machine learning libraries which I used a lot of the time in the lab. I don’t exactly remember what it was and since I have a usage limit I’m unable to look at the notebook and describe the error in greater detail.

Hi @adamparness726,

I just granted you an additional 4 hours to complete the course.
Let me know if you have any issues.

Best,
Tom

In the 7th section of machine learning section of the Data Science course when I try to run the code to fit to the data it results in this long error, also i apologize for using imgur i was unable to upload a photo directly:

Imgur


RuntimeError Traceback (most recent call last)
in

/opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/memory_utils.py in cupy_rmm_wrapper(*args, **kwargs)
54 def cupy_rmm_wrapper(*args, **kwargs):
55 with cupy_using_allocator(rmm.rmm_cupy_allocator):
—> 56 return func(*args, **kwargs)
57
58 return cupy_rmm_wrapper

/opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/dask/cluster/kmeans.py in fit(self, X)
139 for idx, wf in enumerate(data.worker_to_parts.items())]
140
→ 141 wait_and_raise_from_futures(kmeans_fit)
142
143 comms.destroy()

/opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/dask/common/utils.py in wait_and_raise_from_futures(futures)
152 “”"
153 wait(futures)
→ 154 raise_exception_from_futures(futures)
155 return futures
156

/opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/dask/common/utils.py in raise_exception_from_futures(futures)
142 if errs:
143 raise RuntimeError(“%d of %d worker jobs failed: %s” % (
→ 144 len(errs), len(futures), ", ".join(map(str, errs))
145 ))
146

RuntimeError: 4 of 4 worker jobs failed: Exception occured! file=/opt/conda/envs/rapids/conda-bld/libcuml_1598469299551/work/cpp/comms/std/src/cuML_std_comms_impl.cpp line=425: ERROR: NCCL call=‘ncclBroadcast(buff, buff, count, getNCCLDatatype(datatype), root, _nccl_comm, stream)’. Reason:invalid argument

Obtained 36 stack frames
#0 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9Exception16collectCallStackEv+0x3e) [0x7f97f6fb666e]
#1 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9ExceptionC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x71) [0x7f97f6fb71e1]
#2 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcumlcomms.so(_ZNK2ML24cumlStdCommunicator_impl5bcastEPviN8MLCommon16cumlCommunicator10datatype_tEiP11CUstream_st+0x19e) [0x7f9a7ea9e70e]
#3 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg18initKMeansPlusPlusIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsERNS_6TensorIT_Li2ET0_EERN8MLCommon11buffer_baseISA_NSE_15deviceAllocatorEEERNSF_IcSG_EE+0x682) [0x7f97f73ae442]
#4 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsEPKT_iiPS9_RS9_Ri+0x8e2) [0x7f97f73ac7a2]
#5 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitERKNS_10cumlHandleERKNS0_12KMeansParamsEPKfiiPfRfRi+0x59) [0x7f97f73a9be9]
#6 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/cluster/kmeans_mg.cpython-37m-x86_64-linux-gnu.so(+0xfc76) [0x7f98759b8c76]
#7 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallKeywords+0x15c) [0x5635be34aafc]
#8 in /opt/conda/envs/rapids/bin/python(+0x17f4e1) [0x5635be34b4e1]
#9 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x4802) [0x5635be392ef2]
#10 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x252) [0x5635be2e4db2]
#11 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x5635be303e3c]
#12 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x5635be3903a3]
#13 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x85d) [0x5635be2e53bd]
#14 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x5635be303e3c]
#15 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x5635be3903a3]
#16 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x5635be303b68]
#17 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x5635be3903a3]
#18 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x5635be304767]
#19 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5635be34b335]
#20 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x5635be38ed01]
#21 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x5635be303b68]
#22 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x5635be3903a3]
#23 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x5635be304767]
#24 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5635be34b335]
#25 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x5635be38ed01]
#26 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x5635be304767]
#27 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5635be34b335]
#28 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x5635be38ed01]
#29 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallDict+0x1b6) [0x5635be2e63a6]
#30 in /opt/conda/envs/rapids/bin/python(+0x12e8d1) [0x5635be2fa8d1]
#31 in /opt/conda/envs/rapids/bin/python(PyObject_Call+0x66) [0x5635be2e6ab6]
#32 in /opt/conda/envs/rapids/bin/python(+0x221423) [0x5635be3ed423]
#33 in /opt/conda/envs/rapids/bin/python(+0x1da567) [0x5635be3a6567]
#34 in /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f9aa611c6ba]
#35 in /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f9aa5e5241d]
, Exception occured! file=/opt/conda/envs/rapids/conda-bld/libcuml_1598469299551/work/cpp/comms/std/src/cuML_std_comms_impl.cpp line=425: ERROR: NCCL call=‘ncclBroadcast(buff, buff, count, getNCCLDatatype(datatype), root, _nccl_comm, stream)’. Reason:invalid argument

Obtained 36 stack frames
#0 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9Exception16collectCallStackEv+0x3e) [0x7f74a6fb666e]
#1 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9ExceptionC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x71) [0x7f74a6fb71e1]
#2 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcumlcomms.so(_ZNK2ML24cumlStdCommunicator_impl5bcastEPviN8MLCommon16cumlCommunicator10datatype_tEiP11CUstream_st+0x19e) [0x7f754187070e]
#3 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg18initKMeansPlusPlusIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsERNS_6TensorIT_Li2ET0_EERN8MLCommon11buffer_baseISA_NSE_15deviceAllocatorEEERNSF_IcSG_EE+0x682) [0x7f74a73ae442]
#4 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsEPKT_iiPS9_RS9_Ri+0x8e2) [0x7f74a73ac7a2]
#5 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitERKNS_10cumlHandleERKNS0_12KMeansParamsEPKfiiPfRfRi+0x59) [0x7f74a73a9be9]
#6 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/cluster/kmeans_mg.cpython-37m-x86_64-linux-gnu.so(+0xfc76) [0x7f75141bfc76]
#7 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallKeywords+0x15c) [0x565102c07afc]
#8 in /opt/conda/envs/rapids/bin/python(+0x17f4e1) [0x565102c084e1]
#9 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x4802) [0x565102c4fef2]
#10 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x252) [0x565102ba1db2]
#11 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x565102bc0e3c]
#12 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x565102c4d3a3]
#13 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x85d) [0x565102ba23bd]
#14 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x565102bc0e3c]
#15 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x565102c4d3a3]
#16 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x565102bc0b68]
#17 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x565102c4d3a3]
#18 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x565102bc1767]
#19 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x565102c08335]
#20 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x565102c4bd01]
#21 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x565102bc0b68]
#22 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x565102c4d3a3]
#23 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x565102bc1767]
#24 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x565102c08335]
#25 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x565102c4bd01]
#26 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x565102bc1767]
#27 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x565102c08335]
#28 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x565102c4bd01]
#29 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallDict+0x1b6) [0x565102ba33a6]
#30 in /opt/conda/envs/rapids/bin/python(+0x12e8d1) [0x565102bb78d1]
#31 in /opt/conda/envs/rapids/bin/python(PyObject_Call+0x66) [0x565102ba3ab6]
#32 in /opt/conda/envs/rapids/bin/python(+0x221423) [0x565102caa423]
#33 in /opt/conda/envs/rapids/bin/python(+0x1da567) [0x565102c63567]
#34 in /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f77580166ba]
#35 in /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f7757d4c41d]
, Exception occured! file=/opt/conda/envs/rapids/conda-bld/libcuml_1598469299551/work/cpp/comms/std/src/cuML_std_comms_impl.cpp line=425: ERROR: NCCL call=‘ncclBroadcast(buff, buff, count, getNCCLDatatype(datatype), root, _nccl_comm, stream)’. Reason:invalid argument

Obtained 36 stack frames
#0 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9Exception16collectCallStackEv+0x3e) [0x7f2612fb666e]
#1 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9ExceptionC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x71) [0x7f2612fb71e1]
#2 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcumlcomms.so(_ZNK2ML24cumlStdCommunicator_impl5bcastEPviN8MLCommon16cumlCommunicator10datatype_tEiP11CUstream_st+0x19e) [0x7f28ae49d70e]
#3 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg18initKMeansPlusPlusIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsERNS_6TensorIT_Li2ET0_EERN8MLCommon11buffer_baseISA_NSE_15deviceAllocatorEEERNSF_IcSG_EE+0x682) [0x7f26133ae442]
#4 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsEPKT_iiPS9_RS9_Ri+0x8e2) [0x7f26133ac7a2]
#5 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitERKNS_10cumlHandleERKNS0_12KMeansParamsEPKfiiPfRfRi+0x59) [0x7f26133a9be9]
#6 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/cluster/kmeans_mg.cpython-37m-x86_64-linux-gnu.so(+0xfc76) [0x7f26b004fc76]
#7 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallKeywords+0x15c) [0x5585603d5afc]
#8 in /opt/conda/envs/rapids/bin/python(+0x17f4e1) [0x5585603d64e1]
#9 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x4802) [0x55856041def2]
#10 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x252) [0x55856036fdb2]
#11 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x55856038ee3c]
#12 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55856041b3a3]
#13 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x85d) [0x5585603703bd]
#14 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x55856038ee3c]
#15 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55856041b3a3]
#16 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x55856038eb68]
#17 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55856041b3a3]
#18 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55856038f767]
#19 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5585603d6335]
#20 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x558560419d01]
#21 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x55856038eb68]
#22 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55856041b3a3]
#23 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55856038f767]
#24 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5585603d6335]
#25 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x558560419d01]
#26 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55856038f767]
#27 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x5585603d6335]
#28 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x558560419d01]
#29 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallDict+0x1b6) [0x5585603713a6]
#30 in /opt/conda/envs/rapids/bin/python(+0x12e8d1) [0x5585603858d1]
#31 in /opt/conda/envs/rapids/bin/python(PyObject_Call+0x66) [0x558560371ab6]
#32 in /opt/conda/envs/rapids/bin/python(+0x221423) [0x558560478423]
#33 in /opt/conda/envs/rapids/bin/python(+0x1da567) [0x558560431567]
#34 in /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f28c5b6a6ba]
#35 in /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f28c58a041d]
, Exception occured! file=/opt/conda/envs/rapids/conda-bld/libcuml_1598469299551/work/cpp/comms/std/src/cuML_std_comms_impl.cpp line=425: ERROR: NCCL call=‘ncclBroadcast(buff, buff, count, getNCCLDatatype(datatype), root, _nccl_comm, stream)’. Reason:invalid argument

Obtained 36 stack frames
#0 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9Exception16collectCallStackEv+0x3e) [0x7f7990fb666e]
#1 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN8MLCommon9ExceptionC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x71) [0x7f7990fb71e1]
#2 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcumlcomms.so(_ZNK2ML24cumlStdCommunicator_impl5bcastEPviN8MLCommon16cumlCommunicator10datatype_tEiP11CUstream_st+0x19e) [0x7f7c0a5c470e]
#3 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg18initKMeansPlusPlusIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsERNS_6TensorIT_Li2ET0_EERN8MLCommon11buffer_baseISA_NSE_15deviceAllocatorEEERNSF_IcSG_EE+0x682) [0x7f79913ae442]
#4 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitIfiEEvRKNS_15cumlHandle_implERKNS0_12KMeansParamsEPKT_iiPS9_RS9_Ri+0x8e2) [0x7f79913ac7a2]
#5 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/common/…/…/…/…/libcuml++.so(_ZN2ML6kmeans3opg3fitERKNS_10cumlHandleERKNS0_12KMeansParamsEPKfiiPfRfRi+0x59) [0x7f79913a9be9]
#6 in /opt/conda/envs/rapids/lib/python3.7/site-packages/cuml/cluster/kmeans_mg.cpython-37m-x86_64-linux-gnu.so(+0xfc76) [0x7f7a2c0a5c76]
#7 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallKeywords+0x15c) [0x55ea1a590afc]
#8 in /opt/conda/envs/rapids/bin/python(+0x17f4e1) [0x55ea1a5914e1]
#9 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x4802) [0x55ea1a5d8ef2]
#10 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x252) [0x55ea1a52adb2]
#11 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x55ea1a549e3c]
#12 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55ea1a5d63a3]
#13 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalCodeWithName+0x85d) [0x55ea1a52b3bd]
#14 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x3ec) [0x55ea1a549e3c]
#15 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55ea1a5d63a3]
#16 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x55ea1a549b68]
#17 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55ea1a5d63a3]
#18 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55ea1a54a767]
#19 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x55ea1a591335]
#20 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x55ea1a5d4d01]
#21 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallDict+0x118) [0x55ea1a549b68]
#22 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x1cb3) [0x55ea1a5d63a3]
#23 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55ea1a54a767]
#24 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x55ea1a591335]
#25 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x55ea1a5d4d01]
#26 in /opt/conda/envs/rapids/bin/python(_PyFunction_FastCallKeywords+0x187) [0x55ea1a54a767]
#27 in /opt/conda/envs/rapids/bin/python(+0x17f335) [0x55ea1a591335]
#28 in /opt/conda/envs/rapids/bin/python(_PyEval_EvalFrameDefault+0x611) [0x55ea1a5d4d01]
#29 in /opt/conda/envs/rapids/bin/python(_PyObject_FastCallDict+0x1b6) [0x55ea1a52c3a6]
#30 in /opt/conda/envs/rapids/bin/python(+0x12e8d1) [0x55ea1a5408d1]
#31 in /opt/conda/envs/rapids/bin/python(PyObject_Call+0x66) [0x55ea1a52cab6]
#32 in /opt/conda/envs/rapids/bin/python(+0x221423) [0x55ea1a633423]
#33 in /opt/conda/envs/rapids/bin/python(+0x1da567) [0x55ea1a5ec567]
#34 in /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f7c41cc36ba]
#35 in /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f7c419f941d]

Hi @adamparness726,

Sorry, but I cannot troubleshoot your code, I can only adjust your course completion time.