Error using RAPIDS through WLS2 and CUDA 12

Accelerated Computing CUDA CUDA on Windows Subsystem for Linux
1

Hi,

Once I have installed RAPIDS for WLS2 I am getting an error running these python lines:

import cudf
print(cudf.Series([1, 2, 3]))

"
Traceback (most recent call last):
File “/home/vicmen/.local/lib/python3.10/site-packages/cudf/core/column/column.py”, line 2210, in as_column
memoryview(arbitrary), dtype=dtype, nan_as_null=nan_as_null
TypeError: memoryview: a bytes-like object is required, not ‘list’

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “”, line 1, in
File “/home/vicmen/.local/lib/python3.10/site-packages/nvtx/nvtx.py”, line 101, in inner
result = func(*args, **kwargs)
File “/home/vicmen/.local/lib/python3.10/site-packages/cudf/core/series.py”, line 584, in init
data = column.as_column(
File “/home/vicmen/.local/lib/python3.10/site-packages/cudf/core/column/column.py”, line 2326, in as_column
data = as_column(
File “/home/vicmen/.local/lib/python3.10/site-packages/cudf/core/column/column.py”, line 1976, in as_column
col = ColumnBase.from_arrow(arbitrary)
File “/home/vicmen/.local/lib/python3.10/site-packages/cudf/core/column/column.py”, line 374, in from_arrow
result = libcudf.interop.from_arrow(data)[0]
File “interop.pyx”, line 178, in cudf._lib.interop.from_arrow
RuntimeError: Fatal CUDA error encountered at: /__w/cudf/cudf/cpp/src/bitmask/null_mask.cu:93: 801 cudaErrorNotSupported operation not supported
"

Environment:
Windows 10 22H2
NVIDIA GeForce GTX 1050 Ti, Driver Version: 536.67, CUDA Version: 12.2
WLS2 distro: Ubuntu 22.04
Rapids 23.06 for CUDA 12 (pip install)
Python 3.10

Thanks in advance

1 Like
2

I have the same problem.

Device 0: "Quadro P620"
  CUDA Driver Version / Runtime Version          12.2 / 12.3
  CUDA Capability Major/Minor version number:    6.1
  Total amount of global memory:                 2048 MBytes (2147352576 bytes)
  (004) Multiprocessors, (128) CUDA Cores/MP:    512 CUDA Cores
  GPU Max Clock rate:                            1354 MHz (1.35 GHz)
  Memory Clock rate:                             2505 Mhz
  Memory Bus Width:                              128-bit
  L2 Cache Size:                                 524288 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total shared memory per multiprocessor:        98304 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 5 copy engine(s)
  Run time limit on kernels:                     Yes
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Disabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Managed Memory:                Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      No
  Device PCI Domain ID / Bus ID / location ID:   0 / 1 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

Traceback (most recent call last):
  File "/mnt/d/TwinProject/QuantResearch/plib/research_qlib/run_workflow.py", line 55, in <module>
    run_cudf()
  File "/mnt/d/TwinProject/QuantResearch/plib/research_qlib/run_workflow.py", line 33, in run_cudf
    print(pd.Series([1, 2, 3]))
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/site-packages/nvtx/nvtx.py", line 115, in inner
    result = func(*args, **kwargs)
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/site-packages/cudf/core/series.py", line 602, in __init__
    data = column.as_column(
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/site-packages/cudf/core/column/column.py", line 2469, in as_column
    data = as_column(
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/site-packages/cudf/core/column/column.py", line 1995, in as_column
    col = ColumnBase.from_arrow(arbitrary)
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/site-packages/cudf/core/column/column.py", line 379, in from_arrow
    result = libcudf.interop.from_arrow(data)[0]
  File "/root/miniconda3/envs/wsl_py39/lib/python3.9/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "interop.pyx", line 199, in cudf._lib.interop.from_arrow
RuntimeError: Fatal CUDA error encountered at: /opt/conda/conda-bld/work/cpp/src/bitmask/null_mask.cu:93: 801 cudaErrorNotSupported operation not supported

It take me a lot of time to install, uninstall, install again. But now, give up?

3

In [1]: import cudf

In [2]: print(cudf.Series([1, 2, 3]))

TypeError Traceback (most recent call last)
File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/cudf/core/column/column.py:2306, in as_column(arbitrary, nan_as_null, dtype, length)
2304 try:
2305 data = as_column(
→ 2306 memoryview(arbitrary), dtype=dtype, nan_as_null=nan_as_null
2307 )
2308 except TypeError:

TypeError: memoryview: a bytes-like object is required, not ‘list’

During handling of the above exception, another exception occurred:

RuntimeError Traceback (most recent call last)
Cell In[2], line 1
----> 1 print(cudf.Series([1, 2, 3]))

File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/nvtx/nvtx.py:115, in annotate.call..inner(*args, **kwargs)
112 @wraps(func)
113 def inner(*args, **kwargs):
114 libnvtx_push_range(self.attributes, self.domain.handle)
→ 115 result = func(*args, **kwargs)
116 libnvtx_pop_range(self.domain.handle)
117 return result

File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/cudf/core/series.py:602, in Series.init(self, data, index, dtype, name, copy, nan_as_null)
584 if not isinstance(data, ColumnBase):
585 # Using getattr_static to check if
586 # data is on device memory and perform
(…)
592 # be expensive or mark a buffer as
593 # unspillable.
594 has_cai = (
595 type(
596 inspect.getattr_static(
(…)
600 is property
601 )
→ 602 data = column.as_column(
603 data,
604 nan_as_null=nan_as_null,
605 dtype=dtype,
606 length=len(index) if index is not None else None,
607 )
608 if copy and has_cai:
609 data = data.copy(deep=True)

File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/cudf/core/column/column.py:2469, in as_column(arbitrary, nan_as_null, dtype, length)
2455 if (
2456 isinstance(arbitrary, pd.Index)
2457 and arbitrary.dtype == cudf.dtype(“object”)
(…)
2464 )
2465 ):
2466 raise MixedTypeError(
2467 “Cannot create column with mixed types”
2468 )
→ 2469 data = as_column(
2470 pyarrow_array,
2471 dtype=dtype,
2472 nan_as_null=nan_as_null,
2473 )
2474 except (pa.ArrowInvalid, pa.ArrowTypeError, TypeError) as e:
2475 if isinstance(e, MixedTypeError):

File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/cudf/core/column/column.py:1995, in as_column(arbitrary, nan_as_null, dtype, length)
1989 if isinstance(arbitrary, pa.lib.HalfFloatArray):
1990 raise NotImplementedError(
1991 "Type casting from float16 to float32 is not "
1992 "yet supported in pyarrow, see: "
1993 “[ARROW-3802] [C++] Cast to/from halffloat not implemented - ASF JIRA”
1994 )
→ 1995 col = ColumnBase.from_arrow(arbitrary)
1997 if isinstance(arbitrary, pa.NullArray):
1998 if dtype is not None:
1999 # Cast the column to the dtype if specified.

File ~/miniconda3/envs/wsl_py310/lib/python3.10/site-packages/cudf/core/column/column.py:379, in ColumnBase.from_arrow(cls, array)
376 elif isinstance(array.type, ArrowIntervalType):
377 return cudf.core.column.IntervalColumn.from_arrow(array)
→ 379 result = libcudf.interop.from_arrow(data)[0]
381 return result._with_type_metadata(cudf_dtype_from_pa_type(array.type))

File ~/miniconda3/envs/wsl_py310/lib/python3.10/contextlib.py:79, in ContextDecorator.call..inner(*args, **kwds)
76 @wraps(func)
77 def inner(*args, **kwds):
78 with self._recreate_cm():
—> 79 return func(*args, **kwds)

File interop.pyx:199, in cudf._lib.interop.from_arrow()

RuntimeError: Fatal CUDA error encountered at: /opt/conda/conda-bld/work/cpp/src/bitmask/null_mask.cu:93: 801 cudaErrorNotSupported operation not supported