Too many chunks allocated, memory of size xyz not available. Error code: GXF_EXCEEDING_PREALLOCATED_SIZE

If you are encountering the following error

Too many chunks allocated, memory of size xyz not available. 
Error code: GXF_EXCEEDING_PREALLOCATED_SIZE

The error likely comes from BlockMemoryPool when it doesn’t have enough blocks available. There are two things to try:
(1) If you have a shared pool across multiple operators block_pool = make_shared<BlockMemoryPool>(...);, use independent block memory pool objects for each operator.
(2) Increase the number of blocks in the memory pool by increasing the block_size and/or num_blocks parameter.

1 Like