Is it possible to divide device memories into smaller pieces.

I am experimenting something, I need to divide the computing elements into smaller chunks, and I guess I can do this with the new SDKs, also I need to divide the memory into smaller chunks as well, is it possible in NVIDIA?