Stack overrun bug in directX 12 driver

user112593 · March 31, 2023, 1:04pm

I found a bug on the latest DirectX 12 drivers where clearing more than 32 rectangles with a single draw call crashes the application.

sample code here:

github.com

badasahog/Windows-API-Examples/blob/main/Direct3D12.c#L434


      
          		ID3D12GraphicsCommandList_ClearRenderTargetView(CommandList, rtv, black, 0, NULL);
          
          
		if (totalRects > 0)
          		{
          			for (int i = 0; i < (totalRects / 32); i++)
          				ID3D12GraphicsCommandList_ClearRenderTargetView(CommandList, rtv, clearColor, 32, &rects[i * 32]);
          
          
			ID3D12GraphicsCommandList_ClearRenderTargetView(CommandList, rtv, clearColor, totalRects % 32 + 1, &rects[totalRects - (totalRects % 32 + 1)]);
          			
          			//alternate form (causes crashes):
          			ID3D12GraphicsCommandList_ClearRenderTargetView(CommandList, rtv, clearColor, totalRects, rects);
          		}
          
          
		if (dragActive)
          			ID3D12GraphicsCommandList_ClearRenderTargetView(CommandList, rtv, clearColor, 1, &dragRectCorrected);
          		
          		D3D12_RESOURCE_BARRIER ResourceBarrier2 = { 0 };
          		ResourceBarrier2.Type = D3D12_RESOURCE_BARRIER_TYPE_TRANSITION;
          		ResourceBarrier2.Flags = D3D12_RESOURCE_BARRIER_FLAG_NONE;
          		ResourceBarrier2.Transition.pResource = BackBuffers[CurrentBackBufferIndex];
          		ResourceBarrier2.Transition.StateBefore = D3D12_RESOURCE_STATE_RENDER_TARGET;

MarkusHoHo · April 5, 2023, 2:02pm

Hello @user112593 and welcome to the NVIDIA developer forums!

Thank you for bringing this to our attention.

Can you possibly also share the complete output of DxDiag.exe?

And if you have, a stack trace of the crash.

That would help a lot!

Thanks!

Topic		Replies	Views
Stack overflow when calling ID3D11DeviceContext1::ClearView with more than 16 rectangles DirectX, DXR, DirectCompute	0	828	July 17, 2017
DirectX 12 Nvidia driver crash DirectX, DXR, DirectCompute	1	2809	December 28, 2016
D3D12 driver is crashing when a compute shader is executed with a power of 2 numthreads DirectX, DXR, DirectCompute	0	4223	June 13, 2017
DirectDraw crash in nvd3dumx.dll DirectX, DXR, DirectCompute	0	2207	May 17, 2017
DirectX 12 - ShapDX - Texture problem. DirectX, DXR, DirectCompute	1	1461	December 5, 2019
Crash in simple Direct Compute sample DirectX, DXR, DirectCompute	0	1645	June 20, 2016
Driver crashes when interoperating with D3D render target texture CUDA Programming and Performance	2	1944	May 14, 2009
VXGI crash when used with DX12 DirectX, DXR, DirectCompute	0	1070	March 9, 2017
D3D12 bug with SRV DirectX, DXR, DirectCompute	2	1959	January 24, 2017
DirectX11 crash on Nvidia VGA DirectX, DXR, DirectCompute ffmpeg , directx-11	3	1401	May 16, 2022

Stack overrun bug in directX 12 driver

Related topics