Getting started in gpu programming

I want to learn how to program a gpu/video card, I don’t know how many aspects in video card programming there is. So need some help.

What platform are you on?
If you are on windows and you have Visual Studio installed you can download and install the latest NVidia development kits. Installing the latter should enable you to create CUDA projects from within Visual Studio. In fact the default project code is a ready to compile application that demonstrates parallel vector addition.
You could buy Cuda by Example, it’s fairly good, but there are lots of tutorials on Youtube.

You might consider this course on Udacity: https://www.udacity.com/course/cs344. This course along with several other resources are on the developer resources page: https://developer.nvidia.com/resources.