The GPU is just one big fat processor, but it is programmable, unlike a regular CPU that has predetermined areas for certain functions. A CUDA core can be programmed to do anything the programmer wants it to do. Like a video encoding software can use all of the cores and optimize them for encoding video. A video game will use some of the cores for texture processing, some for physics calculations, etc.
yes they are important for the performance of a video card