Retail CPUs that come with heat sinks normally come with thermal paste pre-applied. OEM processors (no heat sink) may or may not. Either way, It's a good idea to have some available since if you ever remove the heat sink after it's come into contact with the processor, you'll need to remove the paste and re-apply it.
-Wolf sends