Well unfortunately there isn't an obvious culprit here. Skype is using a little more, uTorrent a little less.
As for Chrome, I wasn't suggesting it was a problem, I was just using it as an example of what was eating my memory. However I don't have a memory leak, my memory usage stays pretty static.
So back to your issue. This may take some trial and error. The easiest thing to do, is boot your computer up and don't launch anything, just let it sit. If the memory usage starts to creep up with time, then you know it's one of your startups or background tasks. If it doesn't, then it's likely a program that you regularly use.
With the results of this test, then you need to start eliminating possibilities. I think it's likely something that starts with you computer versus something that you launch and run and close on your own. In this case there are two ways to handle the startups, either remove them one by one testing each time to see if the leak is gone, or stop them all. The upside to stopping them all is that on the first test, you'll know if you are on the right track. Then you'd add them back one by one until the leak returns.
I might start with your P2P software, uTorrent.