http://www.cgtextures.com/ is pretty much mandatory for everyone who wants to develop their own textures, its great source for textures and inspiration. And it is getting better all the time.
Another site, but not as good as the one mentioned above, http://amazingtextures.com
I used to visited that site a lot before GCtextures.
The same goes for http://mayang.com/textures/
Gimp is a good program and it is free, but if you are a student and it would possible to get Adobe Creative Suite on a students-license than i would say go for it, spend the money, because it will be well worth it.