First off, upgrading the ram to 4gb is pointless because he is using a 32-bit operating system. At MOST, the system will only recognize and use, 3gb, and even then, for an everyday, average user, 3gb is overkill.
Second, a 10000RPM hard drive is a glorious waste of money for any everyday user, and is typically a waste even in the gaming world. You want a drive with a known, good platter design, the RPM it spins at means nothing for the typical user. One of the highest rated drives on the market is the 640GB Western Digital Caviar Black(it's a 7200RPM drive, not 10000RPM). This particular drive utilizes an awesome dual platter design, and typically scores higher than Western Digital's Raptor drives. Such high-speed spinning drives only start to show their worth in high-end servers running in RAID 5 or higher setups, which are utilizing five or more hard drives. I can 110% guarantee you, I can spend half of what anyone spends on ONE 10000RPM drive, and end up three times more storage space, and TWICE the performance. 10000RPM drives are nothing more than gimmicks for Hard Drive companies to make money off of regular users.
For this system, a cheap 2GB memory kit, and one 640GB Caviar Black is really all it needs. These two upgrades will definitely show you a HUGE improvement.
Here is a link to the Caviar Black:
http://www.newegg.com/Product/Product.aspx?Item=N82E16822136319. Now, this is currently the absolute best bang for the buck in the hard drive world, however, you do not need to spend that much, and don't really need the performance this drive offers. I am personally using a Caviar Blue in one of my machines, and its an excellent drive for the price. I'm using the 500GB version:
http://www.newegg.com/Product/Product.aspx?Item=N82E16822136073
As for the memory, any 2x 1GB stick setup will do the job. However, I'd recommend some OCZ memory. For one, they are well known in the memory world, and also offer an EXCELLENT lifetime warranty on all of their memory. Here is what I would go with for your system:
http://www.newegg.com/Product/Product.aspx?Item=N82E16820227124
No matter what you do, you are looking at least $100 in upgrades, to at least NOTICE the difference.