For buying a handset, there's also a famous UK shop called Argos who are actually a catalog retailer. They have stores in several town centers. They always have really ridiculous offers on cheap phones. I just had a look and they have them starting at GBP4.99 at the moment:
Cheapest Mobile phones at Argos