Depends on what you want. Not to costly is quite relative, cheapest HiFi is around 1200 euro (expensive HiFi around 100000)
0-100 euro: Go to a local computer shop and pick up some good looking stereo speakers. Don't look at fancy certificates, and don't go for the biggest subwoofer. The bass may sound nice at first sight, but it's irritating to have a sloppy bas beat which sounds the same with all songs.
100-400 euro: Don't know anything in this range, ask others.
400-1000 euro: Now you're spending this much, add another 200 euro to get some good speakers. You don't want to spend 1000 euro's on something you don't really like. You may want to take a look at the active Dynaudio speakers. They are HiFi and don't need an amp.
1200 euro: Get the Rotel RA-05 amplifier and two B&W 685 speakers. Attach them to your mac for the best sound you've ever heard through computer speakers, and to a CD player for even better sound (DAC of a Mac is bad, which is a bottleneck)
1200 - more euro: Go to your local HiFi shop, ask for a cup of coffee and start listening. You'll find something nice
Some other important things:
- IGNORE Bose speakers. They are expensive and only relatively good for home cinema purposes (= movies), music always sounds bad, or way worse than with HiFi speakers of the same price class.
- IGNORE Yamo speakers. They produce way to much bass, which may sound poppy in the beginning. but is irritating because it isn't what the artist wanted you to hear. Also, it's a cover for the bad high and mids.
- Don't buy 5.1, 7.1 or 5^456.1 speakers sets! You don't need 7 speakers to listen to STEREO music. Also, why pay for 7 bad speakers? You don't get a better quality by adding a speakers. Buy 2 good ones instead. You also don't need a subwoofer. Subwoofers are there to produce a good BANG during movies. They can't produce detailed low sounds in music, and will sound bad, sloppy and irritating.