There's a good page on ways to remove it, and if you look around online you can find a reverse osmosis system for around 200-300 dollars that will
hook up to your water line, and provide water for drinking and running to the fridge if you have an icemaker / water dispenser.