Are you sure you hate goat milk? I have read that people don't really know goat milk until they try it from a farm, and everyone thinks they hate it but then don't. Of course, I have never had just milk from a goat, only goat cheese, so I don't know if it's true.
You could make goat cheese and sell it to people who do like it. Or just the milk, people do buy it. They only make milk if you consistently impregnate them though, and they need a cool-down period between giving birth and being human-ready milkers. You don't want to try to drink the milk too early, that is when it tastes all bleh!
So, goats make dairy whether it is for you or to sell, but needs to be kidding every year to make milk. Sheep give wool regardless of baby-status, right?
razz But goats come in much smaller sizes, as far as I know, so they could be easier to care for in general.
Also, these goats look like sheep:
http://www.angoragoat.com/They give hair, so if you find that goat feeding and pooping fits in better with your gardening needs than sheep feeding and pooping, but you want the hair, these guys have it!
I don't know which of chickens or ducks would work best, but I think most of the duck poop ends up in the pond, doesn't it? It's probably a bit more convenient to use the poop from chickens, unless you want to scoop up poopy water.