I've always had compliments on how I taste and still a smoker. As for the wimmenz, it's more about hygiene IMHO.
Swiped from the interwebz: Macrobiotic nutritionists have actually done research on this question, and the answer is: you are what you eat. Common sense dictates that if you taste good, your lover will want to eat you more often, so improving your body's taste and smell should be important to you.
Sweet, acidic substances supposedly show up as a sweetish taste in semen, but it's what you haven't eaten, drunk, or otherwise consumed that makes the biggest difference.
The perfect recipe goes something like this: plenty of water, little dairy, no caffeine (or cocaine, or similar, bitter alkaloids), no smoking. Another huge factor in semen taste is alcohol consumption and smoking. If you smoke, your semen taste may reflect that.
If you think this sounds a good deal like your doctor's (or mother's) prescription for a long and healthy life, you're right, but it's just a coincidence.
In general, nutritionists say that alkaline-based foods such as meats and fish produce a bitter, fish taste.
Dairy products, which contain a high bacterial putrefaction level create the foulest tasting fluids by far. (Dissent: almost everyone I know says that there is one worse than a high-dairy content - asparagus. You can't miss the taste of asparagus-laced semen.)
Acidic fruits, such as sweets, and fruits give bodily fluids a pleasant, sugary flavor.
Chemically processed liquors will cause an extremely acidic taste, however, so if you're going to drink alcohol, drink high-quality, naturally fermented beers (Rolling Rock or Kirin) or sake. Alcohol especially can make your semen extremely bitter. You may want to try cutting out the hard liquor for a week or two and see if that helps.