Yup, in full sun I usually drop right to ISO100. As you know by now there are many things that contribute to a good exposure, but one thing that is overlooked is setting your white balance to the current conditions. You'll get much more realistic fish colours if you select a WB other than auto white balance.
WB = Daylight
WB = Cloudy
Now show me some of your fishing spots! lol