i am not sure what a butterfish is. would be great if you could post a photo of them.
4-5m visibility is pretty lousy. i have had a lot better in port phillip. You would probably get better visbility toward the southern end of the bay. though the current may be greater (depending on where you go) and more care may be needed. It has been pretty windy lately and i guess that did not help things.