Ha Long Bay is a magical place. Yes there are too many boats and yes the pollution is an issue. But get away from the port or Cat Ba island and it is much nicer.
I tend to do 2 night tours and head for Bai Tu Long Bay just a bit north. The boats still leave from the same harbor.
