It depends on how heavily the ESCs will be used. If they will be run constantly, then they will probably need cooling. If they are only used occasionally, then they may not. For example, on the BlueROV2 the thrusters are usually not running most of the time, so the ESCs are fine.
For most boat applications I would recommend cooling because you're generally running constantly.