Only tested on 1.14x, but with the new boats, if you place  them extremely close to walls and push them towards said wall, the collision will bug and the boat will be able to phase through the wall.