The arrow will look like it stops on top of the fence but it keeps going. You can tell if you pit a wooden button where is should end up connected to a command block with a say command.