Steps to reproduce:

1: Go to the worldborder.

2: Place a piston 1 block before the worldborder.

3: Place a block that is broken by pistons.

4: Activate the piston.

5: The item that it has broken is now beyond the worldborder.