What I expected to happen was:
A frame without an item (destroying it in a creative or falling out in survival)

What actually happened was:
The item remains framed and cannot be removed.

Steps to Reproduce:
1. Put a frame
2. Put an item in a frame
3. Destroy / remove item

In the screenshot you can see how the blow is struck on the frame with your hand (the attack indicator began to fill up next to the inventory, which indicates that the strike was carried out), but the object remains in it.