In adventure mode you can still break note blocks

I punched a note block in adventure mode expecting it to play a sound but instead block destruction cracks appeared.

Steps to Reproduce:
1. Place a noteblock
2. /gamemode 2
3. puch noteblock