When an arrow is shot at a surface it falls 'bounces' out.
Then when you get close to it, it snaps back to the proper place but is pointing almost straight down.

To Reproduce:
1) Creative Mode (I don't know about the others)
2) Shoot bow at a surface
3) Some arrows are not at the correct angle when stuck in a block or they are not in the block at all