There's a bug that when you get slower while flying with an elytra, you take fall damage or you instantly die (I don't really know). In my example, I got slower until I traveled 5 blocks/second, but I still died with full hearts. I hope you'll fix this issue.