Let me ask you something, Rock---is this your natural pitching delivery, or did some nitwit coach tell you to do that? Somehow I suspect that the latter is the case here, and trying to throw from such an awkward position can do nothing but injure your arm and shoulder. It falls into the same category as the coach who insists that a pitcher throw "over the top" all the time in spite of the fact that this might not be the kid's natural motion.
I had an incredible pitching coach years ago. He was an active major-league pitcher, one of the Yankees' Big Three, and he doubled as an extra pitching coach for the team. He had this basic tenet that every pitcher has a natural motion, and so what he would do would be to show said pitcher how to make the most of it. I was a natural sidearmer, and he helped me take full advantage of this delivery.
Now, i don't know what your natural motion might be---it might be a 3/4 or a sidearm motion---but I would strongly recommend that you drop that elbow so it's no higher than your shoulder, and take a look at your arm angle, how you deliver the pitch. Just doing that one little thing is sure to take a lot of pressure off. Give it a try and see what happens.