Flywheel Removal

I have an oil leak behind the flywheel and I am trying to take it off.

As you can see, I got the bolts and locking nuts off but when I try to pull off the wheel it hits something and wont come off. I think the shaft is tapered at the end to keep the flywheel from coming off.

Any suggestions?