I say keep it, but move the ball to the 1 yard-line.
Why make a PAT shorter? Because it also makes the 2-point conversion closer and more attractive to try.
Keep the 1 and 2 point options, but make the 2 not only possible with a run (they're almost always pass attempts from 2 yards out) but also more frequent. This would make things more exciting.
It would make the PAT kick a yard shorter and it would also enrage us more when one is shanked. All the more reason to do it.
I also have had the thought...
FGs <39 yards = 3 pts
FGs 40-49 yds = 4 pts
FGs 50+ yds = 5 pts
The 5-point kick seems like overkill, so maybe just 4 pts for 50+ would suffice.