If he beats Rodgers in the NFC Championship game, and then Brady in the Superbowl. It would be hard to argue even if he has 4-5 average seasons the rest of his career. He will probably be the first HOF that is not in the top 10 of any category in the All-time passing list, but will have a decent winning record.
Since all we do is argue about rings and completely disregard the regular season, I don't see why he won't get in.