It seems that the public is over reacting based on two things. Brady owns Manning, Manning couldn't even win with a 24 point lead, so why would Manning win now? I actually think the Chargers were a much tougher opponent then the Pats.
I expect this game to be a shootout with Denver having the complete edge. The Patriots strength is their running game while the Broncos run D is where they are best at. The last time these teams played the Broncos basically shut down the Patriots run game shutting the entire team down to 116 yards, I expect them to do the same again. The Broncos will force the Patriots to pass. While the loss of Chris Harris might be huge, Rodgers-Comartie did not play in the 2nd half of that Patriots win so Brady was able to exploit a hole in that secondary with the over size Gronk. Having DRC and a washed up Champ Bailey, should be sufficient to cover the Patriot receiving corps that scares nobody. The Broncos Defense will be more than good enough to contain the Patriots offense to 24 points or less.
As for the Broncos offense, I'm expecting Denver to light that Patriots secondary up like a Christmas tree. Andrew Luck had his way with that secondary with less weapons, but offset his brilliance with picks. Manning will not throw 4 picks in this game. The Patriots also did not have to deal with Julius Thomas the first time, and he was clutch in the Chargers game. I expect Julius Thomas to come up big again. The Patriots defense this time will not have the home crowd and the icy cold windy conditions to aid them this time. I expect Peyton Manning to come out loose and confident in this game, now that he's got that one and done talk out of the way. The highest scoring offense in NFL history will show up on Sunday.
My Prediction Broncos win 38-24.