I guess you just proved Romney's point. The people who are going to get all jazzed up about this stuff aren't going to vote for him anyway.
That's not the point. It's the fact that he says that he doesn't care about them that people are in an uproar about. Hey, I'll give the guy credit for being honest about how he feels, but isn't it the job of the President to "care" about the entire country and not just those who his ideology speaks to and who vote for him? "And so my job is not to worry about those people." So, he only worries about people who are living better? As Linda McMahon said in her response to the video (and I get that she's running in a very blue state) that the majority of people on the take from the gov't don't want to be in that position, but are forced to because of the hand they've been dealt.
That's what's so interesting as to how the right is reiterating the Obama quote about a segment of the right "clinging to guns and religion". They don't play the full quote, where he goes on to say that he still cares about them despite the differences in that respect. The entire Romney video is out now and nothing is taken out of context or made into a soundbite (which both sides of the media hammered Obama for in 2008).