No..
but maybe, What he was trying to say is,
Some people who are on top of our society, they only see other people as far lower level than them.

and for those who are less fortunate, they are just being looked down by those who are more fortunate.