Historically, the people who are most excluded and are also the most likely to be branded ‘lazy’