Recruitment is a time-consuming process, and AI systems are increasingly being used to support the decision-making process. However, machine learning models used in such systems can inherit bias if the underlying training data reflects biased human preferences. It is essential to analyze and quantify these biases in order to develop fairer AI systems. To address this issue, we collected human judgments of colleague preference for 2200 face images. The face image set includes images of different ethnicities and genders, as well as both real and synthetically generated faces. The images were annotated by humans from diverse backgrounds in terms of age, gender, and ethnicity. Annotators were shown series of pairs of face images and asked to select which individual they would prefer as a colleague. We gathered responses from 451 annotators and aggregated the annotations to compute a preference score for each image. This dataset provides a basis for understanding human bias in colleague preference and can support the development of fair and unbiased AI models for use in recruitment settings.
Krishnareddy et al. (Fri,) studied this question.