Answers are grounded in this paper and cite their sources.
We analyze the Stanford Natural Language Inference (SNLI) corpus in an investigation of bias and stereotyping in NLP data. The human-elicitation protocol employed in the construction of the SNLI makes it prone to amplifying bias and stereotypical associations, which we demonstrate statistically (using pointwise mutual information) and with qualitative examples.
No takes yet. Share an insight, caveat, or question.
Rudinger et al. (2017) studied this question.