The evidence behind the guides

Sources

Find a study, check what it supports, and follow it back to a concern.

TopicCollection

Sources for Cultural bias in annotation guidelines

2 sources

Guide citations are still under editorial review.

Barbara Plank · EMNLP 2022 Research position paper

The Problem of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation (original source, new tab)

Explains why human disagreement can contain useful information rather than merely label noise.

Santurkar and colleagues · ICML 2023 Research study

Whose Opinions Do Language Models Reflect? (original source, new tab)

Compares model responses with US public-opinion groups. It does not isolate training data as the sole cause of differences.

Sources retain their original publishers’ rights. Inclusion does not imply endorsement. Saved sources stay in this browser on this device. Dates and source descriptions come from the existing editorial records.