Inferential statistics and the use of administrative data in US educational research

While the use of inferential statistics is a nearly universal practice in the social sciences, there are instances where its application is unnecessary and potentially misleading. This is true for a portion of research using administrative data in educational research in the United States. Surveying all research articles using administrative data published in Educational Researcher and American Educational Research Journal between 2011 and 2013, we find that over half use inferential techniques to help interpret results despite the use of population data. To the extent that these practices and findings are replicated and interpreted in the United States and elsewhere, this can lead to the undervaluing of potentially meaningful patterns and trends.