Evaluating Diversity Metrics: A Critique of the Equity Index Method

Background: Evaluating diversity, inclusivity, and equity remains both a prevalent topic in education and a difficult challenge for most evaluators. Traditional metrics used to evaluate these constructs include questionnaires, focus groups, and anonymous comment solicitations. While each of these ap...

Full description

Saved in:
Bibliographic Details
Main Authors: Kenneth D. Royal, Keven Flammer
Format: Article
Language:English
Published: The Evaluation Center at Western Michigan University 2015-11-01
Series:Journal of MultiDisciplinary Evaluation
Subjects:
Online Access:https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/425
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849738344249950208
author Kenneth D. Royal
Keven Flammer
author_facet Kenneth D. Royal
Keven Flammer
author_sort Kenneth D. Royal
collection DOAJ
description Background: Evaluating diversity, inclusivity, and equity remains both a prevalent topic in education and a difficult challenge for most evaluators. Traditional metrics used to evaluate these constructs include questionnaires, focus groups, and anonymous comment solicitations. While each of these approaches offer value, they also possess a number of limitations (e.g., self-reported nature, holistic perspective, social desirability bias, varying degrees of respondent sensitivity, representative responses, etc.). Researchers at the University of Southern California have successfully utilized the Equity Index Method (EIM) as a potential approach for measuring diversity and reporting diversity-related outcomes. Purpose: Provide a critique of the EIM and discusses how the EIM could be improved and extended to other evaluation contexts and settings. Setting: Not Applicable. Intervention: Not Applicable. Research Design: Not Applicable. Data Collection and Analysis: Not Applicable. Findings: Despite the potential for problems with interpretations based on small samples and subgroups and some concerns about semantics involving the term “equity”, we believe the EIM possesses a number of strengths that many evaluators will find useful. We encourage other evaluators to consider this method and explore its utility in a variety of contexts.
format Article
id doaj-art-c4c679d1643e4616905012c856c030e5
institution DOAJ
issn 1556-8180
language English
publishDate 2015-11-01
publisher The Evaluation Center at Western Michigan University
record_format Article
series Journal of MultiDisciplinary Evaluation
spelling doaj-art-c4c679d1643e4616905012c856c030e52025-08-20T03:06:39ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802015-11-01112510.56645/jmde.v11i25.425Evaluating Diversity Metrics: A Critique of the Equity Index MethodKenneth D. Royal0https://orcid.org/0000-0002-5508-1480Keven Flammer1https://orcid.org/0000-0003-3430-0039North Carolina State UniversityNorth Carolina State UniversityBackground: Evaluating diversity, inclusivity, and equity remains both a prevalent topic in education and a difficult challenge for most evaluators. Traditional metrics used to evaluate these constructs include questionnaires, focus groups, and anonymous comment solicitations. While each of these approaches offer value, they also possess a number of limitations (e.g., self-reported nature, holistic perspective, social desirability bias, varying degrees of respondent sensitivity, representative responses, etc.). Researchers at the University of Southern California have successfully utilized the Equity Index Method (EIM) as a potential approach for measuring diversity and reporting diversity-related outcomes. Purpose: Provide a critique of the EIM and discusses how the EIM could be improved and extended to other evaluation contexts and settings. Setting: Not Applicable. Intervention: Not Applicable. Research Design: Not Applicable. Data Collection and Analysis: Not Applicable. Findings: Despite the potential for problems with interpretations based on small samples and subgroups and some concerns about semantics involving the term “equity”, we believe the EIM possesses a number of strengths that many evaluators will find useful. We encourage other evaluators to consider this method and explore its utility in a variety of contexts. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/425equityequity index methodapplications
spellingShingle Kenneth D. Royal
Keven Flammer
Evaluating Diversity Metrics: A Critique of the Equity Index Method
Journal of MultiDisciplinary Evaluation
equity
equity index method
applications
title Evaluating Diversity Metrics: A Critique of the Equity Index Method
title_full Evaluating Diversity Metrics: A Critique of the Equity Index Method
title_fullStr Evaluating Diversity Metrics: A Critique of the Equity Index Method
title_full_unstemmed Evaluating Diversity Metrics: A Critique of the Equity Index Method
title_short Evaluating Diversity Metrics: A Critique of the Equity Index Method
title_sort evaluating diversity metrics a critique of the equity index method
topic equity
equity index method
applications
url https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/425
work_keys_str_mv AT kennethdroyal evaluatingdiversitymetricsacritiqueoftheequityindexmethod
AT kevenflammer evaluatingdiversitymetricsacritiqueoftheequityindexmethod