How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes

This tutorial provides guidelines for conducting linear mixed effects (LME) analyses for simple designs, aimed at researchers familiar with t-tests, analysis of variance (ANOVA) and linear regression. First, we compare LME analyses with traditional methods when participants are the only source of ra...

Full description

Saved in:
Bibliographic Details
Main Authors: Marc Brysbaert, Dries Debeer
Format: Article
Language:English
Published: Ubiquity Press 2025-01-01
Series:Journal of Cognition
Subjects:
Online Access:https://account.journalofcognition.org/index.php/up-j-jc/article/view/409
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823859313915985920
author Marc Brysbaert
Dries Debeer
author_facet Marc Brysbaert
Dries Debeer
author_sort Marc Brysbaert
collection DOAJ
description This tutorial provides guidelines for conducting linear mixed effects (LME) analyses for simple designs, aimed at researchers familiar with t-tests, analysis of variance (ANOVA) and linear regression. First, we compare LME analyses with traditional methods when participants are the only source of random variation. We show that LME analysis is more interesting as soon as you have more than one observation per participant per condition. The second section discusses studies where both participants and stimuli are used as sources of random variation, ensuring robust generalization beyond the specific stimuli tested. In our search for standardized effect sizes, we saw that partial eta squared is even less informative for LME than for ANOVA. We present eta squared within as an alternative, to be used in combination with the traditional measure eta squared (also in ANOVA). To facilitate implementation, we analyze toy datasets with R and jamovi. This tutorial gives researchers a good foundation for LME analyses of simple 2 × 2 designs and paves the way for tackling more complicated designs.
format Article
id doaj-art-43fdb8c0cfc2492895b2f72d8660d93d
institution Kabale University
issn 2514-4820
language English
publishDate 2025-01-01
publisher Ubiquity Press
record_format Article
series Journal of Cognition
spelling doaj-art-43fdb8c0cfc2492895b2f72d8660d93d2025-02-11T05:36:32ZengUbiquity PressJournal of Cognition2514-48202025-01-01815510.5334/joc.409408How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect SizesMarc Brysbaert0https://orcid.org/0000-0002-3645-3189Dries Debeer1https://orcid.org/0000-0002-5875-357XFaculty of Psychology and Educational Sciences, Ghent UniversityFaculty of Psychology and Educational Sciences, Ghent UniversityThis tutorial provides guidelines for conducting linear mixed effects (LME) analyses for simple designs, aimed at researchers familiar with t-tests, analysis of variance (ANOVA) and linear regression. First, we compare LME analyses with traditional methods when participants are the only source of random variation. We show that LME analysis is more interesting as soon as you have more than one observation per participant per condition. The second section discusses studies where both participants and stimuli are used as sources of random variation, ensuring robust generalization beyond the specific stimuli tested. In our search for standardized effect sizes, we saw that partial eta squared is even less informative for LME than for ANOVA. We present eta squared within as an alternative, to be used in combination with the traditional measure eta squared (also in ANOVA). To facilitate implementation, we analyze toy datasets with R and jamovi. This tutorial gives researchers a good foundation for LME analyses of simple 2 × 2 designs and paves the way for tackling more complicated designs.https://account.journalofcognition.org/index.php/up-j-jc/article/view/409statistical analysismathematical modellingface perception
spellingShingle Marc Brysbaert
Dries Debeer
How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
Journal of Cognition
statistical analysis
mathematical modelling
face perception
title How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
title_full How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
title_fullStr How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
title_full_unstemmed How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
title_short How to Run Linear Mixed Effects Analysis for Pairwise Comparisons? A Tutorial and a Proposal for the Calculation of Standardized Effect Sizes
title_sort how to run linear mixed effects analysis for pairwise comparisons a tutorial and a proposal for the calculation of standardized effect sizes
topic statistical analysis
mathematical modelling
face perception
url https://account.journalofcognition.org/index.php/up-j-jc/article/view/409
work_keys_str_mv AT marcbrysbaert howtorunlinearmixedeffectsanalysisforpairwisecomparisonsatutorialandaproposalforthecalculationofstandardizedeffectsizes
AT driesdebeer howtorunlinearmixedeffectsanalysisforpairwisecomparisonsatutorialandaproposalforthecalculationofstandardizedeffectsizes