Model-Based Reasoning in Humans Becomes Automatic with Training.
Model-based and model-free reinforcement learning (RL) have been suggested as algorithmic realizations of goal-directed and habitual action strategies. Model-based RL is more flexible than model-free but requires sophisticated calculations using a learnt model of the world. This has led model-based...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2015-09-01
|
| Series: | PLoS Computational Biology |
| Online Access: | https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004463&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849331154677661696 |
|---|---|
| author | Marcos Economides Zeb Kurth-Nelson Annika Lübbert Marc Guitart-Masip Raymond J Dolan |
| author_facet | Marcos Economides Zeb Kurth-Nelson Annika Lübbert Marc Guitart-Masip Raymond J Dolan |
| author_sort | Marcos Economides |
| collection | DOAJ |
| description | Model-based and model-free reinforcement learning (RL) have been suggested as algorithmic realizations of goal-directed and habitual action strategies. Model-based RL is more flexible than model-free but requires sophisticated calculations using a learnt model of the world. This has led model-based RL to be identified with slow, deliberative processing, and model-free RL with fast, automatic processing. In support of this distinction, it has recently been shown that model-based reasoning is impaired by placing subjects under cognitive load--a hallmark of non-automaticity. Here, using the same task, we show that cognitive load does not impair model-based reasoning if subjects receive prior training on the task. This finding is replicated across two studies and a variety of analysis methods. Thus, task familiarity permits use of model-based reasoning in parallel with other cognitive demands. The ability to deploy model-based reasoning in an automatic, parallelizable fashion has widespread theoretical implications, particularly for the learning and execution of complex behaviors. It also suggests a range of important failure modes in psychiatric disorders. |
| format | Article |
| id | doaj-art-813f9ae5b0844eb88286fad0acd0dd3a |
| institution | Kabale University |
| issn | 1553-734X 1553-7358 |
| language | English |
| publishDate | 2015-09-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS Computational Biology |
| spelling | doaj-art-813f9ae5b0844eb88286fad0acd0dd3a2025-08-20T03:46:42ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582015-09-01119e100446310.1371/journal.pcbi.1004463Model-Based Reasoning in Humans Becomes Automatic with Training.Marcos EconomidesZeb Kurth-NelsonAnnika LübbertMarc Guitart-MasipRaymond J DolanModel-based and model-free reinforcement learning (RL) have been suggested as algorithmic realizations of goal-directed and habitual action strategies. Model-based RL is more flexible than model-free but requires sophisticated calculations using a learnt model of the world. This has led model-based RL to be identified with slow, deliberative processing, and model-free RL with fast, automatic processing. In support of this distinction, it has recently been shown that model-based reasoning is impaired by placing subjects under cognitive load--a hallmark of non-automaticity. Here, using the same task, we show that cognitive load does not impair model-based reasoning if subjects receive prior training on the task. This finding is replicated across two studies and a variety of analysis methods. Thus, task familiarity permits use of model-based reasoning in parallel with other cognitive demands. The ability to deploy model-based reasoning in an automatic, parallelizable fashion has widespread theoretical implications, particularly for the learning and execution of complex behaviors. It also suggests a range of important failure modes in psychiatric disorders.https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004463&type=printable |
| spellingShingle | Marcos Economides Zeb Kurth-Nelson Annika Lübbert Marc Guitart-Masip Raymond J Dolan Model-Based Reasoning in Humans Becomes Automatic with Training. PLoS Computational Biology |
| title | Model-Based Reasoning in Humans Becomes Automatic with Training. |
| title_full | Model-Based Reasoning in Humans Becomes Automatic with Training. |
| title_fullStr | Model-Based Reasoning in Humans Becomes Automatic with Training. |
| title_full_unstemmed | Model-Based Reasoning in Humans Becomes Automatic with Training. |
| title_short | Model-Based Reasoning in Humans Becomes Automatic with Training. |
| title_sort | model based reasoning in humans becomes automatic with training |
| url | https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1004463&type=printable |
| work_keys_str_mv | AT marcoseconomides modelbasedreasoninginhumansbecomesautomaticwithtraining AT zebkurthnelson modelbasedreasoninginhumansbecomesautomaticwithtraining AT annikalubbert modelbasedreasoninginhumansbecomesautomaticwithtraining AT marcguitartmasip modelbasedreasoninginhumansbecomesautomaticwithtraining AT raymondjdolan modelbasedreasoninginhumansbecomesautomaticwithtraining |