From observed transitions to hidden paths in Markov networks

The number of observable degrees of freedom is typically limited in experiments. Here we consider discrete Markov networks in which an observer has access to a few visible transitions and the waiting times between these transitions. Focusing on the underlying structure of a discrete network, we pres...

Full description

Saved in:
Bibliographic Details
Main Authors: Alexander M. Maier, Udo Seifert, Jann van der Meer
Format: Article
Language:English
Published: American Physical Society 2025-07-01
Series:Physical Review Research
Online Access:http://doi.org/10.1103/p4k1-1dvb
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849718947135356928
author Alexander M. Maier
Udo Seifert
Jann van der Meer
author_facet Alexander M. Maier
Udo Seifert
Jann van der Meer
author_sort Alexander M. Maier
collection DOAJ
description The number of observable degrees of freedom is typically limited in experiments. Here we consider discrete Markov networks in which an observer has access to a few visible transitions and the waiting times between these transitions. Focusing on the underlying structure of a discrete network, we present methods to infer local and global properties of the network from observed data. First, we derive bounds on the microscopic entropy production along the hidden paths between two visible transitions, which complement extant bounds on mean entropy production and affinities of hidden cycles. Second, we demonstrate how the operationally accessible data encodes information about the topology of shortest hidden paths, which can be used to identify potential clusters of states or exclude their existence. Finally, we outline a systematic way to combine the inferred data, resulting in an algorithm that finds the candidates for a minimal graph of the underlying network, i.e., a graph that is part of the original one and compatible with the observations. Our results highlight the interplay between thermodynamic methods, waiting-time distributions, and topological aspects like network structure, which can be expected to provide novel insights in other setups of coarse graining as well.
format Article
id doaj-art-2a0202cd45be4726abc4c665e47441f5
institution DOAJ
issn 2643-1564
language English
publishDate 2025-07-01
publisher American Physical Society
record_format Article
series Physical Review Research
spelling doaj-art-2a0202cd45be4726abc4c665e47441f52025-08-20T03:12:15ZengAmerican Physical SocietyPhysical Review Research2643-15642025-07-017303306710.1103/p4k1-1dvbFrom observed transitions to hidden paths in Markov networksAlexander M. MaierUdo SeifertJann van der MeerThe number of observable degrees of freedom is typically limited in experiments. Here we consider discrete Markov networks in which an observer has access to a few visible transitions and the waiting times between these transitions. Focusing on the underlying structure of a discrete network, we present methods to infer local and global properties of the network from observed data. First, we derive bounds on the microscopic entropy production along the hidden paths between two visible transitions, which complement extant bounds on mean entropy production and affinities of hidden cycles. Second, we demonstrate how the operationally accessible data encodes information about the topology of shortest hidden paths, which can be used to identify potential clusters of states or exclude their existence. Finally, we outline a systematic way to combine the inferred data, resulting in an algorithm that finds the candidates for a minimal graph of the underlying network, i.e., a graph that is part of the original one and compatible with the observations. Our results highlight the interplay between thermodynamic methods, waiting-time distributions, and topological aspects like network structure, which can be expected to provide novel insights in other setups of coarse graining as well.http://doi.org/10.1103/p4k1-1dvb
spellingShingle Alexander M. Maier
Udo Seifert
Jann van der Meer
From observed transitions to hidden paths in Markov networks
Physical Review Research
title From observed transitions to hidden paths in Markov networks
title_full From observed transitions to hidden paths in Markov networks
title_fullStr From observed transitions to hidden paths in Markov networks
title_full_unstemmed From observed transitions to hidden paths in Markov networks
title_short From observed transitions to hidden paths in Markov networks
title_sort from observed transitions to hidden paths in markov networks
url http://doi.org/10.1103/p4k1-1dvb
work_keys_str_mv AT alexandermmaier fromobservedtransitionstohiddenpathsinmarkovnetworks
AT udoseifert fromobservedtransitionstohiddenpathsinmarkovnetworks
AT jannvandermeer fromobservedtransitionstohiddenpathsinmarkovnetworks