⌘+K

Pulse Explore Communities Researchers Journals

Home Communities Explore

February 16, 2024Open Access

A note on weak compactness of occupation measures for an absorbing Markov decision process

François Dufour Tomás Prieto-Rumeau

View Full Paper

Ask AI

Bookmark

Share

Abstract

We consider an absorbing Markov decision process with a discrete time parameter with Borel state and action spaces. We prove that the set of occupation measures is compact for the weak topology if and only if the control model is uniformly absorbing.

Discussion

No takes yet. Share an insight, caveat, or question.

Cite This Study

Dufour et al. (2024) studied this question.

synapsesocial.com/papers/68e78f4db6db6435877009b9 https://doi.org/10.48550/arxiv.2402.10672

View Full Paper

Ask AI

Bookmark

Share

Keep reading

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

1Further remarks on absorbing Markov decision processes2024
2On the Continuity of the Projection Mapping from Strategic Measures to Occupation Measures in Absorbing Markov Decision Processes2024 · 4 citations
3Maximizing the probability of visiting a set infinitely often for a Markov decision process with Borel state and action spaces2024
4Occupation measures for Markov chainsOriginal Research · 1977 · 58 citations
5Risk-sensitive discounted Markov decision processes with unbounded reward functions and Borel spaces2024 · 1 citations

Constrained Markov Decision Processes with Non-constant Discount Factor2024
Existence and uniqueness of quasi-stationary and quasi-ergodic measures for absorbing Markov chains: A Banach lattice approach2024
Non-compact spaces of invariant measures2026