This paper investigates the robustness of causal bandits (CBs) in the face of temporal model fluctuations. This setting deviates from the existing literature's widely-adopted assumption of constant causal models. The focus is on causal systems with linear structural equation models (SEMs). The SEMs and the time-varying pre- and post-interventional statistical models are all unknown and subject to variations over time. The goal is to design a sequence of interventions that incur the smallest cumulative regret compared to an oracle aware of the entire causal model and its fluctuations. A robust CB algorithm is proposed, and its cumulative regret is analyzed by establishing both upper and lower bounds on the regret. It is shown that in a graph with maximum in-degree d, length of the largest causal path L, and an aggregate model deviation C, the regret is upper bounded by Õ(dL-1/2(√T + C)) and lower bounded by Ω(dL/2-2max\√T\; ,\; d²C\). The proposed algorithm achieves nearly optimal Õ(√T) regret when C is o(√T), maintaining sub-linear regret for a broad range of C.
No takes yet. Share an insight, caveat, or question.
Yan et al. (2024) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: