With the recent evolution of mobile health technologies, health scientists
are increasingly interested in developing just-in-time adaptive interventions
(JITAIs), typically delivered via notification on mobile device and designed to
help the user prevent negative health outcomes and promote the adoption and
maintenance of healthy behaviors. A JITAI involves a sequence of decision rules
(i.e., treatment policy) that takes the user's current context as input and
specifies whether and what type of an intervention should be provided at the
moment. In this paper, we develop a Reinforcement Learning (RL) algorithm that
continuously learns and improves the treatment policy embedded in the JITAI as
the data is being collected from the user. This work is motivated by our
collaboration on designing the RL algorithm in HeartSteps V2 based on data from
HeartSteps V1. HeartSteps is a physical activity mobile health application. The
RL algorithm developed in this paper is being used in HeartSteps V2 to decide,
five times per day, whether to deliver a context-tailored activity suggestion.

本研究发展了一种强化学习算法，用于连续学习并改进快速干预应用程序中的治疗策略，并在 HeartSteps V2 中使用，以决定每天是否提供特定于上下文的活动建议。