[论文解读] Continuous Time Markov Networks

Tal El‐Hay, Nir Friedman+2 more|arXiv (Cornell University)|Jun 27, 2012

Bayesian Modeling and Causal Inference参考文献 13被引用 13

一句话总结

本文提出了连续时间马尔可夫网络（CTMNs），这是一种新颖的框架，用于建模结合局部转移提议与作为马尔可夫网络编码的全局适应度函数的连续时间随机过程。该模型利用适应度函数以概率方式接受或拒绝状态变化，确保平稳分布与网络的势函数一致，从而能够紧凑地表示诸如生物序列演化等复杂动态。

ABSTRACT

A central task in many applications is reasoning about processes that change in a continuous time. The mathematical framework of Continuous Time Markov Processes provides the basic foundations for modeling such systems. Recently, Nodelman et al introduced continuous time Bayesian networks (CTBNs), which allow a compact representation of continuous-time processes over a factored state space. In this paper, we introduce continuous time Markov networks (CTMNs), an alternative representation language that represents a different type of continuous-time dynamics. In many real life processes, such as biological and chemical systems, the dynamics of the process can be naturally described as an interplay between two forces - the tendency of each entity to change its state, and the overall fitness or energy function of the entire system. In our model, the first force is described by a continuous-time proposal process that suggests possible local changes to the state of the system at different rates. The second force is represented by a Markov network that encodes the fitness, or desirability, of different states; a proposed local change is then accepted with a probability that is a function of the change in the fitness distribution. We show that the fitness distribution is also the stationary distribution of the Markov process, so that this representation provides a characterization of a temporal process whose stationary distribution has a compact graphical representation. This allows us to naturally capture a different type of structure in complex dynamical processes, such as evolving biological sequences. We describe the semantics of the representation, its basic properties, and how it compares to CTBNs. We also provide algorithms for learning such models from data, and discuss its applicability to biological sequence evolution.

研究动机与目标

• 开发一种连续时间随机过程的新表示方法，以同时捕捉局部转移动态与全局系统级偏好。
• 建模状态变化受个体实体倾向与整体系统适应度共同影响的系统，例如生物与化学过程。
• 确保该过程的平稳分布与图模型的势函数完全一致，从而实现严谨的推理与学习。
• 从时间数据中提供一种CTMNs的学习算法，特别适用于演化中的生物序列。
• 为CTMNs提供形式化语义与理论基础，使其与现有模型（如CTBNs）相区别。

提出的方法

• 该模型定义了一个连续时间马尔可夫过程，其中每个状态转移由一个基于速率的局部提议过程提出。
• 提议的转移以依赖于系统适应度变化的概率被接受，该适应度由马尔可夫网络的势函数定义。
• 适应度函数以马尔可夫网络形式编码，其在团上的势函数反映了不同状态配置的可取程度。
• 接受概率基于适应度变化的比值推导得出，确保细致平衡性，并在网络分布下保持平稳性。
• 该过程被构造为使得平稳分布即为马尔可夫网络上的吉布斯分布，从而实现一致的长期行为。
• 基于从观测到的时间轨迹的最大似然估计，开发了基于梯度优化的学习算法。

实验结果

研究问题

• RQ1 如何建模连续时间过程，使得局部转移速率与全局系统适应度共同影响动态？
• RQ2 能否构建一个连续时间马尔可夫过程，其平稳分布恰好是马尔可夫网络的吉布斯分布？
• RQ3 与CTBNs相比，该模型在表达能力、平稳性以及复杂依赖关系建模方面有何差异？
• RQ4 可使用哪些学习算法从未观测的时间数据中推断适应度函数与转移速率的参数？
• RQ5 CTMNs能否有效建模现实世界过程，如具有复杂相互依赖状态变化的演化生物序列？

主要发现

• CTMN过程的平稳分布恰好是马尔可夫网络势函数所定义的吉布斯分布，确保与适应度模型的一致性。
• 该模型允许将动态自然地分解为局部提议机制与全局适应度评估，从而实现模块化与可解释性建模。
• 状态转移的接受概率基于适应度变化的比值推导得出，满足细致平衡条件，并确保收敛至目标分布。
• 该框架支持从时间数据中使用最大似然法进行学习，优化过程同时涵盖转移速率与势函数参数。
• 该模型在生物序列演化中得到验证，其中相互依赖的突变与适应度景观可被自然捕捉。
• CTMNs为CTBNs提供了互补的替代方案，尤其适用于全局系统适应度在状态转移中起主导作用的系统。