半马尔科夫链与马尔科夫链的区别

半马尔科夫链与马尔科夫链的区别

 
A continuous-time stochastic process is called a semi-Markov process or 'Markov renewal process' if the embedded jump chain (the discrete process registering what values the process takes) is a Markov chain, and where the holding times (time between jumps) are random variables with any distribution, whose distribution function may depend on the two states between which the move is made. A semi-Markov process where all the holding times are exponentially distributed is called a continuous time Markov chain/process(http://wiki.answers.com/Q/What_is_difference_between_markov_process_and_semi-markov_process)
 
上面是英文解释,下面是例子:
 
         青蛙在荷叶上跳动,在每个不同的荷叶上表示不同的状态,从一个荷叶跳到另一个荷叶表示状态的转移,该转移过程只依赖于现在所处荷叶,而与以前呆过的荷叶无关,如果只考虑青蛙跳跃的时刻序列,这个过程就是离散时间的马氏过程,如果考虑青蛙在荷叶上呆了一段时间,且这段时间是服从指数分布的,那这个过程是连续时间马氏过程,如果时间是非指数分布的,那这个过程是半马氏分布。(http://zhidao.baidu.com/question/76179363.html,该例子讲的很形象,但是却放在了百度知道的评论里,不仔细还不容易发现啊……)
posted @ 2016-04-09 21:06  Hand&Head  阅读(3319)  评论(0编辑  收藏  举报