Skip to content

Commit 9c6e580

Browse files
committed
update markov chain blog
1 parent 281cc66 commit 9c6e580

28 files changed

+2
-2
lines changed

_posts/2023-07-12-markov-chains.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ Let $\mu_{i} = \sum_{t \geq 1} t \cdot r_{i,i}^{t}$ denote the expected time to
9696
9797
Here we give an example of a Markov chain that has null recurrent states. Consider the following markov chain whose states are the positive integers.
9898

99-
![Fig. 1. An example of a Markov chain that has null recurrent states ](assets/img/markov_chains/image.png)
99+
![Fig. 1. An example of a Markov chain that has null recurrent states ](image.png)
100100

101101
Starting at state 1, the probability of not having returned to state 1 within the first $t$ steps is
102102
$$
@@ -135,7 +135,7 @@ A state $i$ is periodic means that for $s = k, 2k, 3k,...$, $P(X_{t+s}= j | X_t
135135

136136
Consider the two-state “broken printer” Markov chain:
137137

138-
![Transition diagram for the two-state broken printer chain](assets/img/markov_chains/2023-07-22-11-00-52.png)
138+
![Transition diagram for the two-state broken printer chain](2023-07-22-11-00-52.png)
139139

140140
There are two state (0 and 1) in this Markov chain, and assume that the initial distribution is
141141
$$
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 commit comments

Comments
 (0)