Skip to content

Commit 281cc66

Browse files
authored
Update 2023-07-12-markov-chains.md
Change image path and header.
1 parent e58107a commit 281cc66

File tree

1 file changed

+14
-7
lines changed

1 file changed

+14
-7
lines changed

_posts/2023-07-12-markov-chains.md

+14-7
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,16 @@
11
---
2-
title: Discrete Markov Chains
3-
date: 2023-07-12 18:00:00
4-
tags: Markov Chains
5-
categories: Reading Group
6-
mathjax: true
2+
layout: distill
3+
title: Markov Chains
4+
description: An introduction to Markov Chains.
5+
tags: probability, random process, Markov Chains
6+
giscus_comments: true
7+
date: 2023-07-12
8+
featured: true
9+
10+
authors:
11+
- name: Xue Yu
12+
affiliations:
13+
name: Renmin University of China/UBC
714
---
815

916

@@ -89,7 +96,7 @@ Let $\mu_{i} = \sum_{t \geq 1} t \cdot r_{i,i}^{t}$ denote the expected time to
8996
9097
Here we give an example of a Markov chain that has null recurrent states. Consider the following markov chain whose states are the positive integers.
9198

92-
![Fig. 1. An example of a Markov chain that has null recurrent states ](./Markov-Chains/image.png)
99+
![Fig. 1. An example of a Markov chain that has null recurrent states ](assets/img/markov_chains/image.png)
93100

94101
Starting at state 1, the probability of not having returned to state 1 within the first $t$ steps is
95102
$$
@@ -128,7 +135,7 @@ A state $i$ is periodic means that for $s = k, 2k, 3k,...$, $P(X_{t+s}= j | X_t
128135

129136
Consider the two-state “broken printer” Markov chain:
130137

131-
![Transition diagram for the two-state broken printer chain](./Markov-Chains/2023-07-22-11-00-52.png)
138+
![Transition diagram for the two-state broken printer chain](assets/img/markov_chains/2023-07-22-11-00-52.png)
132139

133140
There are two state (0 and 1) in this Markov chain, and assume that the initial distribution is
134141
$$

0 commit comments

Comments
 (0)