1. The simplest actor‑critic (QAC)
2. Advantage actor‑critic (A2C)
2.1. Baseline invariance
2.2. The algorithm of advantage actor‑critic
3. Off‑policy actor‑critic
3.1. Illustrative examples
3.2. Importance sampling
3.3. The theorem of off‑policy policy gradient
3.4. The algorithm of off‑policy actor‑critic
4. Deterministic actor‑critic (DPG)
4.1. The theorem of deterministic policy gradient
4.2. The algorithm of deterministic actor‑critic
参考文献
本文是一篇学习笔记,内容全部源自于以下视频
https://www.bilibili.com/video/BV1Pz5C6iE3X/?p=6&spm_id_from=333.1007.top_right_bar_window_history.content.click&vd_source=44ed90827c8f67247cab0ab288133c80