0
To my knowledge, there are at least 6 different variants of Actor Critic:
\begin{array}{l l l l}
\text{actor gradient} & \text{critic gradient} & \text{actor gradient biased} & \text{name} \\
\hline
\sum_t \nabla_\theta \log \pi_\theta(a_t | s_t) \cdot (R_t - V_\theta) & \nabla_\theta \frac{1}{T}...
