Q-prop

[DennisWangCW]

where is the Q-prop codes?

[Carolzheng]

qprop is implemented within algo class of TRPO and VPG. The original paper mentioned that qprop could be directly combined with a number of algorithms. The get_algo function in launcher_stub_utils.py is a good place to start.