Motivation
Currently, we only provide raw operation about object in Flame. But there're still several common tools for 3rd part libarary, e.g. ReplayBuffer in TorchRL. This feature will add a modle, named flamepy.tools, to support those libraries; the first tool is ReplayBuffer for TorchRL.
Function Specification
- Add
flamepy.tools model in py sdk
- Add ReplayBuffer for TorchRL
- Add example of ReplayBuffer to show the differentiation
Solutions
- Based on patch_object to support multi client updated
- Support different py type of object via generic in Py
- Update the example of replay buffer accordingly
Additional context
The flamepy.tools should be well organized, as it'll include more tools for 3rd part lib. For example, we should have a torchrl sub model for ReplayBuffer of TorchRL.
Motivation
Currently, we only provide raw operation about object in Flame. But there're still several common tools for 3rd part libarary, e.g. ReplayBuffer in TorchRL. This feature will add a modle, named
flamepy.tools, to support those libraries; the first tool is ReplayBuffer for TorchRL.Function Specification
flamepy.toolsmodel in py sdkSolutions
Additional context
The
flamepy.toolsshould be well organized, as it'll include more tools for 3rd part lib. For example, we should have atorchrlsub model for ReplayBuffer of TorchRL.