Detailed Framework

Play flow

../_images/playflow1.png

・1 Episode loop

../_images/playflow2.png

Multiplay flow

../_images/overview-multiplay.drawio.png

Distributed flow

../_images/runner_distributed_flow.png

Class diagram

RL

../_images/class_rl.png

Env

../_images/class_env.png

Run

../_images/class_runner.png

Interface Type

SpaceBase(srl.base.spaces)

Class	Type	SpaceType
DiscreteSpace	int	DISCRETE
ArrayDiscreteSpace	list[int]	DISCRETE
ContinuousSpace	float	CONTINUOUS
ArrayContinuousSpace	list[float]	CONTINUOUS
BoxSpace	NDArray[AnyType]	srl.base.define.SpaceTypes
MultiSpace	list[SpaceBase]	MULTI

RL type

	Action	Observation	Observation window
Discrete	int DiscreteSpace	list[int] ArrayDiscreteSpace	list[int] ArrayDiscreteSpace
Continuous	list[float] ArrayContinuousSpace	NDArray[np.float32] BoxSpace	NDArray[np.float32] BoxSpace
Image	NDArray[np.uint8] BoxSpace	NDArray[np.float32] BoxSpace	NDArray[np.float32] BoxSpace