Detailed Framework

Overview

../_images/overview-sequence.drawio.png

・Multiprocessing flow (Worker-Memory-Trainer)

../_images/overview-mp_memory.drawio.png

・Multiprocessing flow (Worker-Trainer)

../_images/overview-mp.drawio.png

Play flow

../_images/playflow1.png

・1 Episode loop

../_images/playflow2.png

Multiplay flow

../_images/overview-multiplay.drawio.png

Class diagram

RL

../_images/class_rl.png

Env

../_images/class_env.png

Run

../_images/class_runner.png

Interface Type

SpaceBase(srl.base.spaces)

Class	Type	SpaceType
DiscreteSpace	int	DISCRETE
ArrayDiscreteSpace	list[int]	DISCRETE
ContinuousSpace	float	CONTINUOUS
ArrayContinuousSpace	list[float]	CONTINUOUS
BoxSpace	NDArray[AnyType]	srl.base.define.SpaceTypes
TextSpace	str	DISCRETE
MultiSpace	list[SpaceBase]	MULTI
AnySpace	any	UNKNOWN