Shortcuts

correct_for_frame_skip

torchrl.trainers.helpers.correct_for_frame_skip(cfg: DictConfig) DictConfig[source]

Correct the arguments for the input frame_skip, by dividing all the arguments that reflect a count of frames by the frame_skip.

This is aimed at avoiding unknowingly over-sampling from the environment, i.e. targetting a total number of frames of 1M but actually collecting frame_skip * 1M frames.

Parameters:

cfg (DictConfig) – DictConfig containing some frame-counting argument, including: “max_frames_per_traj”, “total_frames”, “frames_per_batch”, “record_frames”, “annealing_frames”, “init_random_frames”, “init_env_steps”

Returns:

the input DictConfig, modified in-place.

Docs

Access comprehensive developer documentation for PyTorch

View Docs

Tutorials

Get in-depth tutorials for beginners and advanced developers

View Tutorials

Resources

Find development resources and get your questions answered

View Resources