SimuRLacra-v1.0

Using
Python 3.7.10
PyTorch 1.8.1
BOTroch 0.4 (--no-deps)
GPyTroch 1.4.2 (--no-deps)
SBI 0.16 (--no-deps)
Pyro-api 0.1.2 (--no-deps)
Pyro-ppl 1.6.0 (--no-deps)
Rcs master (commit 69de648802b1e909f0fc847020538a2e61f4c9df)
mujoco-py 2.0.2.9

Notes
Complete overhaul for ADR, SPDR, and ARPL
Stable Interface

SimuRLacra-v0.6

Using
Python 3.7.10
PyTorch 1.8.1
BOTroch 0.4 (--no-deps)
GPyTroch 1.4.2 (--no-deps)
SBI 0.16 (--no-deps)
Pyro-api 0.1.2 (--no-deps)
Pyro-ppl 1.6.0 (--no-deps)
Rcs master (commit 2cf42d75073d8be1f628506af3a0c4c3ab4e056f)
mujoco-py 2.0.2.9

Notes
Automatic tests are running
Added SPRL and PDDR
GPU support working

SimuRLacra-v0.5

Using
Python 3.7.9
PyTorch 1.7.0
BOTroch 0.3.3 (--no-deps)
GPyTroch 1.3.0 (--no-deps)
SBI 0.14.2 (--no-deps)
Pyro-ppl 1.5.1 (--no-deps)
Rcs master (commit 071c6cc1f27f8e1d301da55325888ed35bb42563)
mujoco-py 2.0.2.5

Notes
Major change in the ParameterExplorationSampler
Integrated sbi toolbox
Many bug fixes
Improved GPU support (not finished yes)
Only running into "inflateValidate" bug when building Rcs on Ubuntu < 20.04 (easy fix)

SimuRLacra-v0.4

Using
Python 3.7.9
PyTorch 1.7.0
BOTroch 0.3.2 (--no-deps)
GPyTroch 1.2.1 (--no-deps)
SBI 0.13.2 (--no-deps)
Rcs master (commit 5f86fa652931d396c422263b17bd385190de53ca)
mujoco-py 2.0.2.10

Notes
Completely reworked saving and loading
Moveing experiments between machines works, but not renaming them
Introduced checkpoints for meta-algorithms
Restructured algorithms (now pickleable), two-headed policies, and potential-based policies
Running into "inflateValidate" bug when building Rcs (easy fix)
basic GPU support (not properly tested)

SimuRLacra-v0.3

Using
Python 3.7.9
PyTorch 1.4.0 (1.5.1 also works)
BOTroch 0.3.0 (--no-deps)
GPyTroch 1.2.0 (--no-deps)
Rcs master (commit 5f86fa652931d396c422263b17bd385190de53ca)
mujoco-py 2.0.2.10

Notes
State after finishing the experiments for the BayRn paper
Test time out due to erroneous behavior of the lazy_fixtures
Running into "inflateValidate" bug when building Rcs (easy fix)
basic GPU support (not properly tested)

SimuRLacra-v0.2

Using
Python 3.7.6
PyTorch 1.4.0 (1.5.1 also works)
BOTroch 0.3.0 (--no-deps)
GPyTroch 1.1.1 (--no-deps)
Rcs master (commit 5d683b8e3308ed8f4c01cd0f6e3cb19fa89237ea)
mujoco-py 2.0.2.10

Notes
Tensorboard integration (not properly tested)
SimOpt is unfinished (sim-2-real eval missing)
Running into "inflateValidate" bug when building Rcs (easy fix)
basic GPU support (not properly tested)
Dockerfile unfinished (coverage missing)

SimuRLacra-v0.1

Using
Python 3.7.6
PyTorch 1.4.0 (locally build)
BOTroch 0.3.0 (--no-deps)
GPyTroch 1.1.1 (--no-deps)
Rcs master (commit aae905e6d56350c3d112960ac8967b3d7bd84078)
mujoco-py 2.0.2.9

Notes
Running into "inflateValidate" bug when building Rcs (easy fix)
GPU support unfinished
Dockerfile unfinished (coverage missing)