i seem to be unable to re-run checkpoints with brackets in the filename.
mismatched input '[' expecting <EOF>
See https://hydra.cc/docs/next/advanced/override_grammar/basic for details
here, you can see the last outputs for training a model that saves a checkpoint last_Cartpoleep101rew[133.24].pth
i try running it but get the above error. i then rename it to __NO_BRACKETS__.pth and then it runs fine:
fps step: 228085.7 fps step and policy inference: 167287.0 fps total: 117272.7
fps step: 231854.9 fps step and policy inference: 171459.2 fps total: 119474.3
fps step: 219754.7 fps step and policy inference: 163183.4 fps total: 111201.2
=> saving checkpoint 'runs/Cartpole/nn/last_Cartpole_ep_100_rew_133.24303.pth'
fps step: 215111.4 fps step and policy inference: 159014.7 fps total: 109320.1
=> saving checkpoint 'runs/Cartpole/nn/last_Cartpoleep101rew[133.24].pth'
MAX EPOCHS NUM!
(rlgpu) stuart@hp:~/repos/IsaacGymEnvs/isaacgymenvs$ python train.py task=Cartpole checkpoint='runs/Cartpole/nn/last_Cartpoleep101rew[133.24].pth' test=True num_envs=64
Importing module 'gym_37' (/home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/linux-x86_64/gym_37.so)
Setting GYM_USD_PLUG_INFO_PATH to /home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/linux-x86_64/usd/plugInfo.json
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/torch/utils/cpp_extension.py:3: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
import imp
PyTorch version 1.8.1
Device count 1
/home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/src/gymtorch
Using /home/stuart/.cache/torch_extensions as PyTorch extensions root...
Emitting ninja build file /home/stuart/.cache/torch_extensions/gymtorch/build.ninja...
Building extension module gymtorch...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module gymtorch...
/home/stuart/Downloads/isaacgym/python/isaacgym/torch_utils.py:135: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
def get_axis_params(value, axis_idx, x_value=0., dtype=np.float, n_dims=3):
2022-04-24 10:57:42,839 - INFO - logger - logger initialized
<unknown>:6: DeprecationWarning: invalid escape sequence \*
Error: FBX library failed to load - importing FBX data will not succeed. Message: No module named 'fbx'
FBX tools must be installed from https://help.autodesk.com/view/FBX/2020/ENU/?guid=FBX_Developer_Help_scripting_with_python_fbx_installing_python_fbx_html
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/torch/utils/tensorboard/__init__.py:3: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if not hasattr(tensorboard, '__version__') or LooseVersion(tensorboard.__version__) < LooseVersion('1.15'):
mismatched input '[' expecting <EOF>
See https://hydra.cc/docs/next/advanced/override_grammar/basic for details
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
(rlgpu) stuart@hp:~/repos/IsaacGymEnvs/isaacgymenvs$ mv runs/Cartpole/nn/last_Cartpoleep101rew[133.24].pth runs/Cartpole/nn/__NO_BRACKETS__.pth
(rlgpu) stuart@hp:~/repos/IsaacGymEnvs/isaacgymenvs$ python train.py task=Cartpole checkpoint='runs/Cartpole/nn/__NO_BRACKETS__.pth' test=True num_envs=64
Importing module 'gym_37' (/home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/linux-x86_64/gym_37.so)
Setting GYM_USD_PLUG_INFO_PATH to /home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/linux-x86_64/usd/plugInfo.json
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/torch/utils/cpp_extension.py:3: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
import imp
PyTorch version 1.8.1
Device count 1
/home/stuart/Downloads/isaacgym/python/isaacgym/_bindings/src/gymtorch
Using /home/stuart/.cache/torch_extensions as PyTorch extensions root...
Emitting ninja build file /home/stuart/.cache/torch_extensions/gymtorch/build.ninja...
Building extension module gymtorch...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module gymtorch...
/home/stuart/Downloads/isaacgym/python/isaacgym/torch_utils.py:135: DeprecationWarning: `np.float` is a deprecated alias for the builtin `float`. To silence this warning, use `float` by itself. Doing this will not modify any behavior and is safe. If you specifically wanted the numpy scalar type, use `np.float64` here.
Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
def get_axis_params(value, axis_idx, x_value=0., dtype=np.float, n_dims=3):
2022-04-24 10:59:00,725 - INFO - logger - logger initialized
<unknown>:6: DeprecationWarning: invalid escape sequence \*
Error: FBX library failed to load - importing FBX data will not succeed. Message: No module named 'fbx'
FBX tools must be installed from https://help.autodesk.com/view/FBX/2020/ENU/?guid=FBX_Developer_Help_scripting_with_python_fbx_installing_python_fbx_html
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/torch/utils/tensorboard/__init__.py:3: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if not hasattr(tensorboard, '__version__') or LooseVersion(tensorboard.__version__) < LooseVersion('1.15'):
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/hydra/_internal/defaults_list.py:251: UserWarning: In 'config': Defaults list is missing `_self_`. See https://hydra.cc/docs/upgrades/1.0_to_1.1/default_composition_order for more information
warnings.warn(msg, UserWarning)
/home/stuart/miniconda3/envs/rlgpu/lib/python3.7/site-packages/hydra/_internal/defaults_list.py:413: UserWarning: In config: Invalid overriding of hydra/job_logging:
Default list overrides requires 'override' keyword.
See https://hydra.cc/docs/next/upgrades/1.0_to_1.1/defaults_list_override for more information.
deprecation_warning(msg)
task:
name: Cartpole
physics_engine: physx
env:
…
success