I have been attempting to use the ERA5 dataset downloader and converter located under modulus/examples/weather/dataset_download. I have setup the CDS API key, and am trying to run ‘python start_mirror.py’. When running it initially, I get an error of: ‘ValueError: chunks keys (‘time’,) not found in data dimensions (‘valid_time’, ‘latitude’, ‘longitude’)’ coming from line 209 in era5_mirror.py of ‘ds = ds.chunk(chunking)’. From looking into this myself, this seems to be an issue stemming from era5_mirror.py under download_chunk(), where the dataset that is opened from the requested data from CDS API has dimensions of ‘valid_time’, ‘latitude’, and ‘longitude’. I tried to remedy this problem by renaming the dimension ‘valid_time’ to ‘time’. However, doing so raised another issue, this time of: ‘ValueError: append_dim=‘time’ does not match any existing dataset dimensions {}’ coming from line 223 of era5_mirror.py of ‘ds.to_zarr(mapper, mode=mode, consolidated=True, append_dim=append_dim)’. I am very confused by this error, as it seemed to me that after renaming the dimensin to ‘time’ that the append_dim=‘time’ should match an existing dataset dimension. I would greatly appreciate any help on this matter.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Problem in Installing DIGITS | 12 | 2819 | December 2, 2019 | |
Error during apt update on Ubuntu 20.04 “File has unexpected size” | 4 | 2140 | August 19, 2023 | |
E: Failed to fetch https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/Packages.gz File has unexpected size (213860 != 185496) | 7 | 4025 | October 5, 2020 | |
CUDA Packages file for ubuntu20.04 (08/17 UPDATE) has unexpected file size | 5 | 960 | August 18, 2023 | |
DIGITS installation guidance | 1 | 3838 | October 12, 2015 | |
cuda-visual-tools-8-0.x86_64 corrupted on yum repo | 11 | 3257 | April 29, 2017 | |
Apt update failing on Ubuntu CUDA repo | 18 | 4638 | July 15, 2022 | |
Error with CAFFE?! | 17 | 1735 | May 10, 2019 | |
DIGITS installation guidance | 0 | 1081 | August 25, 2015 | |
Cuda Packages file for ubuntu20.04 new update 07/11 break due unexpected file size 580845 | 7 | 1077 | July 12, 2022 |