INFO: NumExpr defaulting to 2 threads.
2023-10-30 07:34:00.204176: E tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:9342] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2023-10-30 07:34:00.204231: E tensorflow/compiler/xla/stream_executor/cuda/cuda_fft.cc:609] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2023-10-30 07:34:00.204268: E tensorflow/compiler/xla/stream_executor/cuda/cuda_blas.cc:1518] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2023-10-30 07:34:01.325960: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
[NeMo I 2023-10-30 07:34:01 nemo2riva:38] Logging level set to 20
[NeMo I 2023-10-30 07:34:01 convert:35] Restoring NeMo model from ‘tts_zh_hifigan_sfspeech.nemo’
GPU available: True (cuda), used: False
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
HPU available: False, using: 0 HPUs
[NeMo W 2023-10-30 07:34:01 nemo_logging:349] /usr/local/lib/python3.10/dist-packages/pytorch_lightning/trainer/setup.py:176: PossibleUserWarning: GPU available but not used. Set accelerator and devices using Trainer(accelerator='gpu', devices=1).
rank_zero_warn(
[NeMo W 2023-10-30 07:34:03 modelPT:161] If you intend to do training or fine-tuning, please call the ModelPT.setup_training_data() method and provide a valid configuration file to setup the train data loader.
Train config :
dataset:
target: nemo.collections.tts.torch.data.VocoderDataset
manifest_filepath: /pred/train_manifest_mel.json
sample_rate: 22050
n_segments: 8192
max_duration: null
min_duration: 0.75
load_precomputed_mel: true
hop_length: 256
dataloader_params:
drop_last: false
shuffle: true
batch_size: 88
num_workers: 5
pin_memory: true
[NeMo W 2023-10-30 07:34:03 modelPT:168] If you intend to do validation, please call the ModelPT.setup_validation_data() or ModelPT.setup_multiple_validation_data() method and provide a valid configuration file to setup the validation data loader(s).
Validation config :
dataset:
target: nemo.collections.tts.torch.data.VocoderDataset
manifest_filepath: /pred/val_manifest_mel.json
sample_rate: 22050
n_segments: 66048
max_duration: null
min_duration: 3
load_precomputed_mel: true
hop_length: 256
dataloader_params:
drop_last: false
shuffle: false
batch_size: 88
num_workers: 5
pin_memory: true
[NeMo I 2023-10-30 07:34:03 features:289] PADDING: 0
[NeMo I 2023-10-30 07:34:03 features:297] STFT using exact pad
[NeMo I 2023-10-30 07:34:03 features:289] PADDING: 0
[NeMo I 2023-10-30 07:34:03 features:297] STFT using exact pad
[NeMo W 2023-10-30 07:34:03 nemo_logging:349] /usr/local/lib/python3.10/dist-packages/torch/nn/utils/weight_norm.py:30: UserWarning: torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm.
warnings.warn(“torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm.”)
[NeMo I 2023-10-30 07:34:05 save_restore_connector:249] Model HifiGanModel was successfully restored from /content/tts_zh_hifigan_sfspeech.nemo.
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-mt-exported-encdecmtmodel.yaml for nemo.collections.nlp.models.MTEncDecModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-pc-exported-bert.yaml for nemo.collections.nlp.models.PunctuationCapitalizationModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/tts-exported-fastpitchmodel.yaml for nemo.collections.tts.models.FastPitchModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-mt-exported-megatronnmtmodel.yaml for nemo.collections.nlp.models.MegatronNMTModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/asr-scr-exported-encdecclsmodel.yaml for nemo.collections.asr.models.classification_models.EncDecClassificationModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/tts-exported-radttsmodel.yaml for nemo.collections.tts.models.RadTTSModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/tts-exported-hifiganmodel.yaml for nemo.collections.tts.models.HifiGanModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-tc-exported-bert.yaml for nemo.collections.nlp.models.TextClassificationModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-tkc-exported-bert.yaml for nemo.collections.nlp.models.TokenClassificationModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/asr-stt-exported-encdecctcmodel.yaml for nemo.collections.asr.models.EncDecCTCModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/asr-stt-exported-encdectcmodelbpe.yaml for nemo.collections.asr.models.EncDecCTCModelBPE
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-qa-exported-bert.yaml for nemo.collections.nlp.models.QAModel
[NeMo I 2023-10-30 07:34:06 schema:161] Loaded schema file /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/nlp-isc-exported-bert.yaml for nemo.collections.nlp.models.IntentSlotClassificationModel
[NeMo I 2023-10-30 07:34:06 schema:200] Found validation schema for nemo.collections.tts.models.HifiGanModel at /usr/local/lib/python3.10/dist-packages/nemo2riva/validation_schemas/tts-exported-hifiganmodel.yaml
[NeMo I 2023-10-30 07:34:06 schema:229] Checking installed NeMo version … 1.20.0 OK (>=1.1)
[NeMo I 2023-10-30 07:34:06 artifacts:59] Found model at ./model_weights.ckpt
[NeMo I 2023-10-30 07:34:06 artifacts:136] Retrieved artifacts: dict_keys([‘model_config.yaml’])
[NeMo I 2023-10-30 07:34:06 cookbook:78] Exporting model HifiGanModel with config=ExportConfig(export_subnet=None, export_format=‘ONNX’, export_file=‘model_graph.onnx’, encryption=True, autocast=False, max_dim=None, export_args={})
Removing weight norm…
Removing weight norm…
[NeMo I 2023-10-30 07:34:08 exportable:130] Successfully exported HifiGanModel to /tmp/tmp2wdv_7cs/model_graph.onnx
Traceback (most recent call last):
File “/usr/local/bin/nemo2riva”, line 8, in
sys.exit(nemo2riva())
File “/usr/local/lib/python3.10/dist-packages/nemo2riva/cli/nemo2riva.py”, line 49, in nemo2riva
Nemo2Riva(args)
File “/usr/local/lib/python3.10/dist-packages/nemo2riva/convert.py”, line 81, in Nemo2Riva
export_model(
File “/usr/local/lib/python3.10/dist-packages/nemo2riva/cookbook.py”, line 141, in export_model
create_artifact(
File “/usr/local/lib/python3.10/dist-packages/nemo2riva/artifacts.py”, line 92, in create_artifact
af.encrypt()
File “”, line 128, in encrypt
PermissionError: Cannot encrypt the artifact without encryption