runtime error
Exit code: 1. Reason: ��██▌ | 209/458 [00:13<00:16, 15.51it/s, Materializing param=model.language_model.layers.23.input_layernorm.weight] Traceback (most recent call last): File "/home/user/app/app.py", line 8, in <module> model = Mistral3ForConditionalGeneration.from_pretrained( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/.local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 4063, in from_pretrained loading_info, disk_offload_index = cls._load_pretrained_model(model, state_dict, checkpoint_files, load_config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/.local/lib/python3.11/site-packages/transformers/modeling_utils.py", line 4182, in _load_pretrained_model loading_info, disk_offload_index = convert_and_load_state_dict_in_model( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/.local/lib/python3.11/site-packages/transformers/core_model_loading.py", line 1204, in convert_and_load_state_dict_in_model disk_offload_index = offload_and_maybe_resave_param( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/.local/lib/python3.11/site-packages/transformers/core_model_loading.py", line 923, in offload_and_maybe_resave_param disk_offload_index = offload_weight(param, target_name, disk_offload_folder, disk_offload_index) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/.local/lib/python3.11/site-packages/transformers/integrations/accelerate.py", line 485, in offload_weight raise ValueError( ValueError: The current `device_map` had weights offloaded to the disk, which needed to be re-saved. This is either because the weights are not in `safetensors` format, or because the model uses an internal weight format different than the one saved (i.e. most MoE models). Please provide an `offload_folder` for them in `from_pretrained`.
Container logs:
Fetching error logs...