mistralai

/

Codestral-22B-v0.1

like 1.01k

Here are a few repos that are HF compatible:

• https://huggingface.co/legraphista/Codestral-22B-v0.1-hf-FIM-fix
• https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf

And the script: https://huggingface.co/legraphista/Codestral-22B-v0.1-hf-FIM-fix/blob/main/convert_mistral_weights_to_hf-22B.py

Thank you.

As mistral themselves uploaded the HF compatible ckpt, any reason @salaki for the need of script ?

@vanshils can you share the link to the HF compatible ckpt?

Thank you.

hh

@salaki https://huggingface.co/mistralai/Codestral-22B-v0.1/tree/main

@vanshils can I use https://huggingface.co/docs/transformers/v4.35.2/en/main_classes/trainer#transformers.TrainingArguments.per_device_train_batch_size to finetune this model?