How to set the temperature
#25
by
aakash1307
- opened
I am slightly new to the LLAVA ecosystem so wanted to check how to set the temperature. In the documentation, I can't find any parameter similar to temperature so wanted to confirm how to set it or the model ensures the output is same for a certain image?
Hi, you can just pass the temperature argument to the generate method. See here for more details: https://huggingface.co/docs/transformers/v4.40.1/en/generation_strategies.