Progress bar
#4
by
enricoburivf
- opened
Hi! Love the model.
However, inference is quite slow, as you certainly know.
It would be super helpful if you could add the option to print a progress bar / a tqdm, to check how many batches have been processed already.
Thanks in advance.
How are you currently running inference with the model? I should be quite fast if implemented properly. A fast and easy way to use it is probably with the zeroshotclassification pipeline: https://huggingface.co/docs/transformers/en/main_classes/pipelines#transformers.ZeroShotClassificationPipeline
Don't remember if the pipeline natively provides a progress bar, but here is example code for adding one: https://huggingface.co/docs/transformers/en/main_classes/pipelines#pipeline-batching