Would be nice to have the openchat.json config directly in the repo
I'm trying to test the model using the openchat api server:
python -m ochat.serving.openai_api_server --model berkeley-nest/Starling-LM-7B-alpha.
Looks like the code is looking for the openchat.json file:
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/mlaprise/miniconda3/envs/openchat/lib/python3.11/site-packages/ochat/serving/openai_api_server.py", line 348, in
with open(cached_file(path_or_repo_id=args.model, filename="openchat.json"), "r") as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/mlaprise/miniconda3/envs/openchat/lib/python3.11/site-packages/transformers/utils/hub.py", line 481, in cached_file
raise EnvironmentError(
OSError: berkeley-nest/Starling-LM-7B-alpha does not appear to have a file named openchat.json. Checkout 'https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha/main' for available files.
Thank you for the comment! I just copied their openchat.json and uploaded here!