Chunking for generation:   0%|          | 0/13 [00:00<?, ?it/s]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 64. Only generating 0 .
INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 64. Only generating 64 .
INFO:root:vllm: loading model: /media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1, tp=2, trust_remote_code=0
2023-12-23 08:57:45,951	INFO worker.py:1673 -- Started a local Ray instance.
INFO 12-23 08:57:46 llm_engine.py:73] Initializing an LLM engine with config: model='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer='/media/hangyu5/Home/Documents/Hugging-Face/LM_cocktail/LMCocktail-10.7B-v1', tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.float16, max_seq_len=4096, download_dir=None, load_format=auto, tensor_parallel_size=2, quantization=None, enforce_eager=False, seed=0)
INFO 12-23 08:58:02 llm_engine.py:223] # GPU blocks: 4457, # CPU blocks: 2730
(RayWorkerVllm pid=57929) [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
(RayWorkerVllm pid=57929) INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.36s/it]
(RayWorkerVllm pid=57929) INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.
(RayWorkerVllm pid=57928) INFO 12-23 08:58:05 model_runner.py:394] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.85s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.73s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.72s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.42s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.45s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.00s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.36s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.01s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]

Chunking for generation:  15%|█▌        | 2/13 [07:49<43:04, 234.92s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 128. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.15s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.77s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.85s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.75s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.08s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.52s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.75s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:23<00:00, 23.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:19<00:00, 19.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.81s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.36it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.36it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.80s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.42s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.42s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.05it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.02s/it]

Chunking for generation:  23%|██▎       | 3/13 [16:30<59:01, 354.16s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 192. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.37it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.37it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.56s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:32<00:00, 32.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.14s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.81s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.35s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.72s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.00s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.14s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.76s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it]

Chunking for generation:  31%|███       | 4/13 [23:50<57:52, 385.86s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 256. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.30it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.30it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.70s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:26<00:00, 26.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.84s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.36s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.45s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.76s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.10s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.72s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.01s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.23s/it]

Chunking for generation:  38%|███▊      | 5/13 [32:12<56:51, 426.44s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 320. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.56s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:22<00:00, 22.14s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.70s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.12it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.12it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.76s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.00s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.23it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.23it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.05it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.63s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.41s/it]

Chunking for generation:  46%|████▌     | 6/13 [39:18<49:44, 426.29s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 384. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.73s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.14s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.21s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.21s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.10s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.80s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:27<00:00, 27.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.33s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.45s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.77s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.56s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.36s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.36s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.80s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.13s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.13s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.76s/it]

Chunking for generation:  54%|█████▍    | 7/13 [45:53<41:37, 416.20s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 448. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.35s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.70s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:16<00:00, 16.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.14it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.14it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.40it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.40it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.92s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.68s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.68s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.56s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.93s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.01s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.01s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.84s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.47s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.47s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.72s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.72s/it]

Chunking for generation:  62%|██████▏   | 8/13 [51:36<32:45, 393.15s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 512. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.29s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.56s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.56s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:53<00:00, 53.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.34s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.34s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.92s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.20s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.92s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.67it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.67it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.80it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.80it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.03it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.03it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.35s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.85s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:24<00:00, 24.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.08s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.67s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.67s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.15s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.06s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.27s/it]

Chunking for generation:  69%|██████▉   | 9/13 [58:17<26:22, 395.73s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 576. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.66s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.66s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.35s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.36s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.81s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  8.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  8.00s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.30it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.30it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.88s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.88s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.29s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.80s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.51s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.51s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.45s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.10s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.10s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.73s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.73s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.99s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.99s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:54<00:00, 54.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.44it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.44it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.77s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.50s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.50s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.33s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.33s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.00it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.00it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.11it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.11it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.62s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.62s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  5.49it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  5.48it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.00it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.00it/s]

Chunking for generation:  77%|███████▋  | 10/13 [1:04:30<19:25, 388.50s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 640. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.98it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.98it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.93s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.06s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.74s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.74s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.74it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.74it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.45s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.45s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.75s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.75s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  6.27it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  6.26it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  4.06it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  4.06it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.80s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.80s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.43it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.43it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.61it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.61it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.54it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.53it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.11it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.11it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it]
Processed prompts: 100%|██████████| 1/1 [00:51<00:00, 51.11s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.58s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.58s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.07it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.07it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.20it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.20it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  5.52it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  5.52it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.21it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.21it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.95it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.95it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.48s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.48s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.05it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.04it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.71it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.71it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.26s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.45it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.45it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.24it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.24it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.76s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.31s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.08s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.08s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.76s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.76s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.87s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.87s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.09s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.09s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.52s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.69it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.69it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.92s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:14<00:00, 14.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.52s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.52s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.82s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.82s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.55s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.55s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.60s/it]

Chunking for generation:  85%|████████▍ | 11/13 [1:08:47<11:36, 348.42s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 704. Only generating 64 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.18s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.18s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.15s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.01it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  1.01it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.61it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  2.61it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.81s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.51it/s]
Processed prompts: 100%|██████████| 1/1 [00:00<00:00,  3.51it/s]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.19s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.19s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.43s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.43s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.59s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.59s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.29s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.29s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.02s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.63s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.46s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.04s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.04s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.64s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.69s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.69s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.98s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.14s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.14s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.95s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.95s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]
Processed prompts: 100%|██████████| 1/1 [00:15<00:00, 15.83s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.70s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.15s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.22s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.22s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.40s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.40s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.30s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.30s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.41s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.41s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.84s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.84s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.65s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.23s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.70s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.70s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.32s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.32s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.53s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.53s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.92s/it]
Processed prompts: 100%|██████████| 1/1 [00:02<00:00,  2.92s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.49s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.49s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.57s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.57s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]

Chunking for generation:  92%|█████████▏| 12/13 [1:15:10<05:59, 359.02s/it]INFO:root:Loading outputs from output/chatgpt_fn_--SOLAR-10-7B-LMCocktail/model_outputs.json
INFO:root:Found 768. Only generating 37 .


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.28s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.38s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.05s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.12s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.12s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.24s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.27s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.91s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.91s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.90s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.90s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.61s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.61s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.96s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.96s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.78s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.86s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.86s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.25s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.25s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.60s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.60s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.17s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it]
Processed prompts: 100%|██████████| 1/1 [00:12<00:00, 12.03s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.63s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.64s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:07<00:00,  7.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.97s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  8.97s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.93s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.79s/it]
Processed prompts: 100%|██████████| 1/1 [00:01<00:00,  1.79s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.16s/it]
Processed prompts: 100%|██████████| 1/1 [00:04<00:00,  4.16s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:03<00:00,  3.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:11<00:00, 11.77s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.89s/it]
Processed prompts: 100%|██████████| 1/1 [00:05<00:00,  5.89s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]
Processed prompts: 100%|██████████| 1/1 [00:10<00:00, 10.37s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.94s/it]
Processed prompts: 100%|██████████| 1/1 [00:09<00:00,  9.94s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.71s/it]
Processed prompts: 100%|██████████| 1/1 [00:06<00:00,  6.71s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.77s/it]
Processed prompts: 100%|██████████| 1/1 [00:21<00:00, 21.78s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it]
Processed prompts: 100%|██████████| 1/1 [00:18<00:00, 18.39s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  9.00s/it]
Processed prompts: 100%|██████████| 1/1 [00:08<00:00,  9.00s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it]
Processed prompts: 100%|██████████| 1/1 [00:17<00:00, 17.07s/it]


Processed prompts:   0%|          | 0/1 [00:00<?, ?it/s]

Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it]
Processed prompts: 100%|██████████| 1/1 [00:13<00:00, 13.05s/it]

Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 346.18s/it]
Chunking for generation: 100%|██████████| 13/13 [1:20:27<00:00, 371.32s/it]
INFO:root:Evaluating the SOLAR-10.7B-LMCocktail outputs.
INFO:root:Creating the annotator from `chatgpt_fn`.
INFO:root:Saving annotations to `/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json`.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
https://api.openai-proxy.org/v1

Annotation chunk:   0%|          | 0/7 [00:00<?, ?it/s]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/128 [00:01<02:22,  1.12s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   2%|▏         | 2/128 [00:01<01:17,  1.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▍         | 6/128 [00:02<00:34,  3.50it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▌         | 7/128 [00:02<00:31,  3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   6%|▋         | 8/128 [00:03<00:48,  2.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▉         | 12/128 [00:03<00:25,  4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  12%|█▏        | 15/128 [00:04<00:29,  3.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  14%|█▍        | 18/128 [00:04<00:20,  5.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 20/128 [00:05<00:21,  4.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▋        | 21/128 [00:05<00:24,  4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  17%|█▋        | 22/128 [00:05<00:23,  4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  19%|█▉        | 24/128 [00:05<00:17,  5.87it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|█▉        | 25/128 [00:06<00:22,  4.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|██        | 26/128 [00:06<00:24,  4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  21%|██        | 27/128 [00:06<00:24,  4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  22%|██▏       | 28/128 [00:06<00:21,  4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  23%|██▎       | 30/128 [00:07<00:29,  3.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 34/128 [00:08<00:16,  5.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 35/128 [00:08<00:26,  3.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  29%|██▉       | 37/128 [00:09<00:19,  4.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  30%|███       | 39/128 [00:09<00:15,  5.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  32%|███▏      | 41/128 [00:10<00:21,  4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  34%|███▍      | 44/128 [00:10<00:14,  5.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  36%|███▌      | 46/128 [00:11<00:26,  3.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  39%|███▉      | 50/128 [00:12<00:18,  4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  40%|███▉      | 51/128 [00:12<00:17,  4.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  41%|████▏     | 53/128 [00:12<00:15,  4.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  43%|████▎     | 55/128 [00:13<00:16,  4.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  44%|████▍     | 56/128 [00:13<00:15,  4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  45%|████▍     | 57/128 [00:13<00:16,  4.25it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▌     | 59/128 [00:13<00:12,  5.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  47%|████▋     | 60/128 [00:14<00:14,  4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  48%|████▊     | 61/128 [00:14<00:15,  4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  48%|████▊     | 62/128 [00:14<00:15,  4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  50%|█████     | 64/128 [00:14<00:11,  5.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  51%|█████     | 65/128 [00:15<00:14,  4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 66/128 [00:15<00:14,  4.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 67/128 [00:15<00:14,  4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  54%|█████▍    | 69/128 [00:16<00:12,  4.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  55%|█████▍    | 70/128 [00:16<00:14,  4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  56%|█████▋    | 72/128 [00:16<00:10,  5.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  58%|█████▊    | 74/128 [00:17<00:10,  5.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  59%|█████▊    | 75/128 [00:17<00:12,  4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  60%|██████    | 77/128 [00:17<00:08,  5.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  61%|██████    | 78/128 [00:17<00:09,  5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  62%|██████▏   | 79/128 [00:18<00:10,  4.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  62%|██████▎   | 80/128 [00:18<00:11,  4.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  63%|██████▎   | 81/128 [00:18<00:09,  4.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  64%|██████▍   | 82/128 [00:18<00:10,  4.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  65%|██████▍   | 83/128 [00:19<00:12,  3.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▋   | 85/128 [00:19<00:08,  4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  67%|██████▋   | 86/128 [00:19<00:08,  5.14it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 87/128 [00:20<00:09,  4.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  69%|██████▉   | 88/128 [00:20<00:10,  4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|███████   | 90/128 [00:20<00:08,  4.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  71%|███████   | 91/128 [00:20<00:07,  4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  72%|███████▏  | 92/128 [00:21<00:07,  5.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  73%|███████▎  | 93/128 [00:21<00:07,  4.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▍  | 95/128 [00:21<00:06,  5.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  75%|███████▌  | 96/128 [00:21<00:07,  4.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  76%|███████▌  | 97/128 [00:22<00:06,  4.83it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 98/128 [00:22<00:08,  3.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  79%|███████▉  | 101/128 [00:22<00:05,  5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  80%|███████▉  | 102/128 [00:23<00:05,  4.95it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  80%|████████  | 103/128 [00:23<00:05,  4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  81%|████████▏ | 104/128 [00:23<00:05,  4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  82%|████████▏ | 105/128 [00:23<00:05,  4.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  83%|████████▎ | 106/128 [00:24<00:04,  5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▎ | 107/128 [00:24<00:03,  5.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▍ | 108/128 [00:24<00:04,  4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  85%|████████▌ | 109/128 [00:24<00:04,  4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  86%|████████▌ | 110/128 [00:24<00:03,  5.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  87%|████████▋ | 111/128 [00:25<00:03,  4.50it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 112/128 [00:25<00:03,  4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 113/128 [00:25<00:03,  4.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  89%|████████▉ | 114/128 [00:25<00:02,  4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  90%|████████▉ | 115/128 [00:26<00:03,  3.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████ | 116/128 [00:26<00:03,  4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  92%|█████████▏| 118/128 [00:26<00:02,  4.24it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  94%|█████████▍| 120/128 [00:27<00:01,  4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▌| 122/128 [00:27<00:01,  4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  96%|█████████▌| 123/128 [00:28<00:01,  3.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  98%|█████████▊| 125/128 [00:28<00:00,  4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  99%|█████████▉| 127/128 [00:28<00:00,  4.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches: 100%|██████████| 128/128 [00:29<00:00,  4.50it/s]
prompt_batches: 100%|██████████| 128/128 [00:29<00:00,  4.39it/s]
*** SIGTERM received at time=1703326722 on cpu 18 ***
PC: @           0x5547b8  (unknown)  _PyObject_VectorcallTstate.lto_priv.14
    @     0x7fb277d26520   96618656  (unknown)
    @     0x7fb27745d200  (unknown)  (unknown)
    @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: *** SIGTERM received at time=1703326722 on cpu 18 ***
[2023-12-23 10:18:42,710 E 206008 55975] logging.cc:361: PC: @           0x5547b8  (unknown)  _PyObject_VectorcallTstate.lto_priv.14
[2023-12-23 10:18:42,712 E 206008 55975] logging.cc:361:     @     0x7fb277d26520   96618656  (unknown)
[2023-12-23 10:18:42,714 E 206008 55975] logging.cc:361:     @     0x7fb27745d200  (unknown)  (unknown)
[2023-12-23 10:18:42,719 E 206008 55975] logging.cc:361:     @           0x869d20  (unknown)  (unknown)
INFO:root:Completed 128 examples in 29.3 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  14%|█▍        | 1/7 [00:29<02:58, 29.67s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/128 [00:01<02:53,  1.37s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   3%|▎         | 4/128 [00:01<00:42,  2.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▍         | 6/128 [00:02<00:43,  2.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▌         | 7/128 [00:02<00:36,  3.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▊         | 11/128 [00:03<00:29,  3.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  10%|█         | 13/128 [00:03<00:28,  4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  12%|█▎        | 16/128 [00:04<00:24,  4.58it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  14%|█▍        | 18/128 [00:04<00:22,  4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  15%|█▍        | 19/128 [00:05<00:24,  4.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 20/128 [00:05<00:23,  4.65it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▋        | 21/128 [00:05<00:20,  5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  17%|█▋        | 22/128 [00:05<00:25,  4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  18%|█▊        | 23/128 [00:07<01:01,  1.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  23%|██▎       | 30/128 [00:08<00:23,  4.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  25%|██▌       | 32/128 [00:08<00:20,  4.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  26%|██▌       | 33/128 [00:08<00:20,  4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 35/128 [00:09<00:21,  4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  29%|██▉       | 37/128 [00:09<00:21,  4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  30%|███       | 39/128 [00:09<00:18,  4.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  31%|███▏      | 40/128 [00:10<00:21,  4.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  33%|███▎      | 42/128 [00:10<00:22,  3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  34%|███▍      | 44/128 [00:11<00:20,  4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  36%|███▌      | 46/128 [00:11<00:15,  5.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  37%|███▋      | 47/128 [00:11<00:18,  4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  38%|███▊      | 48/128 [00:12<00:20,  3.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  38%|███▊      | 49/128 [00:12<00:17,  4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  41%|████      | 52/128 [00:12<00:14,  5.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  41%|████▏     | 53/128 [00:13<00:18,  4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  42%|████▏     | 54/128 [00:13<00:17,  4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  43%|████▎     | 55/128 [00:13<00:15,  4.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  45%|████▍     | 57/128 [00:14<00:15,  4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  45%|████▌     | 58/128 [00:14<00:14,  4.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▌     | 59/128 [00:14<00:15,  4.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  48%|████▊     | 61/128 [00:14<00:13,  4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  48%|████▊     | 62/128 [00:15<00:16,  3.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  50%|█████     | 64/128 [00:15<00:16,  3.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 66/128 [00:15<00:11,  5.46it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 67/128 [00:16<00:15,  3.86it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  53%|█████▎    | 68/128 [00:16<00:16,  3.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  55%|█████▌    | 71/128 [00:16<00:09,  6.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  56%|█████▋    | 72/128 [00:17<00:15,  3.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  57%|█████▋    | 73/128 [00:17<00:13,  4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  58%|█████▊    | 74/128 [00:17<00:12,  4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  60%|██████    | 77/128 [00:18<00:12,  4.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  61%|██████    | 78/128 [00:19<00:12,  3.98it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  64%|██████▍   | 82/128 [00:19<00:10,  4.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  65%|██████▍   | 83/128 [00:20<00:09,  4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▌   | 84/128 [00:20<00:08,  4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▋   | 85/128 [00:20<00:08,  5.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 87/128 [00:20<00:10,  4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|███████   | 90/128 [00:21<00:07,  4.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  72%|███████▏  | 92/128 [00:22<00:09,  3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▍  | 95/128 [00:22<00:05,  5.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  75%|███████▌  | 96/128 [00:22<00:06,  4.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  76%|███████▌  | 97/128 [00:23<00:07,  4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 98/128 [00:23<00:06,  4.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  78%|███████▊  | 100/128 [00:23<00:05,  4.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  80%|███████▉  | 102/128 [00:24<00:06,  4.27it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  80%|████████  | 103/128 [00:24<00:06,  4.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  82%|████████▏ | 105/128 [00:24<00:04,  5.39it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  83%|████████▎ | 106/128 [00:24<00:03,  5.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▎ | 107/128 [00:25<00:05,  4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  85%|████████▌ | 109/128 [00:25<00:03,  5.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  86%|████████▌ | 110/128 [00:25<00:03,  5.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  87%|████████▋ | 111/128 [00:26<00:04,  3.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 112/128 [00:26<00:03,  4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 113/128 [00:26<00:02,  5.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  89%|████████▉ | 114/128 [00:26<00:02,  4.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  90%|████████▉ | 115/128 [00:26<00:02,  5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████ | 116/128 [00:27<00:02,  4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████▏| 117/128 [00:27<00:02,  4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  93%|█████████▎| 119/128 [00:27<00:01,  4.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  94%|█████████▍| 120/128 [00:27<00:01,  5.35it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▍| 121/128 [00:28<00:01,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▌| 122/128 [00:28<00:01,  3.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  97%|█████████▋| 124/128 [00:29<00:01,  3.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  99%|█████████▉| 127/128 [00:29<00:00,  4.23it/s]
prompt_batches: 100%|██████████| 128/128 [00:29<00:00,  4.29it/s]
INFO:root:Completed 128 examples in 29.9 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  29%|██▊       | 2/7 [01:00<02:30, 30.06s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/128 [00:01<02:54,  1.37s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▍         | 6/128 [00:02<00:36,  3.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▌         | 7/128 [00:02<00:32,  3.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   7%|▋         | 9/128 [00:02<00:23,  5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   8%|▊         | 10/128 [00:02<00:22,  5.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▊         | 11/128 [00:03<00:31,  3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▉         | 12/128 [00:03<00:36,  3.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  12%|█▏        | 15/128 [00:03<00:21,  5.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  12%|█▎        | 16/128 [00:04<00:25,  4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  13%|█▎        | 17/128 [00:04<00:24,  4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  14%|█▍        | 18/128 [00:04<00:24,  4.55it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 20/128 [00:04<00:19,  5.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▋        | 21/128 [00:05<00:27,  3.84it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  18%|█▊        | 23/128 [00:05<00:22,  4.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|█▉        | 25/128 [00:06<00:21,  4.84it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|██        | 26/128 [00:06<00:23,  4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  21%|██        | 27/128 [00:06<00:25,  3.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  22%|██▏       | 28/128 [00:07<00:27,  3.67it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  24%|██▍       | 31/128 [00:07<00:19,  5.09it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  25%|██▌       | 32/128 [00:07<00:20,  4.61it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 34/128 [00:08<00:23,  3.94it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  28%|██▊       | 36/128 [00:08<00:21,  4.27it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  30%|██▉       | 38/128 [00:09<00:19,  4.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  31%|███▏      | 40/128 [00:12<00:55,  1.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  38%|███▊      | 49/128 [00:12<00:17,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  41%|████      | 52/128 [00:12<00:13,  5.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  43%|████▎     | 55/128 [00:13<00:16,  4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  45%|████▌     | 58/128 [00:14<00:17,  4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  47%|████▋     | 60/128 [00:14<00:14,  4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  49%|████▉     | 63/128 [00:16<00:24,  2.68it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  55%|█████▍    | 70/128 [00:17<00:11,  4.87it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  56%|█████▋    | 72/128 [00:17<00:12,  4.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  58%|█████▊    | 74/128 [00:18<00:12,  4.40it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  59%|█████▉    | 76/128 [00:18<00:12,  4.09it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  60%|██████    | 77/128 [00:19<00:12,  4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  61%|██████    | 78/128 [00:19<00:12,  3.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  63%|██████▎   | 81/128 [00:19<00:10,  4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  64%|██████▍   | 82/128 [00:20<00:09,  4.65it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  65%|██████▍   | 83/128 [00:20<00:09,  4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▌   | 84/128 [00:20<00:08,  4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▋   | 85/128 [00:20<00:09,  4.61it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  67%|██████▋   | 86/128 [00:20<00:08,  5.01it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 87/128 [00:21<00:08,  4.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  69%|██████▉   | 88/128 [00:21<00:08,  4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|██████▉   | 89/128 [00:21<00:07,  5.32it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|███████   | 90/128 [00:21<00:10,  3.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  73%|███████▎  | 93/128 [00:22<00:09,  3.72it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  73%|███████▎  | 94/128 [00:22<00:08,  4.19it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▍  | 95/128 [00:23<00:09,  3.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 98/128 [00:23<00:07,  4.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 99/128 [00:23<00:06,  4.73it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  78%|███████▊  | 100/128 [00:24<00:06,  4.66it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  79%|███████▉  | 101/128 [00:24<00:05,  4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  80%|████████  | 103/128 [00:25<00:06,  3.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  82%|████████▏ | 105/128 [00:25<00:04,  4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  83%|████████▎ | 106/128 [00:25<00:04,  4.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▎ | 107/128 [00:25<00:03,  5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▍ | 108/128 [00:25<00:04,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  85%|████████▌ | 109/128 [00:26<00:03,  5.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  86%|████████▌ | 110/128 [00:26<00:03,  5.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  87%|████████▋ | 111/128 [00:26<00:03,  4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 112/128 [00:26<00:02,  5.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 113/128 [00:27<00:03,  3.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  90%|████████▉ | 115/128 [00:27<00:02,  5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████ | 116/128 [00:27<00:02,  4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████▏| 117/128 [00:27<00:02,  4.38it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  92%|█████████▏| 118/128 [00:28<00:02,  3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▍| 121/128 [00:28<00:01,  5.55it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▌| 122/128 [00:28<00:01,  5.33it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  96%|█████████▌| 123/128 [00:29<00:01,  4.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  97%|█████████▋| 124/128 [00:29<00:00,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  98%|█████████▊| 125/128 [00:29<00:00,  4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  99%|█████████▉| 127/128 [00:29<00:00,  5.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches: 100%|██████████| 128/128 [00:30<00:00,  3.62it/s]
prompt_batches: 100%|██████████| 128/128 [00:30<00:00,  4.21it/s]
INFO:root:Completed 128 examples in 30.5 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  43%|████▎     | 3/7 [01:30<02:01, 30.44s/it]INFO:root:Annotating 127 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 127 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/127 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/127 [00:01<02:13,  1.06s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   2%|▏         | 3/127 [00:01<00:41,  2.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▍         | 6/127 [00:02<00:40,  2.96it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   8%|▊         | 10/127 [00:02<00:20,  5.64it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▉         | 12/127 [00:03<00:28,  4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  10%|█         | 13/127 [00:03<00:29,  3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  13%|█▎        | 16/127 [00:04<00:26,  4.21it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  13%|█▎        | 17/127 [00:04<00:27,  4.05it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 20/127 [00:04<00:17,  6.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  17%|█▋        | 22/127 [00:05<00:26,  4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  18%|█▊        | 23/127 [00:05<00:24,  4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|██        | 26/127 [00:06<00:24,  4.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  21%|██▏       | 27/127 [00:06<00:22,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  22%|██▏       | 28/127 [00:06<00:20,  4.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  24%|██▎       | 30/127 [00:06<00:16,  5.91it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  24%|██▍       | 31/127 [00:07<00:24,  3.95it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  25%|██▌       | 32/127 [00:07<00:27,  3.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  28%|██▊       | 35/127 [00:08<00:16,  5.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  28%|██▊       | 36/127 [00:08<00:20,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  29%|██▉       | 37/127 [00:08<00:21,  4.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  30%|██▉       | 38/127 [00:09<00:26,  3.42it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  32%|███▏      | 41/127 [00:09<00:15,  5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  33%|███▎      | 42/127 [00:09<00:16,  5.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  34%|███▍      | 43/127 [00:10<00:26,  3.23it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  36%|███▌      | 46/127 [00:10<00:16,  4.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  38%|███▊      | 48/127 [00:11<00:23,  3.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  42%|████▏     | 53/127 [00:12<00:19,  3.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▌     | 58/127 [00:13<00:15,  4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▋     | 59/127 [00:14<00:15,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  50%|████▉     | 63/127 [00:14<00:13,  4.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  51%|█████     | 65/127 [00:14<00:11,  5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 66/127 [00:15<00:10,  5.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:openai._base_client:Retrying request to /chat/completions in 0.939927 seconds
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  54%|█████▎    | 68/127 [00:21<01:02,  1.06s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 86/127 [00:22<00:09,  4.15it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|███████   | 89/127 [00:22<00:09,  4.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  72%|███████▏  | 92/127 [00:23<00:07,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▍  | 94/127 [00:23<00:07,  4.13it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  76%|███████▌  | 96/127 [00:24<00:06,  4.75it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 98/127 [00:24<00:05,  5.36it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  79%|███████▊  | 100/127 [00:25<00:09,  2.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  82%|████████▏ | 104/127 [00:26<00:05,  4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▍ | 107/127 [00:26<00:03,  5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  86%|████████▌ | 109/127 [00:27<00:04,  4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  87%|████████▋ | 110/127 [00:27<00:03,  4.29it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  89%|████████▉ | 113/127 [00:28<00:03,  3.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  92%|█████████▏| 117/127 [00:28<00:01,  5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  93%|█████████▎| 118/127 [00:29<00:02,  4.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  94%|█████████▎| 119/127 [00:30<00:02,  2.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  98%|█████████▊| 124/127 [00:30<00:00,  5.44it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  99%|█████████▉| 126/127 [00:30<00:00,  4.97it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"

prompt_batches: 100%|██████████| 127/127 [00:31<00:00,  4.07it/s]
*** SIGTERM received at time=1703326815 on cpu 43 ***
PC: @           0x5138fa  (unknown)  _PyEval_EvalFrameDefault
    @     0x7fb277d26520   96618512  (unknown)
    @     0x7fb277426740  (unknown)  (unknown)
    @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: *** SIGTERM received at time=1703326815 on cpu 43 ***
[2023-12-23 10:20:15,631 E 209804 55975] logging.cc:361: PC: @           0x5138fa  (unknown)  _PyEval_EvalFrameDefault
[2023-12-23 10:20:15,633 E 209804 55975] logging.cc:361:     @     0x7fb277d26520   96618512  (unknown)
[2023-12-23 10:20:15,635 E 209804 55975] logging.cc:361:     @     0x7fb277426740  (unknown)  (unknown)
[2023-12-23 10:20:15,640 E 209804 55975] logging.cc:361:     @           0x869d20  (unknown)  (unknown)
INFO:root:Completed 127 examples in 31.3 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  57%|█████▋    | 4/7 [02:02<01:32, 30.94s/it]INFO:root:Annotating 128 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 128 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/128 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/128 [00:01<02:54,  1.38s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▍         | 6/128 [00:02<00:35,  3.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   5%|▌         | 7/128 [00:02<00:34,  3.47it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   8%|▊         | 10/128 [00:02<00:20,  5.69it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   9%|▉         | 12/128 [00:03<00:36,  3.20it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  12%|█▎        | 16/128 [00:04<00:26,  4.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  13%|█▎        | 17/128 [00:04<00:26,  4.16it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 20/128 [00:04<00:20,  5.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▋        | 21/128 [00:05<00:29,  3.62it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|█▉        | 25/128 [00:06<00:20,  5.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|██        | 26/128 [00:06<00:22,  4.58it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  21%|██        | 27/128 [00:06<00:25,  4.03it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  23%|██▎       | 30/128 [00:07<00:18,  5.43it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Sleeping 2 before retrying to call openai API...
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 400 Bad Request"
WARNING:root:OpenAIError: Error code: 400 - {'error': {'message': "Sorry! We've encountered an issue with repetitive patterns in your prompt. Please try again with a different prompt.", 'type': 'invalid_request_error', 'param': 'prompt', 'code': None}}.
WARNING:root:Unknown error. 
 It's likely a rate limit so we are retrying...
INFO:root:Max rate limit reached.


prompt_batches:  24%|██▍       | 31/128 [01:21<20:26, 12.65s/it]
prompt_batches: 100%|██████████| 128/128 [01:21<00:00,  1.56it/s]
*** SIGTERM received at time=1703326898 on cpu 6 ***
*** SIGTERM received at time=1703326898 on cpu 8 ***
PC: @           0x50f2b9  (unknown)  _PyEval_EvalFrameDefault
    @     0x7fb277d26520  (unknown)  (unknown)
PC: @           0x50fdd5  (unknown)  _PyEval_EvalFrameDefault
    @     0x7fb277d26520   96618360  (unknown)
    @     0x7fb2770c16c0  965637776  (unknown)
    @     0x7fb277426740  (unknown)  (unknown)
    @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 6 ***
[2023-12-23 10:21:38,138 E 211132 55975] logging.cc:361: PC: @           0x50f2b9  (unknown)  _PyEval_EvalFrameDefault
[2023-12-23 10:21:38,141 E 211132 55975] logging.cc:361:     @     0x7fb277d26520  (unknown)  (unknown)
[2023-12-23 10:21:38,143 E 211132 55975] logging.cc:361:     @     0x7fb2770c16c0  965637776  (unknown)
    @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: *** SIGTERM received at time=1703326898 on cpu 8 ***
[2023-12-23 10:21:38,144 E 211134 55975] logging.cc:361: PC: @           0x50fdd5  (unknown)  _PyEval_EvalFrameDefault
[2023-12-23 10:21:38,147 E 211134 55975] logging.cc:361:     @     0x7fb277d26520   96618360  (unknown)
[2023-12-23 10:21:38,147 E 211132 55975] logging.cc:361:     @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:21:38,151 E 211134 55975] logging.cc:361:     @     0x7fb277426740  (unknown)  (unknown)
[2023-12-23 10:21:38,157 E 211134 55975] logging.cc:361:     @           0x869d20  (unknown)  (unknown)
INFO:root:Completed 128 examples in 82.1 seconds.
WARNING:root:Found 0 annotations in:'''

''' but expected 1. We are setting all annotations to None.
WARNING:root:1 samples had no auto annotation. We are filtering them for now. If you are using chain of thought it might be that max_tokens limit is too low. 
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  71%|███████▏  | 5/7 [03:25<01:39, 49.53s/it]INFO:root:Annotating 125 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 125 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/125 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   1%|          | 1/125 [00:03<07:07,  3.45s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   8%|▊         | 10/125 [00:03<00:31,  3.68it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  11%|█         | 14/125 [00:04<00:28,  3.88it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  14%|█▎        | 17/125 [00:04<00:21,  5.08it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  15%|█▌        | 19/125 [00:05<00:26,  4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  18%|█▊        | 22/125 [00:05<00:19,  5.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  19%|█▉        | 24/125 [00:06<00:24,  4.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  20%|██        | 25/125 [00:06<00:23,  4.26it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  22%|██▏       | 28/125 [00:07<00:17,  5.54it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  23%|██▎       | 29/125 [00:07<00:22,  4.23it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  25%|██▍       | 31/125 [00:07<00:18,  5.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  26%|██▋       | 33/125 [00:08<00:15,  5.85it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 34/125 [00:08<00:24,  3.76it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  28%|██▊       | 35/125 [00:08<00:20,  4.30it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  30%|███       | 38/125 [00:09<00:15,  5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  31%|███       | 39/125 [00:10<00:26,  3.25it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  32%|███▏      | 40/125 [00:10<00:22,  3.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  33%|███▎      | 41/125 [00:10<00:28,  2.90it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  35%|███▌      | 44/125 [00:11<00:18,  4.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  37%|███▋      | 46/125 [00:11<00:15,  5.12it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  38%|███▊      | 48/125 [00:11<00:14,  5.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  39%|███▉      | 49/125 [00:12<00:16,  4.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  41%|████      | 51/125 [00:12<00:14,  5.04it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  42%|████▏     | 52/125 [00:12<00:13,  5.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  42%|████▏     | 53/125 [00:12<00:14,  5.10it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  43%|████▎     | 54/125 [00:13<00:17,  4.06it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  44%|████▍     | 55/125 [00:13<00:18,  3.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▌     | 57/125 [00:13<00:12,  5.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▋     | 58/125 [00:13<00:12,  5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  47%|████▋     | 59/125 [00:14<00:14,  4.60it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  48%|████▊     | 60/125 [00:14<00:12,  5.31it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  49%|████▉     | 61/125 [00:14<00:12,  5.24it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  50%|████▉     | 62/125 [00:14<00:13,  4.59it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  50%|█████     | 63/125 [00:14<00:13,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  51%|█████     | 64/125 [00:15<00:17,  3.56it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  52%|█████▏    | 65/125 [00:15<00:15,  3.79it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  54%|█████▎    | 67/125 [00:18<00:43,  1.34it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  61%|██████    | 76/125 [00:19<00:15,  3.18it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  66%|██████▋   | 83/125 [00:19<00:07,  5.53it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 85/125 [00:20<00:08,  4.81it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  70%|██████▉   | 87/125 [00:21<00:07,  4.77it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  71%|███████   | 89/125 [00:21<00:07,  4.52it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  72%|███████▏  | 90/125 [00:21<00:07,  4.41it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▎  | 92/125 [00:21<00:06,  5.49it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  74%|███████▍  | 93/125 [00:22<00:07,  4.48it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  75%|███████▌  | 94/125 [00:23<00:10,  2.83it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  77%|███████▋  | 96/125 [00:23<00:07,  4.02it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  79%|███████▉  | 99/125 [00:23<00:04,  5.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  81%|████████  | 101/125 [00:24<00:05,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  83%|████████▎ | 104/125 [00:24<00:03,  5.32it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▍ | 105/125 [00:24<00:03,  5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  85%|████████▍ | 106/125 [00:25<00:05,  3.71it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  87%|████████▋ | 109/125 [00:25<00:02,  5.43it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  88%|████████▊ | 110/125 [00:26<00:03,  4.45it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  90%|████████▉ | 112/125 [00:26<00:02,  5.98it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  91%|█████████ | 114/125 [00:27<00:02,  4.51it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  92%|█████████▏| 115/125 [00:27<00:02,  4.99it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  93%|█████████▎| 116/125 [00:27<00:01,  4.63it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  94%|█████████▍| 118/125 [00:27<00:01,  5.07it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▌| 119/125 [00:27<00:01,  4.72it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  96%|█████████▌| 120/125 [00:28<00:01,  4.00it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  98%|█████████▊| 122/125 [00:28<00:00,  4.82it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  99%|█████████▉| 124/125 [00:29<00:00,  3.54it/s]
prompt_batches: 100%|██████████| 125/125 [00:29<00:00,  4.24it/s]
INFO:root:Completed 125 examples in 29.6 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk:  86%|████████▌ | 6/7 [03:55<00:42, 42.88s/it]INFO:root:Annotating 37 examples with chatgpt_fn
INFO:root:Using `openai_completions` on 37 prompts using gpt-3.5-turbo-16k-0613.
INFO:root:Kwargs to completion: {'n': 1, 'model': 'gpt-3.5-turbo-16k-0613', 'is_chat': True, 'temperature': 0, 'function_call': {'name': 'print_best_model'}, 'functions': [{'name': 'print_best_model', 'description': 'Print the best model given the preferred output.', 'parameters': {'type': 'object', 'properties': {'best_output': {'type': 'string', 'description': "Name of the best output, should be 'Output (a)' or 'Output (b)'"}}}, 'required': ['best_output']}]}. num_procs=5
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
To disable this warning, you can either:
	- Avoid using `tokenizers` before the fork if possible
	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)


prompt_batches:   0%|          | 0/37 [00:00<?, ?it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:   3%|▎         | 1/37 [00:01<00:44,  1.23s/it]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  16%|█▌        | 6/37 [00:02<00:10,  2.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  19%|█▉        | 7/37 [00:02<00:08,  3.36it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  27%|██▋       | 10/37 [00:02<00:04,  5.70it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  32%|███▏      | 12/37 [00:03<00:07,  3.37it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  43%|████▎     | 16/37 [00:04<00:05,  4.17it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  46%|████▌     | 17/37 [00:04<00:05,  3.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  57%|█████▋    | 21/37 [00:05<00:03,  4.35it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  62%|██████▏   | 23/37 [00:05<00:02,  4.89it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  68%|██████▊   | 25/37 [00:06<00:02,  4.80it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  73%|███████▎  | 27/37 [00:06<00:01,  5.28it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  76%|███████▌  | 28/37 [00:06<00:01,  4.74it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  81%|████████  | 30/37 [00:07<00:01,  4.78it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  84%|████████▍ | 31/37 [00:08<00:01,  3.22it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  95%|█████████▍| 35/37 [00:08<00:00,  4.93it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches:  97%|█████████▋| 36/37 [00:08<00:00,  5.11it/s]INFO:httpx:HTTP Request: POST https://api.openai-proxy.org/v1/chat/completions "HTTP/1.1 200 OK"


prompt_batches: 100%|██████████| 37/37 [00:09<00:00,  3.84it/s]
prompt_batches: 100%|██████████| 37/37 [00:09<00:00,  4.06it/s]
*** SIGTERM received at time=1703326937 on cpu 3 ***
*** SIGTERM received at time=1703326937 on cpu 22 ***
PC: @           0x50eb9c  (unknown)  _PyEval_EvalFrameDefault
    @     0x7fb277d26520   96618360  (unknown)
    @     0x7fb277426740  (unknown)  (unknown)
PC: @           0x522eec  (unknown)  _PyObject_GenericGetAttrWithDict
    @     0x7fb277d26520   84386496  (unknown)
    @           0x85eea0  (unknown)  (unknown)
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 3 ***
[2023-12-23 10:22:17,677 E 215931 55975] logging.cc:361: PC: @           0x522eec  (unknown)  _PyObject_GenericGetAttrWithDict
[2023-12-23 10:22:17,679 E 215931 55975] logging.cc:361:     @     0x7fb277d26520   84386496  (unknown)
    @           0x869d20  (unknown)  (unknown)
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: *** SIGTERM received at time=1703326937 on cpu 22 ***
[2023-12-23 10:22:17,680 E 215932 55975] logging.cc:361: PC: @           0x50eb9c  (unknown)  _PyEval_EvalFrameDefault
[2023-12-23 10:22:17,681 E 215931 55975] logging.cc:361:     @           0x85eea0  (unknown)  (unknown)
[2023-12-23 10:22:17,683 E 215932 55975] logging.cc:361:     @     0x7fb277d26520   96618360  (unknown)
[2023-12-23 10:22:17,686 E 215932 55975] logging.cc:361:     @     0x7fb277426740  (unknown)  (unknown)
[2023-12-23 10:22:17,691 E 215932 55975] logging.cc:361:     @           0x869d20  (unknown)  (unknown)
INFO:root:Completed 37 examples in 9.2 seconds.
INFO:root:Saving all annotations to /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.
INFO:root:Loading all annotations from /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/evaluators_configs/chatgpt_fn/annotations_seed0_configs.json.

Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 31.99s/it]
Annotation chunk: 100%|██████████| 7/7 [04:04<00:00, 34.95s/it]
INFO:root:drop 1 outputs that are not[0, 1, 2]
/home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/metrics.py:26: FutureWarning: Setting an item of incompatible dtype is deprecated and will raise in a future error of pandas. Value '1.5' has dtype incompatible with int64, please explicitly cast to a compatible dtype first.
  series_preferences[series_preferences == 0] = 1.5
INFO:root:Saving all results to output/chatgpt_fn_--SOLAR-10-7B-LMCocktail
INFO:root:Saving result to the precomputed leaderboard at /home/hangyu5/Documents/Git-repoMy/AIResearchVault/repo/LLM-infrastructure/alpaca_eval/src/alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv
                        win_rate  standard_error  n_total  avg_length
gpt4                       73.79            1.54      805        1365
SOLAR-10.7B-LMCocktail     73.45            1.56      804        1203
claude                     70.37            1.60      805        1082
chatgpt                    66.09            1.66      805         811
wizardlm-13b               65.16            1.67      805         985
vicuna-13b                 64.10            1.69      805        1037
guanaco-65b                62.36            1.71      805        1249
oasst-rlhf-llama-33b       62.05            1.71      805        1079
alpaca-farm-ppo-human      60.25            1.72      805         803
falcon-40b-instruct        56.52            1.74      805         662
text_davinci_003           50.00            0.00      805         307
alpaca-7b                  45.22            1.74      805         396
text_davinci_001           28.07            1.56      805         296
(RayWorkerVllm pid=57928) [W CUDAGraph.cpp:145] Warning: Waiting for pending NCCL work to finish before starting graph capture. (function operator())
(RayWorkerVllm pid=57928) INFO 12-23 08:58:39 model_runner.py:437] Graph capturing finished in 34 secs.