File size: 268 Bytes
1a73bd7
 
 
 
 
 
1
2
3
4
5
6
7
model,score,throughput,response_length,latency,energy
lmsys/vicuna-13B,1054,19.47,178.71,10.37,12
lmsys/vicuna-7B,1007,31.26,217.33,7.71,32
metaai/llama-13B,854,18.49,390.9,22.74,24
lmsys/fastchat-t5-3B,941,31.98,131.12,6.09,4
BlinkDL/rwkv-7B,928,23.09,239.98,9.62,12