Update README.md

README.md

@@ -1,6 +1,23 @@
 ---
 license: cc-by-nc-4.0
 ---
+## Exl2 version of [maywell/PiVoT-MoE](https://huggingface.co/maywell/PiVoT-MoE)  
+
+## branch  
+main : 2.4bpw h8  
+3bh8 : 3bpw h8  
+4bh8 : 4bpw h8  
+6bh8 : 6bpw h8  
+8bh8 : 8bpw h8  
+
+Using ThePile [0007.parquet](https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/resolve/refs%2Fconvert%2Fparquet/default/train/0007.parquet) as dataset  
+ 
+Quantization settings : ```python convert.py -i models/maywell_PiVoT-MoE -o PiVoT-MoE-temp -cf PiVoT-MoE-8bpw-h8-exl2 -c 0007.parquet -l 8192 -b 8 -hb 8 -ml 8192```  
+```python convert.py -i models/maywell_PiVoT-MoE -o PiVoT-MoE-temp2 -cf PiVoT-MoE-6bpw-h8-exl2 -c 0007.parquet -l 8192 -b 6 -hb 8 -m PiVoT-MoE-temp/measurement.json -ml 8192```  
+```python convert.py -i models/maywell_PiVoT-MoE -o PiVoT-MoE-temp3 -cf PiVoT-MoE-4bpw-h8-exl2 -c 0007.parquet -l 8192 -b 4 -hb 8 -m PiVoT-MoE-temp/measurement.json -ml 8192```  
+```python convert.py -i models/maywell_PiVoT-MoE -o PiVoT-MoE-temp4 -cf PiVoT-MoE-3bpw-h8-exl2 -c 0007.parquet -l 8192 -b 3 -hb 8 -m PiVoT-MoE-temp/measurement.json -ml 8192```  
+```python convert.py -i models/maywell_PiVoT-MoE -o PiVoT-MoE-temp5 -cf PiVoT-MoE-2.4bpw-h8-exl2 -c 0007.parquet -l 8192 -b 2.4 -hb 8 -m PiVoT-MoE-temp/measurement.json -ml 8192```  
+### below this line is original readme  
 # PiVot-MoE
 ![img](./PiVoT-MoE.png)