MaziyarPanahi commited on
Commit
4077d32
1 Parent(s): 7920348

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -7,8 +7,24 @@ tags:
7
  - moe
8
  - biology
9
  - medical
 
10
  ---
11
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
 
13
  ## Quantized mode
14
 
 
7
  - moe
8
  - biology
9
  - medical
10
+ - MoE
11
  ---
12
 
13
+ ## How to use it
14
+
15
+ ```python
16
+ # Use a pipeline as a high-level helper
17
+ from transformers import pipeline
18
+
19
+ pipe = pipeline("text-generation", model="MaziyarPanahi/Bioxtral-4x7B-v0.1")
20
+
21
+ # Load model directly
22
+ from transformers import AutoTokenizer, AutoModelForCausalLM
23
+
24
+ tokenizer = AutoTokenizer.from_pretrained("MaziyarPanahi/Bioxtral-4x7B-v0.1")
25
+ model = AutoModelForCausalLM.from_pretrained("MaziyarPanahi/Bioxtral-4x7B-v0.1")
26
+ ```
27
+
28
 
29
  ## Quantized mode
30