andersonbcdefg commited on
Commit
40763d6
1 Parent(s): eeed786

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ from huggingface_hub import snapshot_download
14
  snapshot_download(repo_id="TaylorAI/Llama2-7B-SFT-LIMA-ct2", local_dir="Llama2_TaylorAI")
15
  ```
16
 
17
- Then, you can perform inference as follows. Note that the model was trained with the separator `\\n\\n###\\n\\n` between the prompt/instruction
18
  and the model's response, so to get the expected result, you'll want to append this to your prompt. The model was also trained to finish its
19
  output with the suffix `@@@`, so you can stop generating tokens once you reach this suffix, or use it to split the completion and keep the
20
  relevant part. All of this is shown in the example below.
 
14
  snapshot_download(repo_id="TaylorAI/Llama2-7B-SFT-LIMA-ct2", local_dir="Llama2_TaylorAI")
15
  ```
16
 
17
+ Then, you can perform inference as follows. Note that the model was trained with the separator `\n\n###\n\n` between the prompt/instruction
18
  and the model's response, so to get the expected result, you'll want to append this to your prompt. The model was also trained to finish its
19
  output with the suffix `@@@`, so you can stop generating tokens once you reach this suffix, or use it to split the completion and keep the
20
  relevant part. All of this is shown in the example below.