hyunwoongko
commited on
Commit
•
5355201
1
Parent(s):
6dcf136
Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ license: apache-2.0
|
|
11 |
# GPT-NeoX-Ko-1.3B
|
12 |
|
13 |
## Model Description
|
14 |
-
GPT-NeoX-Ko is a Korean autoregressive language model made by EleutherAI multilingual team. We collected about 1.2TB Korean dataset for this work, which was done with [TUNiB](https://tunib.ai/). In addition, we used the GPT-NeoX framework for model training and added some Korean tasks to LM-Evaluation-Harness for model evaluation.
|
15 |
|
16 |
| Hyperparameter | Value |
|
17 |
|----------------------|----------------------------------------------------------------------------------------------------------------------------------------|
|
|
|
11 |
# GPT-NeoX-Ko-1.3B
|
12 |
|
13 |
## Model Description
|
14 |
+
GPT-NeoX-Ko is a Korean autoregressive language model made by EleutherAI multilingual team. We collected about 1.2TB Korean dataset for this work, which was done with [TUNiB](https://tunib.ai/). In addition, we used the [GPT-NeoX framework](https://github.com/EleutherAI/gpt-neox) for model training and added some Korean tasks to [LM-Evaluation-Harness](https://github.com/EleutherAI/lm-evaluation-harness) for model evaluation.
|
15 |
|
16 |
| Hyperparameter | Value |
|
17 |
|----------------------|----------------------------------------------------------------------------------------------------------------------------------------|
|