ibm-granite
/

granite-3.0-3b-a800m-base

Text Generation

Model card Files Files and versions Community

amezasor commited on about 13 hours ago

Commit

4857909

•

1 Parent(s): a3e5d55

typo fix

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -272,7 +272,7 @@ Granite-3.0-3B-A800M-Base is based on a decoder-only sparse Mixture of Experts (
 | Initialization std           | 0.1      | 0.1      | 0.1      | **0.1**      |
 | Sequence Length              | 4096     | 4096     | 4096     | **4096**     |
 | Position Embedding           | RoPE     | RoPE     | RoPE     | **RoPE**     |
-| # Paremeters                 | 2.5B     | 8.1B     | 1.3B     | **3.3B**     |
 | # Active Parameters          | 2.5B     | 8.1B     | 400M     | **800M**     |
 | # Training tokens            | 12T      | 12T      | 10T      | **10T**      |

 | Initialization std           | 0.1      | 0.1      | 0.1      | **0.1**      |
 | Sequence Length              | 4096     | 4096     | 4096     | **4096**     |
 | Position Embedding           | RoPE     | RoPE     | RoPE     | **RoPE**     |
+| # Parameters                 | 2.5B     | 8.1B     | 1.3B     | **3.3B**     |
 | # Active Parameters          | 2.5B     | 8.1B     | 400M     | **800M**     |
 | # Training tokens            | 12T      | 12T      | 10T      | **10T**      |