Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
lapp0
/
distily_bench_gpt2_attn
like
0
TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
License:
mit
Model card
Files
Files and versions
Metrics
Training metrics
Community
32685dd
distily_bench_gpt2_attn
/
logs
1 contributor
History:
9 commits
This model has one file that has been marked as unsafe.
View unsafe files
training_args.bin
lapp0
End of training
32685dd
verified
about 2 months ago
attn_loss_fn=cos, attn_weight=2.0
Training in progress, step 12375
about 2 months ago
attn_loss_fn=jsd, attn_weight=2.0
End of training
about 2 months ago
attn_loss_fn=kl, attn_weight=2.0
Training in progress, step 12375
about 2 months ago
attn_loss_fn=mse, attn_weight=2.0
Training in progress, step 12375
about 2 months ago
attn_loss_fn=mse_sum, attn_weight=2.0
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723651220.93d6cbb3ad53
5.91 kB
LFS
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723651454.93d6cbb3ad53
5.91 kB
LFS
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723651737.93d6cbb3ad53
196 kB
LFS
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723652161.93d6cbb3ad53
5.91 kB
LFS
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723652404.93d6cbb3ad53
3.35 MB
LFS
Training in progress, step 12375
about 2 months ago
events.out.tfevents.1723656174.93d6cbb3ad53
520 Bytes
LFS
Training in progress, step 12375
about 2 months ago