File size: 580 Bytes
451bffc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: mit
datasets:
- CooperW/jadidi
base_model:
- unsloth/gemma-2-27b-bnb-4bit
---
This model has been trained for binary classification of the TON-Iot Network dataset.
Refer to adapter_config.json for LoRa Parameters.
Key Training Params:
* Steps: 100
* Batch Size: 64
* Optimizer: Adam_8bit
* lr_schedular: cosine_with_restarts
* lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 }
The datasets are an 80/20 partition of the TON-Iot Network dataset.
Train Dataset:
* train_network.jsonl
Test Dataset:
* test_network.jsonl |