CooperW's picture
Update README.md
34e566d verified
metadata
license: mit
datasets:
  - CooperW/jadidi
base_model:
  - unsloth/gemma-2-27b-bnb-4bit

This model has been trained for multi classification of the TON-Iot Network dataset.

Refer to adapter_config.json for LoRa Parameters.

Accuracy: 95.6%

Key Training Params:

  • Steps: 100
  • Batch Size: 64
  • Optimizer: Adam_8bit
  • lr_schedular: cosine_with_restarts
  • lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 }

The datasets are an 80/20 partition of the TON-Iot Network dataset.

Train Dataset:

  • train_network_multi.jsonl

Test Dataset:

  • test_network_multi.jsonl