--- license: mit datasets: - CooperW/jadidi base_model: - unsloth/gemma-2-27b-bnb-4bit --- This model has been trained for binary classification of the TON-Iot Network dataset. Refer to adapter_config.json for LoRa Parameters. Key Training Params: * Steps: 100 * Batch Size: 64 * Optimizer: Adam_8bit * lr_schedular: cosine_with_restarts * lr_scheduler_kwargs = { "num_cycles": len(trainer.get_train_dataloader()) / 100 } The datasets are an 80/20 partition of the TON-Iot Network dataset. Train Dataset: * train_network.jsonl Test Dataset: * test_network.jsonl