README.md

---
license: other
base_model: nvidia/mit-b2
tags:
- vision
- image-segmentation
- generated_from_trainer
metrics:
- recall
model-index:
- name: segformer-b2-finetuned-segments-greenhousev3-sep-23
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b2-finetuned-segments-greenhousev3-sep-23

This model is a fine-tuned version of [nvidia/mit-b2](https://huggingface.co/nvidia/mit-b2) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1322
- Mean Iou: 0.6132
- Mean Accuracy: 0.7450
- Overall Accuracy: 0.9609
- F1 Score: 0.9588
- Recall: 0.9609
- Accuracy Unlabeled: nan
- Accuracy Object: 0.0206
- Accuracy Road: nan
- Accuracy Plant: 0.9558
- Accuracy Iron: 0.6844
- Accuracy Wood: 0.7721
- Accuracy Wall: 0.9074
- Accuracy Raw Road: 0.9928
- Accuracy Bottom Wall: 0.9443
- Accuracy Roof: 0.2718
- Accuracy Grass: 0.6305
- Accuracy Mulch: 0.9225
- Accuracy Person: 0.9763
- Accuracy Tomato: 0.8611
- Iou Unlabeled: 0.0
- Iou Object: 0.0184
- Iou Road: nan
- Iou Plant: 0.9019
- Iou Iron: 0.6258
- Iou Wood: 0.7197
- Iou Wall: 0.8552
- Iou Raw Road: 0.9821
- Iou Bottom Wall: 0.6995
- Iou Roof: 0.2149
- Iou Grass: 0.6173
- Iou Mulch: 0.8751
- Iou Person: 0.7825
- Iou Tomato: 0.6797

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 2
- eval_batch_size: 2
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 15

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | F1 Score | Recall | Accuracy Unlabeled | Accuracy Object | Accuracy Road | Accuracy Plant | Accuracy Iron | Accuracy Wood | Accuracy Wall | Accuracy Raw Road | Accuracy Bottom Wall | Accuracy Roof | Accuracy Grass | Accuracy Mulch | Accuracy Person | Accuracy Tomato | Iou Unlabeled | Iou Object | Iou Road | Iou Plant | Iou Iron | Iou Wood | Iou Wall | Iou Raw Road | Iou Bottom Wall | Iou Roof | Iou Grass | Iou Mulch | Iou Person | Iou Tomato |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------:|:------:|:------------------:|:---------------:|:-------------:|:--------------:|:-------------:|:-------------:|:-------------:|:-----------------:|:--------------------:|:-------------:|:--------------:|:--------------:|:---------------:|:---------------:|:-------------:|:----------:|:--------:|:---------:|:--------:|:--------:|:--------:|:------------:|:---------------:|:--------:|:---------:|:---------:|:----------:|:----------:|
| 0.4728        | 0.14  | 20   | 0.6655          | 0.2299   | 0.2891        | 0.8798           | 0.8777   | 0.8798 | nan                | 0.0             | nan           | 0.9629         | 0.0           | 0.0           | 0.6311        | 0.9559            | 0.1394               | 0.0           | 0.0            | 0.7803         | 0.0             | 0.0             | nan           | 0.0        | 0.0      | 0.7506    | 0.0      | 0.0      | 0.5587   | 0.9347       | 0.1283          | 0.0      | 0.0       | 0.6164    | 0.0        | 0.0        |
| 0.2268        | 0.29  | 40   | 0.3465          | 0.2906   | 0.3326        | 0.9191           | 0.9169   | 0.9191 | nan                | 0.0             | nan           | 0.9575         | 0.0           | 0.0           | 0.9650        | 0.9645            | 0.2226               | 0.0           | 0.0            | 0.8811         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8449    | 0.0      | 0.0      | 0.7368   | 0.9537       | 0.2068          | 0.0      | 0.0       | 0.7453    | 0.0        | 0.0        |
| 0.3019        | 0.43  | 60   | 0.2880          | 0.3198   | 0.3631        | 0.9298           | 0.9275   | 0.9298 | nan                | 0.0             | nan           | 0.9563         | 0.0891        | 0.0           | 0.9515        | 0.9770            | 0.5062               | 0.0           | 0.0            | 0.8765         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8484    | 0.0862   | 0.0      | 0.7512   | 0.9642       | 0.3825          | 0.0      | 0.0       | 0.8051    | 0.0        | 0.0        |
| 0.1585        | 0.57  | 80   | 0.2347          | 0.3519   | 0.3900        | 0.9370           | 0.9347   | 0.9370 | nan                | 0.0             | nan           | 0.9569         | 0.3653        | 0.0           | 0.9044        | 0.9855            | 0.3948               | 0.1606        | 0.0            | 0.9130         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8600    | 0.2939   | 0.0      | 0.7732   | 0.9692       | 0.3490          | 0.1496   | 0.0       | 0.8283    | 0.0        | 0.0        |
| 0.1301        | 0.71  | 100  | 0.2319          | 0.3482   | 0.4088        | 0.9312           | 0.9289   | 0.9312 | nan                | 0.0             | nan           | 0.9291         | 0.2820        | 0.0           | 0.7532        | 0.9864            | 0.7759               | 0.2375        | 0.0            | 0.9412         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8606    | 0.2518   | 0.0      | 0.6801   | 0.9726       | 0.3958          | 0.1929   | 0.0       | 0.8249    | 0.0        | 0.0        |
| 0.1759        | 0.86  | 120  | 0.2091          | 0.3762   | 0.4338        | 0.9421           | 0.9398   | 0.9421 | nan                | 0.0             | nan           | 0.9526         | 0.3518        | 0.0           | 0.8590        | 0.9908            | 0.8850               | 0.2730        | 0.0            | 0.8937         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8672    | 0.3154   | 0.0      | 0.7874   | 0.9749       | 0.5630          | 0.1681   | 0.0       | 0.8384    | 0.0        | 0.0        |
| 0.2844        | 1.0   | 140  | 0.2082          | 0.3916   | 0.4498        | 0.9450           | 0.9427   | 0.9450 | nan                | 0.0             | nan           | 0.9541         | 0.4831        | 0.0           | 0.8960        | 0.9846            | 0.9094               | 0.2606        | 0.0            | 0.9101         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8716    | 0.3912   | 0.0      | 0.8308   | 0.9738       | 0.5975          | 0.1947   | 0.0       | 0.8396    | 0.0        | 0.0        |
| 0.798         | 1.14  | 160  | 0.2097          | 0.3589   | 0.4018        | 0.9399           | 0.9376   | 0.9399 | nan                | 0.0             | nan           | 0.9677         | 0.2508        | 0.0           | 0.9451        | 0.9814            | 0.6654               | 0.1253        | 0.0            | 0.8856         | 0.0             | 0.0             | nan           | 0.0        | nan      | 0.8701    | 0.2347   | 0.0      | 0.8037   | 0.9701       | 0.4866          | 0.1206   | 0.0       | 0.8206    | 0.0        | 0.0        |
| 0.1109        | 1.29  | 180  | 0.1858          | 0.3963   | 0.4418        | 0.9494           | 0.9471   | 0.9494 | nan                | 0.0             | nan           | 0.9458         | 0.4474        | 0.0           | 0.9346        | 0.9883            | 0.9136               | 0.1362        | 0.0            | 0.9287         | 0.0             | 0.0073          | nan           | 0.0        | nan      | 0.8749    | 0.3894   | 0.0      | 0.8578   | 0.9764       | 0.6721          | 0.1314   | 0.0       | 0.8462    | 0.0        | 0.0073     |
| 0.1307        | 1.43  | 200  | 0.1860          | 0.3877   | 0.4278        | 0.9476           | 0.9453   | 0.9476 | nan                | 0.0             | nan           | 0.9560         | 0.3539        | 0.0           | 0.9347        | 0.9919            | 0.7286               | 0.2421        | 0.0            | 0.9096         | 0.0135          | 0.0032          | nan           | 0.0        | nan      | 0.8755    | 0.3252   | 0.0      | 0.8295   | 0.9770       | 0.5821          | 0.1991   | 0.0       | 0.8466    | 0.0135     | 0.0032     |
| 0.084         | 1.57  | 220  | 0.1887          | 0.4217   | 0.4708        | 0.9486           | 0.9463   | 0.9486 | nan                | 0.0             | nan           | 0.9582         | 0.3334        | 0.0           | 0.8882        | 0.9920            | 0.9166               | 0.2368        | 0.0            | 0.9038         | 0.0659          | 0.3552          | nan           | 0.0        | nan      | 0.8801    | 0.3078   | 0.0      | 0.8184   | 0.9768       | 0.6100          | 0.2048   | 0.0       | 0.8532    | 0.0659     | 0.3430     |
| 0.1455        | 1.71  | 240  | 0.1807          | 0.3972   | 0.4840        | 0.9472           | 0.9449   | 0.9472 | nan                | 0.0             | nan           | 0.9643         | 0.6948        | 0.0           | 0.9136        | 0.9910            | 0.6636               | 0.2532        | 0.0            | 0.8843         | 0.0879          | 0.3557          | 0.0           | 0.0        | nan      | 0.8765    | 0.4982   | 0.0      | 0.8146   | 0.9770       | 0.5113          | 0.2082   | 0.0       | 0.8475    | 0.0879     | 0.3424     |
| 0.4724        | 1.86  | 260  | 0.1679          | 0.4540   | 0.5105        | 0.9501           | 0.9478   | 0.9501 | nan                | 0.0             | nan           | 0.9543         | 0.4028        | 0.0           | 0.8962        | 0.9915            | 0.8939               | 0.2762        | 0.0            | 0.9111         | 0.1767          | 0.6238          | nan           | 0.0        | nan      | 0.8830    | 0.3581   | 0.0      | 0.8287   | 0.9775       | 0.6134          | 0.1958   | 0.0       | 0.8565    | 0.1767     | 0.5588     |
| 0.0792        | 2.0   | 280  | 0.1651          | 0.4441   | 0.5410        | 0.9538           | 0.9515   | 0.9538 | nan                | 0.0125          | nan           | 0.9700         | 0.6903        | 0.0           | 0.9289        | 0.9895            | 0.8878               | 0.1999        | 0.0            | 0.8855         | 0.1589          | 0.7681          | 0.0           | 0.0123     | nan      | 0.8820    | 0.5481   | 0.0      | 0.8666   | 0.9790       | 0.6902          | 0.1844   | 0.0       | 0.8517    | 0.1588     | 0.6009     |
| 0.0818        | 2.14  | 300  | 0.1739          | 0.4140   | 0.5109        | 0.9495           | 0.9471   | 0.9495 | nan                | 0.0             | nan           | 0.9603         | 0.3701        | 0.0           | 0.9235        | 0.9884            | 0.7417               | 0.2544        | 0.0            | 0.9121         | 0.1378          | 0.8426          | 0.0           | 0.0        | nan      | 0.8891    | 0.3379   | 0.0      | 0.8072   | 0.9766       | 0.5491          | 0.2107   | 0.0       | 0.8581    | 0.1374     | 0.6155     |
| 0.0728        | 2.29  | 320  | 0.1671          | 0.4637   | 0.5572        | 0.9525           | 0.9501   | 0.9525 | nan                | 0.0026          | nan           | 0.9716         | 0.6449        | 0.0           | 0.9063        | 0.9891            | 0.8891               | 0.2794        | 0.0            | 0.8892         | 0.4852          | 0.6293          | 0.0           | 0.0026     | nan      | 0.8801    | 0.5378   | 0.0      | 0.8463   | 0.9781       | 0.6695          | 0.1932   | 0.0       | 0.8583    | 0.4844     | 0.5772     |
| 0.1481        | 2.43  | 340  | 0.1877          | 0.4361   | 0.5219        | 0.9494           | 0.9471   | 0.9494 | nan                | 0.0063          | nan           | 0.9537         | 0.4166        | 0.0           | 0.8905        | 0.9896            | 0.8297               | 0.1635        | 0.0            | 0.9314         | 0.5917          | 0.4900          | 0.0           | 0.0063     | nan      | 0.8839    | 0.3844   | 0.0      | 0.8038   | 0.9790       | 0.5398          | 0.1583   | 0.0       | 0.8651    | 0.5728     | 0.4762     |
| 0.0827        | 2.57  | 360  | 0.1997          | 0.4146   | 0.5090        | 0.9432           | 0.9409   | 0.9432 | nan                | 0.0011          | nan           | 0.9455         | 0.3143        | 0.0           | 0.7867        | 0.9907            | 0.9458               | 0.0166        | 0.0            | 0.9396         | 0.7194          | 0.4479          | 0.0           | 0.0011     | nan      | 0.8840    | 0.2966   | 0.0      | 0.7427   | 0.9771       | 0.4720          | 0.0166   | 0.0       | 0.8598    | 0.7016     | 0.4382     |
| 0.1107        | 2.71  | 380  | 0.1557          | 0.5025   | 0.6047        | 0.9562           | 0.9538   | 0.9562 | nan                | 0.0411          | nan           | 0.9608         | 0.6180        | 0.0           | 0.9320        | 0.9918            | 0.8880               | 0.2753        | 0.0            | 0.9107         | 0.8757          | 0.7634          | 0.0           | 0.0390     | nan      | 0.8895    | 0.5274   | 0.0      | 0.8685   | 0.9785       | 0.7030          | 0.2059   | 0.0       | 0.8697    | 0.8151     | 0.6354     |
| 0.1865        | 2.86  | 400  | 0.1532          | 0.5085   | 0.6133        | 0.9558           | 0.9535   | 0.9558 | nan                | 0.0016          | nan           | 0.9343         | 0.7329        | 0.0           | 0.9466        | 0.9915            | 0.8648               | 0.2845        | 0.0            | 0.9446         | 0.8986          | 0.7599          | 0.0           | 0.0016     | nan      | 0.8823    | 0.5774   | 0.0      | 0.8855   | 0.9790       | 0.7964          | 0.1783   | 0.0       | 0.8552    | 0.8196     | 0.6358     |
| 0.0648        | 3.0   | 420  | 0.1680          | 0.4919   | 0.5956        | 0.9542           | 0.9518   | 0.9542 | nan                | 0.0034          | nan           | 0.9608         | 0.7622        | 0.0           | 0.8786        | 0.9924            | 0.8920               | 0.2235        | 0.0            | 0.9135         | 0.8478          | 0.6727          | 0.0           | 0.0031     | nan      | 0.8870    | 0.5533   | 0.0      | 0.8376   | 0.9796       | 0.6629          | 0.2034   | 0.0       | 0.8659    | 0.7992     | 0.6020     |
| 0.1125        | 3.14  | 440  | 0.1652          | 0.4831   | 0.5817        | 0.9531           | 0.9509   | 0.9531 | nan                | 0.0049          | nan           | 0.9620         | 0.5142        | 0.0008        | 0.9011        | 0.9885            | 0.9501               | 0.2267        | 0.0            | 0.9172         | 0.8749          | 0.6403          | 0.0           | 0.0049     | nan      | 0.8877    | 0.4584   | 0.0008   | 0.8433   | 0.9791       | 0.6627          | 0.2044   | 0.0       | 0.8567    | 0.8086     | 0.5742     |
| 0.0804        | 3.29  | 460  | 0.1550          | 0.5130   | 0.6533        | 0.9556           | 0.9533   | 0.9556 | nan                | 0.0454          | nan           | 0.9476         | 0.6877        | 0.2668        | 0.9698        | 0.9939            | 0.8789               | 0.2339        | 0.0            | 0.8932         | 0.9467          | 0.9758          | 0.0           | 0.0259     | nan      | 0.8837    | 0.5625   | 0.2668   | 0.9002   | 0.9781       | 0.7943          | 0.2099   | 0.0       | 0.8594    | 0.7619     | 0.4256     |
| 0.0794        | 3.43  | 480  | 0.1514          | 0.5133   | 0.6402        | 0.9569           | 0.9546   | 0.9569 | nan                | 0.0310          | nan           | 0.9438         | 0.5360        | 0.3062        | 0.9648        | 0.9910            | 0.9301               | 0.1980        | 0.0            | 0.9286         | 0.8943          | 0.9582          | 0.0           | 0.0217     | nan      | 0.8848    | 0.4842   | 0.3062   | 0.9028   | 0.9795       | 0.7796          | 0.1869   | 0.0       | 0.8671    | 0.7768     | 0.4828     |
| 0.084         | 3.57  | 500  | 0.1477          | 0.5099   | 0.6059        | 0.9585           | 0.9561   | 0.9585 | nan                | 0.0414          | nan           | 0.9662         | 0.5989        | 0.0030        | 0.9685        | 0.9895            | 0.9243               | 0.2221        | 0.0            | 0.9085         | 0.8977          | 0.7507          | 0.0           | 0.0386     | nan      | 0.8863    | 0.5261   | 0.0030   | 0.9040   | 0.9797       | 0.7818          | 0.2055   | 0.0       | 0.8675    | 0.7826     | 0.6531     |
| 0.0648        | 3.71  | 520  | 0.1482          | 0.5166   | 0.6114        | 0.9580           | 0.9557   | 0.9580 | nan                | 0.0562          | nan           | 0.9561         | 0.6569        | 0.0016        | 0.9635        | 0.9953            | 0.9131               | 0.1891        | 0.0            | 0.8987         | 0.9307          | 0.7761          | 0.0           | 0.0505     | nan      | 0.8872    | 0.5528   | 0.0016   | 0.9031   | 0.9766       | 0.7930          | 0.1801   | 0.0       | 0.8667    | 0.8335     | 0.6705     |
| 0.0828        | 3.86  | 540  | 0.1759          | 0.4830   | 0.5948        | 0.9501           | 0.9478   | 0.9501 | nan                | 0.0214          | nan           | 0.9688         | 0.5372        | 0.0005        | 0.8483        | 0.9893            | 0.9405               | 0.2753        | 0.0            | 0.9003         | 0.8986          | 0.7577          | 0.0           | 0.0185     | nan      | 0.8840    | 0.4753   | 0.0005   | 0.8022   | 0.9796       | 0.5658          | 0.2111   | 0.0       | 0.8651    | 0.8047     | 0.6722     |
| 0.0761        | 4.0   | 560  | 0.1497          | 0.5129   | 0.6124        | 0.9576           | 0.9552   | 0.9576 | nan                | 0.0295          | nan           | 0.9642         | 0.7465        | 0.0           | 0.9567        | 0.9930            | 0.8100               | 0.2875        | 0.0            | 0.9003         | 0.8986          | 0.7630          | 0.0           | 0.0243     | nan      | 0.8874    | 0.6182   | 0.0      | 0.8800   | 0.9804       | 0.7565          | 0.1808   | 0.0       | 0.8670    | 0.8102     | 0.6637     |
| 0.0895        | 4.14  | 580  | 0.1404          | 0.5205   | 0.6296        | 0.9588           | 0.9565   | 0.9588 | nan                | 0.1097          | nan           | 0.9575         | 0.6479        | 0.0           | 0.9431        | 0.9914            | 0.9467               | 0.2837        | 0.0            | 0.9215         | 0.9315          | 0.8219          | 0.0           | 0.1014     | nan      | 0.8908    | 0.5544   | 0.0      | 0.8916   | 0.9801       | 0.7819          | 0.1955   | 0.0       | 0.8729    | 0.8286     | 0.6689     |
| 0.0934        | 4.29  | 600  | 0.1406          | 0.5112   | 0.6070        | 0.9589           | 0.9566   | 0.9589 | nan                | 0.0107          | nan           | 0.9553         | 0.6079        | 0.0           | 0.9781        | 0.9931            | 0.8910               | 0.2657        | 0.0120         | 0.9153         | 0.9560          | 0.6984          | 0.0           | 0.0105     | nan      | 0.8905    | 0.5319   | 0.0      | 0.8901   | 0.9788       | 0.8040          | 0.2210   | 0.0120    | 0.8716    | 0.7811     | 0.6544     |
| 0.0658        | 4.43  | 620  | 0.1400          | 0.5132   | 0.6074        | 0.9595           | 0.9572   | 0.9595 | nan                | 0.0068          | nan           | 0.9600         | 0.6840        | 0.0           | 0.9640        | 0.9920            | 0.9329               | 0.2745        | 0.0003         | 0.9150         | 0.9172          | 0.6422          | 0.0           | 0.0065     | nan      | 0.8895    | 0.5783   | 0.0      | 0.9051   | 0.9798       | 0.8141          | 0.2128   | 0.0003    | 0.8700    | 0.7990     | 0.6158     |
| 0.1135        | 4.57  | 640  | 0.1389          | 0.5163   | 0.6109        | 0.9600           | 0.9577   | 0.9600 | nan                | 0.0156          | nan           | 0.9587         | 0.6038        | 0.0           | 0.9603        | 0.9923            | 0.9510               | 0.2677        | 0.0004         | 0.9205         | 0.8681          | 0.7928          | 0.0           | 0.0145     | nan      | 0.8908    | 0.5260   | 0.0      | 0.9025   | 0.9806       | 0.8119          | 0.2219   | 0.0004    | 0.8738    | 0.8125     | 0.6770     |
| 0.1132        | 4.71  | 660  | 0.1353          | 0.5166   | 0.6113        | 0.9594           | 0.9571   | 0.9594 | nan                | 0.0149          | nan           | 0.9509         | 0.6262        | 0.0           | 0.9600        | 0.9923            | 0.9425               | 0.2831        | 0.0019         | 0.9293         | 0.8859          | 0.7492          | 0.0           | 0.0137     | nan      | 0.8900    | 0.5444   | 0.0      | 0.8979   | 0.9800       | 0.8146          | 0.2003   | 0.0019    | 0.8728    | 0.8226     | 0.6780     |
| 0.0903        | 4.86  | 680  | 0.1719          | 0.4946   | 0.5966        | 0.9534           | 0.9517   | 0.9534 | nan                | 0.0008          | nan           | 0.9599         | 0.6438        | 0.0100        | 0.8733        | 0.9910            | 0.9136               | 0.2515        | 0.0005         | 0.9209         | 0.8808          | 0.7132          | 0.0           | 0.0008     | nan      | 0.8898    | 0.5495   | 0.0100   | 0.8217   | 0.9797       | 0.6287          | 0.1963   | 0.0005    | 0.8700    | 0.8192     | 0.6629     |
| 0.0758        | 5.0   | 700  | 0.2187          | 0.4952   | 0.6093        | 0.9462           | 0.9439   | 0.9462 | nan                | 0.0             | nan           | 0.9728         | 0.5681        | 0.3057        | 0.7628        | 0.9894            | 0.9400               | 0.2767        | 0.0001         | 0.9031         | 0.8571          | 0.7364          | 0.0           | 0.0        | nan      | 0.8859    | 0.5139   | 0.3057   | 0.7273   | 0.9796       | 0.4944          | 0.2122   | 0.0001    | 0.8647    | 0.7764     | 0.6771     |
| 0.2833        | 5.14  | 720  | 0.1511          | 0.5013   | 0.5987        | 0.9559           | 0.9536   | 0.9559 | nan                | 0.0             | nan           | 0.9546         | 0.7183        | 0.0672        | 0.9584        | 0.9949            | 0.7175               | 0.1797        | 0.0            | 0.9128         | 0.9349          | 0.7464          | 0.0           | 0.0        | nan      | 0.8902    | 0.5909   | 0.0672   | 0.8507   | 0.9786       | 0.6221          | 0.1725   | 0.0       | 0.8740    | 0.79       | 0.6801     |
| 0.0744        | 5.29  | 740  | 0.1738          | 0.5093   | 0.6309        | 0.9532           | 0.9509   | 0.9532 | nan                | 0.0072          | nan           | 0.9511         | 0.6715        | 0.2084        | 0.8432        | 0.9937            | 0.9450               | 0.2663        | 0.0008         | 0.9279         | 0.9231          | 0.8322          | 0.0           | 0.0062     | nan      | 0.8889    | 0.5572   | 0.2084   | 0.8055   | 0.9800       | 0.6161          | 0.2162   | 0.0008    | 0.8746    | 0.8029     | 0.6643     |
| 0.0714        | 5.43  | 760  | 0.2051          | 0.4841   | 0.5921        | 0.9518           | 0.9495   | 0.9518 | nan                | 0.0078          | nan           | 0.9558         | 0.5927        | 0.0666        | 0.8609        | 0.9926            | 0.9532               | 0.1885        | 0.0            | 0.9158         | 0.9467          | 0.6250          | 0.0           | 0.0063     | nan      | 0.8868    | 0.5174   | 0.0666   | 0.8094   | 0.9794       | 0.5846          | 0.1805   | 0.0       | 0.8707    | 0.7915     | 0.6004     |
| 0.0762        | 5.57  | 780  | 0.1650          | 0.5024   | 0.6131        | 0.9540           | 0.9517   | 0.9540 | nan                | 0.0296          | nan           | 0.9663         | 0.6629        | 0.1665        | 0.8887        | 0.9898            | 0.9290               | 0.1194        | 0.0            | 0.9099         | 0.9594          | 0.7358          | 0.0           | 0.0205     | nan      | 0.8860    | 0.5934   | 0.1665   | 0.8275   | 0.9803       | 0.6486          | 0.1178   | 0.0       | 0.8687    | 0.7597     | 0.6628     |
| 0.0914        | 5.71  | 800  | 0.1375          | 0.5537   | 0.6932        | 0.9593           | 0.9572   | 0.9593 | nan                | 0.4264          | nan           | 0.9544         | 0.7537        | 0.2685        | 0.9521        | 0.9943            | 0.9177               | 0.2634        | 0.0016         | 0.9051         | 0.9653          | 0.9164          | 0.0           | 0.2219     | nan      | 0.8899    | 0.6534   | 0.2684   | 0.8924   | 0.9802       | 0.8094          | 0.2207   | 0.0016    | 0.8690    | 0.7489     | 0.6419     |
| 0.0537        | 5.86  | 820  | 0.1389          | 0.5551   | 0.6732        | 0.9585           | 0.9567   | 0.9585 | nan                | 0.2189          | nan           | 0.9630         | 0.5396        | 0.4156        | 0.9667        | 0.9887            | 0.9400               | 0.2719        | 0.0452         | 0.9109         | 0.9324          | 0.8853          | 0.0           | 0.1550     | nan      | 0.8876    | 0.4992   | 0.4150   | 0.8951   | 0.9809       | 0.8003          | 0.2219   | 0.0450    | 0.8683    | 0.7839     | 0.6644     |
| 0.1726        | 6.0   | 840  | 0.1286          | 0.5929   | 0.7204        | 0.9600           | 0.9578   | 0.9600 | nan                | 0.2471          | nan           | 0.9490         | 0.7091        | 0.7954        | 0.9417        | 0.9937            | 0.9336               | 0.2915        | 0.0463         | 0.9262         | 0.9383          | 0.8732          | 0.0           | 0.1929     | nan      | 0.8922    | 0.6262   | 0.7332   | 0.8897   | 0.9804       | 0.8258          | 0.1738   | 0.0463    | 0.8746    | 0.8079     | 0.6650     |
| 0.0732        | 6.14  | 860  | 0.2074          | 0.5566   | 0.6938        | 0.9526           | 0.9504   | 0.9526 | nan                | 0.1039          | nan           | 0.9418         | 0.5611        | 0.8804        | 0.8588        | 0.9927            | 0.9399               | 0.2823        | 0.0446         | 0.9379         | 0.9417          | 0.8401          | 0.0           | 0.0830     | nan      | 0.8891    | 0.5225   | 0.7368   | 0.8043   | 0.9794       | 0.6139          | 0.2006   | 0.0446    | 0.8702    | 0.8227     | 0.6683     |
| 0.0584        | 6.29  | 880  | 0.2237          | 0.5399   | 0.6605        | 0.9511           | 0.9493   | 0.9511 | nan                | 0.0362          | nan           | 0.9621         | 0.6614        | 0.7904        | 0.8164        | 0.9920            | 0.9476               | 0.1184        | 0.0155         | 0.9165         | 0.9332          | 0.7361          | 0.0           | 0.0305     | nan      | 0.8921    | 0.5800   | 0.7119   | 0.7721   | 0.9807       | 0.5475          | 0.1158   | 0.0155    | 0.8747    | 0.8351     | 0.6629     |
| 0.0598        | 6.43  | 900  | 0.1893          | 0.5424   | 0.6526        | 0.9525           | 0.9507   | 0.9525 | nan                | 0.0165          | nan           | 0.9732         | 0.6581        | 0.7865        | 0.8772        | 0.9909            | 0.8767               | 0.1914        | 0.0075         | 0.8920         | 0.8893          | 0.6723          | 0.0           | 0.0122     | nan      | 0.8851    | 0.5830   | 0.6993   | 0.8149   | 0.9805       | 0.6021          | 0.1805   | 0.0075    | 0.8657    | 0.7868     | 0.6341     |
| 0.1013        | 6.57  | 920  | 0.1335          | 0.5780   | 0.6934        | 0.9607           | 0.9585   | 0.9607 | nan                | 0.0674          | nan           | 0.9545         | 0.6898        | 0.7161        | 0.9552        | 0.9933            | 0.9497               | 0.2721        | 0.0049         | 0.9209         | 0.9307          | 0.8663          | 0.0           | 0.0526     | nan      | 0.8906    | 0.6059   | 0.6813   | 0.8999   | 0.9806       | 0.8401          | 0.2197   | 0.0049    | 0.8762    | 0.8007     | 0.6615     |
| 0.0833        | 6.71  | 940  | 0.1330          | 0.5692   | 0.6914        | 0.9601           | 0.9580   | 0.9601 | nan                | 0.0915          | nan           | 0.9456         | 0.6183        | 0.6115        | 0.9549        | 0.9933            | 0.9592               | 0.2653        | 0.0617         | 0.9316         | 0.9501          | 0.9140          | 0.0           | 0.0773     | nan      | 0.8916    | 0.5659   | 0.5988   | 0.8971   | 0.9806       | 0.8128          | 0.2219   | 0.0617    | 0.8731    | 0.8011     | 0.6171     |
| 0.0817        | 6.86  | 960  | 0.1351          | 0.5724   | 0.6995        | 0.9590           | 0.9569   | 0.9590 | nan                | 0.1274          | nan           | 0.9576         | 0.7188        | 0.5427        | 0.9152        | 0.9938            | 0.9463               | 0.2705        | 0.1773         | 0.9120         | 0.9560          | 0.8769          | 0.0           | 0.1070     | nan      | 0.8943    | 0.6327   | 0.5407   | 0.8663   | 0.9805       | 0.7262          | 0.2172   | 0.1771    | 0.8753    | 0.7773     | 0.6464     |
| 0.0492        | 7.0   | 980  | 0.1380          | 0.5820   | 0.7143        | 0.9579           | 0.9556   | 0.9579 | nan                | 0.0692          | nan           | 0.9352         | 0.6658        | 0.6519        | 0.9142        | 0.9939            | 0.9420               | 0.2785        | 0.3117         | 0.9396         | 0.9510          | 0.9187          | 0.0           | 0.0626     | nan      | 0.8915    | 0.6026   | 0.6376   | 0.8645   | 0.9790       | 0.7287          | 0.2095   | 0.3117    | 0.8691    | 0.7911     | 0.6179     |
| 0.0771        | 7.14  | 1000 | 0.2250          | 0.5468   | 0.6883        | 0.9541           | 0.9519   | 0.9541 | nan                | 0.1071          | nan           | 0.9525         | 0.5593        | 0.5420        | 0.8624        | 0.9921            | 0.9532               | 0.2513        | 0.2243         | 0.9229         | 0.9603          | 0.9321          | 0.0           | 0.0847     | nan      | 0.8972    | 0.5172   | 0.5370   | 0.8101   | 0.9791       | 0.5957          | 0.2224   | 0.2243    | 0.8759    | 0.7770     | 0.5876     |
| 0.4058        | 7.29  | 1020 | 0.2183          | 0.5275   | 0.6615        | 0.9536           | 0.9514   | 0.9536 | nan                | 0.0732          | nan           | 0.9622         | 0.6842        | 0.3845        | 0.8543        | 0.9921            | 0.9101               | 0.2705        | 0.0502         | 0.9120         | 0.9341          | 0.9105          | 0.0           | 0.0567     | nan      | 0.8933    | 0.5761   | 0.3845   | 0.8099   | 0.9797       | 0.6019          | 0.2205   | 0.0501    | 0.8738    | 0.7984     | 0.6130     |
| 0.0673        | 7.43  | 1040 | 0.2068          | 0.5394   | 0.6758        | 0.9546           | 0.9524   | 0.9546 | nan                | 0.0308          | nan           | 0.9477         | 0.6755        | 0.4295        | 0.8634        | 0.9931            | 0.9386               | 0.2778        | 0.1915         | 0.9286         | 0.9763          | 0.8564          | 0.0           | 0.0286     | nan      | 0.8953    | 0.5905   | 0.4291   | 0.8089   | 0.9797       | 0.6077          | 0.2142   | 0.1915    | 0.8754    | 0.7329     | 0.6587     |
| 0.0628        | 7.57  | 1060 | 0.2107          | 0.5408   | 0.6630        | 0.9531           | 0.9508   | 0.9531 | nan                | 0.0             | nan           | 0.9430         | 0.5187        | 0.5982        | 0.8544        | 0.9928            | 0.9473               | 0.2830        | 0.1745         | 0.9424         | 0.9653          | 0.7364          | 0.0           | 0.0        | nan      | 0.8886    | 0.4912   | 0.5910   | 0.7967   | 0.9815       | 0.5976          | 0.2031   | 0.1731    | 0.8736    | 0.7644     | 0.6696     |
| 0.0522        | 7.71  | 1080 | 0.1767          | 0.5347   | 0.6524        | 0.9539           | 0.9517   | 0.9539 | nan                | 0.0             | nan           | 0.9728         | 0.7060        | 0.3845        | 0.8449        | 0.9918            | 0.9290               | 0.2838        | 0.1439         | 0.8983         | 0.9358          | 0.7375          | 0.0           | 0.0        | nan      | 0.8890    | 0.6093   | 0.3845   | 0.8043   | 0.9823       | 0.6071          | 0.1976   | 0.1422    | 0.8701    | 0.7993     | 0.6656     |
| 0.0869        | 7.86  | 1100 | 0.1538          | 0.5471   | 0.6775        | 0.9556           | 0.9537   | 0.9556 | nan                | 0.0184          | nan           | 0.9557         | 0.7171        | 0.4018        | 0.8595        | 0.9931            | 0.9393               | 0.2777        | 0.2382         | 0.9206         | 0.9628          | 0.8453          | 0.0           | 0.0166     | nan      | 0.8951    | 0.6301   | 0.4017   | 0.8126   | 0.9819       | 0.6177          | 0.2101   | 0.2348    | 0.8750    | 0.7691     | 0.6675     |
| 0.045         | 8.0   | 1120 | 0.1356          | 0.5880   | 0.7348        | 0.9583           | 0.9566   | 0.9583 | nan                | 0.0194          | nan           | 0.9574         | 0.6847        | 0.9394        | 0.9016        | 0.9912            | 0.9424               | 0.2763        | 0.3520         | 0.9199         | 0.9679          | 0.8656          | 0.0           | 0.0162     | nan      | 0.8967    | 0.6149   | 0.7533   | 0.8535   | 0.9812       | 0.6940          | 0.2156   | 0.3220    | 0.8747    | 0.7598     | 0.6625     |
| 0.0618        | 8.14  | 1140 | 0.1575          | 0.5853   | 0.7354        | 0.9554           | 0.9536   | 0.9554 | nan                | 0.0634          | nan           | 0.9565         | 0.6314        | 0.9301        | 0.8496        | 0.9906            | 0.9539               | 0.2834        | 0.4132         | 0.9256         | 0.9484          | 0.8790          | 0.0           | 0.0498     | nan      | 0.8977    | 0.5787   | 0.7574   | 0.8068   | 0.9810       | 0.6149          | 0.2028   | 0.3951    | 0.8752    | 0.7868     | 0.6631     |
| 0.0615        | 8.29  | 1160 | 0.1424          | 0.5866   | 0.7214        | 0.9574           | 0.9553   | 0.9574 | nan                | 0.0456          | nan           | 0.9597         | 0.6568        | 0.8833        | 0.8828        | 0.9914            | 0.9166               | 0.2767        | 0.3445         | 0.9236         | 0.9324          | 0.8438          | 0.0           | 0.0361     | nan      | 0.8966    | 0.6001   | 0.7273   | 0.8290   | 0.9818       | 0.6538          | 0.2102   | 0.3359    | 0.8758    | 0.8010     | 0.6779     |
| 0.0496        | 8.43  | 1180 | 0.1609          | 0.5814   | 0.7108        | 0.9553           | 0.9532   | 0.9553 | nan                | 0.0041          | nan           | 0.9615         | 0.5936        | 0.8529        | 0.8517        | 0.9939            | 0.9439               | 0.2877        | 0.4440         | 0.9077         | 0.9349          | 0.7532          | 0.0           | 0.0035     | nan      | 0.8968    | 0.5522   | 0.7242   | 0.8041   | 0.9809       | 0.6147          | 0.1959   | 0.4386    | 0.8718    | 0.8003     | 0.6756     |
| 0.079         | 8.57  | 1200 | 0.1332          | 0.5783   | 0.6993        | 0.9588           | 0.9566   | 0.9588 | nan                | 0.0             | nan           | 0.9588         | 0.6555        | 0.7735        | 0.9096        | 0.9939            | 0.9300               | 0.2807        | 0.2037         | 0.9173         | 0.9298          | 0.8383          | 0.0           | 0.0        | nan      | 0.8948    | 0.6018   | 0.7004   | 0.8527   | 0.9813       | 0.7232          | 0.1959   | 0.2032    | 0.8768    | 0.8100     | 0.6777     |
| 0.1797        | 8.71  | 1220 | 0.1321          | 0.6012   | 0.7096        | 0.9625           | 0.9602   | 0.9625 | nan                | 0.0             | nan           | 0.9639         | 0.6784        | 0.9002        | 0.9735        | 0.9931            | 0.9319               | 0.2638        | 0.2206         | 0.9077         | 0.9146          | 0.7669          | 0.0           | 0.0        | nan      | 0.8948    | 0.6148   | 0.7647   | 0.9027   | 0.9821       | 0.8453          | 0.2218   | 0.2200    | 0.8727    | 0.8154     | 0.6813     |
| 0.0599        | 8.86  | 1240 | 0.1321          | 0.6013   | 0.7106        | 0.9630           | 0.9607   | 0.9630 | nan                | 0.0             | nan           | 0.9526         | 0.7469        | 0.9123        | 0.9708        | 0.9923            | 0.9355               | 0.2503        | 0.1763         | 0.9337         | 0.9222          | 0.7345          | 0.0           | 0.0        | nan      | 0.8931    | 0.6567   | 0.7621   | 0.9123   | 0.9817       | 0.8493          | 0.2231   | 0.1759    | 0.8777    | 0.8185     | 0.6665     |
| 0.0607        | 9.0   | 1260 | 0.1580          | 0.5668   | 0.7035        | 0.9543           | 0.9521   | 0.9543 | nan                | 0.0003          | nan           | 0.9586         | 0.7034        | 0.8816        | 0.8416        | 0.9912            | 0.9499               | 0.2866        | 0.1688         | 0.9238         | 0.9501          | 0.7863          | 0.0           | 0.0003     | nan      | 0.8923    | 0.6258   | 0.7623   | 0.7997   | 0.9821       | 0.6145          | 0.1791   | 0.1674    | 0.8737    | 0.7955     | 0.6760     |
| 0.1154        | 9.14  | 1280 | 0.1540          | 0.5738   | 0.7192        | 0.9545           | 0.9524   | 0.9545 | nan                | 0.0328          | nan           | 0.9600         | 0.6419        | 0.9343        | 0.8468        | 0.9929            | 0.9347               | 0.2908        | 0.2807         | 0.9128         | 0.9611          | 0.8422          | 0.0           | 0.0257     | nan      | 0.8949    | 0.5996   | 0.7636   | 0.7967   | 0.9817       | 0.6282          | 0.1633   | 0.2772    | 0.8715    | 0.7918     | 0.6655     |
| 0.1047        | 9.29  | 1300 | 0.1369          | 0.5915   | 0.7342        | 0.9578           | 0.9561   | 0.9578 | nan                | 0.0338          | nan           | 0.9637         | 0.7150        | 0.9354        | 0.8903        | 0.9908            | 0.9363               | 0.3021        | 0.3361         | 0.9122         | 0.9653          | 0.8297          | 0.0           | 0.0263     | nan      | 0.8972    | 0.6499   | 0.7643   | 0.8402   | 0.9820       | 0.7037          | 0.1710   | 0.3308    | 0.8717    | 0.7680     | 0.6847     |
| 0.0709        | 9.43  | 1320 | 0.1469          | 0.5713   | 0.6946        | 0.9572           | 0.9549   | 0.9572 | nan                | 0.0074          | nan           | 0.9598         | 0.7151        | 0.7399        | 0.8738        | 0.9929            | 0.9244               | 0.2876        | 0.1671         | 0.9238         | 0.9484          | 0.7947          | 0.0           | 0.0066     | nan      | 0.8932    | 0.6462   | 0.6928   | 0.8263   | 0.9824       | 0.6639          | 0.1928   | 0.1659    | 0.8780    | 0.7918     | 0.6874     |
| 0.128         | 9.57  | 1340 | 0.1526          | 0.5723   | 0.6964        | 0.9561           | 0.9539   | 0.9561 | nan                | 0.0307          | nan           | 0.9630         | 0.7055        | 0.7236        | 0.8697        | 0.9934            | 0.9387               | 0.2777        | 0.1866         | 0.9069         | 0.9425          | 0.8186          | 0.0           | 0.0254     | nan      | 0.8924    | 0.6360   | 0.6937   | 0.8228   | 0.9818       | 0.6410          | 0.2121   | 0.1853    | 0.8718    | 0.7976     | 0.6801     |
| 0.1846        | 9.71  | 1360 | 0.1530          | 0.5663   | 0.7094        | 0.9543           | 0.9522   | 0.9543 | nan                | 0.0431          | nan           | 0.9614         | 0.7195        | 0.7574        | 0.8589        | 0.9933            | 0.9229               | 0.2874        | 0.2003         | 0.9000         | 0.9459          | 0.9226          | 0.0           | 0.0322     | nan      | 0.8904    | 0.6401   | 0.7128   | 0.8146   | 0.9811       | 0.6407          | 0.1922   | 0.1990    | 0.8661    | 0.7953     | 0.5974     |
| 0.0568        | 9.86  | 1380 | 0.1422          | 0.6027   | 0.7368        | 0.9578           | 0.9558   | 0.9578 | nan                | 0.0175          | nan           | 0.9559         | 0.6483        | 0.7743        | 0.8622        | 0.9927            | 0.9333               | 0.2927        | 0.6505         | 0.9244         | 0.9535          | 0.8366          | 0.0           | 0.0154     | nan      | 0.9013    | 0.6021   | 0.7331   | 0.8101   | 0.9822       | 0.6514          | 0.1724   | 0.6303    | 0.8759    | 0.7994     | 0.6610     |
| 0.0544        | 10.0  | 1400 | 0.1463          | 0.6051   | 0.7258        | 0.9591           | 0.9570   | 0.9591 | nan                | 0.0096          | nan           | 0.9583         | 0.6733        | 0.7330        | 0.8787        | 0.9935            | 0.9501               | 0.2223        | 0.6328         | 0.9187         | 0.9603          | 0.7785          | 0.0           | 0.0093     | nan      | 0.9019    | 0.6173   | 0.7054   | 0.8276   | 0.9818       | 0.6368          | 0.2051   | 0.6264    | 0.8762    | 0.8034     | 0.6749     |
| 0.0684        | 10.14 | 1420 | 0.1304          | 0.6195   | 0.7389        | 0.9618           | 0.9597   | 0.9618 | nan                | 0.0462          | nan           | 0.9591         | 0.7483        | 0.7333        | 0.9231        | 0.9932            | 0.9214               | 0.1927        | 0.6513         | 0.9149         | 0.9544          | 0.8284          | 0.0           | 0.0379     | nan      | 0.9015    | 0.6571   | 0.7068   | 0.8684   | 0.9818       | 0.7202          | 0.1834   | 0.6422    | 0.8733    | 0.8036     | 0.6769     |
| 0.0423        | 10.29 | 1440 | 0.1372          | 0.6107   | 0.7373        | 0.9600           | 0.9578   | 0.9600 | nan                | 0.0305          | nan           | 0.9580         | 0.7269        | 0.7609        | 0.8900        | 0.9932            | 0.9437               | 0.1996        | 0.6322         | 0.9186         | 0.9611          | 0.8324          | 0.0           | 0.0262     | nan      | 0.9020    | 0.6449   | 0.7228   | 0.8421   | 0.9821       | 0.6603          | 0.1885   | 0.6164    | 0.8748    | 0.8013     | 0.6773     |
| 0.1508        | 10.43 | 1460 | 0.1904          | 0.6044   | 0.7407        | 0.9573           | 0.9551   | 0.9573 | nan                | 0.0254          | nan           | 0.9635         | 0.6664        | 0.7753        | 0.8477        | 0.9919            | 0.9476               | 0.2662        | 0.6978         | 0.9138         | 0.9569          | 0.8364          | 0.0           | 0.0212     | nan      | 0.9022    | 0.5983   | 0.7151   | 0.8069   | 0.9820       | 0.6068          | 0.1991   | 0.6699    | 0.8746    | 0.8091     | 0.6721     |
| 0.1228        | 10.57 | 1480 | 0.2003          | 0.6049   | 0.7424        | 0.9566           | 0.9545   | 0.9566 | nan                | 0.0242          | nan           | 0.9493         | 0.6147        | 0.7633        | 0.8507        | 0.9933            | 0.9468               | 0.2698        | 0.7809         | 0.9260         | 0.9645          | 0.8250          | 0.0           | 0.0215     | nan      | 0.9018    | 0.5640   | 0.6984   | 0.8055   | 0.9810       | 0.5983          | 0.1931   | 0.7457    | 0.8721    | 0.8007     | 0.6816     |
| 0.0859        | 10.71 | 1500 | 0.1786          | 0.5757   | 0.7060        | 0.9560           | 0.9539   | 0.9560 | nan                | 0.0363          | nan           | 0.9515         | 0.6417        | 0.7712        | 0.8671        | 0.9937            | 0.9385               | 0.2644        | 0.2720         | 0.9270         | 0.9679          | 0.8406          | 0.0           | 0.0323     | nan      | 0.8946    | 0.5879   | 0.7126   | 0.8167   | 0.9814       | 0.6171          | 0.2226   | 0.2710    | 0.8761    | 0.7951     | 0.6765     |
| 0.1141        | 10.86 | 1520 | 0.1791          | 0.5730   | 0.7134        | 0.9553           | 0.9533   | 0.9553 | nan                | 0.0281          | nan           | 0.9627         | 0.7091        | 0.7951        | 0.8398        | 0.9918            | 0.9464               | 0.2971        | 0.2535         | 0.9179         | 0.9628          | 0.8561          | 0.0           | 0.0253     | nan      | 0.8946    | 0.6201   | 0.7289   | 0.8019   | 0.9825       | 0.6165          | 0.1905   | 0.2496    | 0.8766    | 0.7910     | 0.6721     |
| 0.0622        | 11.0  | 1540 | 0.1674          | 0.5833   | 0.7234        | 0.9562           | 0.9542   | 0.9562 | nan                | 0.0402          | nan           | 0.9567         | 0.6500        | 0.8251        | 0.8575        | 0.9934            | 0.9356               | 0.2835        | 0.3898         | 0.9192         | 0.9620          | 0.8675          | 0.0           | 0.0336     | nan      | 0.8965    | 0.5980   | 0.7233   | 0.8085   | 0.9822       | 0.6228          | 0.1991   | 0.3849    | 0.8756    | 0.7875     | 0.6708     |
| 0.0691        | 11.14 | 1560 | 0.1658          | 0.5875   | 0.7260        | 0.9566           | 0.9544   | 0.9566 | nan                | 0.0264          | nan           | 0.9571         | 0.6727        | 0.8209        | 0.8593        | 0.9937            | 0.9305               | 0.2788        | 0.4145         | 0.9177         | 0.9510          | 0.8891          | 0.0           | 0.0224     | nan      | 0.8972    | 0.6131   | 0.7279   | 0.8131   | 0.9817       | 0.6249          | 0.2065   | 0.4130    | 0.8750    | 0.8105     | 0.6525     |
| 0.0529        | 11.29 | 1580 | 0.1686          | 0.5933   | 0.7245        | 0.9571           | 0.9549   | 0.9571 | nan                | 0.0144          | nan           | 0.9567         | 0.6853        | 0.8211        | 0.8601        | 0.9933            | 0.9421               | 0.2757        | 0.4308         | 0.9218         | 0.9459          | 0.8469          | 0.0           | 0.0134     | nan      | 0.8986    | 0.6214   | 0.7392   | 0.8140   | 0.9815       | 0.6228          | 0.2140   | 0.4290    | 0.8766    | 0.8228     | 0.6790     |
| 0.0945        | 11.43 | 1600 | 0.1569          | 0.5896   | 0.7159        | 0.9573           | 0.9551   | 0.9573 | nan                | 0.0193          | nan           | 0.9603         | 0.7009        | 0.8169        | 0.8682        | 0.9928            | 0.9246               | 0.2761        | 0.3466         | 0.9197         | 0.9315          | 0.8332          | 0.0           | 0.0172     | nan      | 0.8967    | 0.6319   | 0.7410   | 0.8202   | 0.9821       | 0.6344          | 0.2141   | 0.3448    | 0.8765    | 0.8224     | 0.6829     |
| 0.0542        | 11.57 | 1620 | 0.1647          | 0.5883   | 0.7243        | 0.9567           | 0.9546   | 0.9567 | nan                | 0.0315          | nan           | 0.9587         | 0.6831        | 0.8074        | 0.8574        | 0.9921            | 0.9463               | 0.2777        | 0.3887         | 0.9217         | 0.9560          | 0.8708          | 0.0           | 0.0282     | nan      | 0.8975    | 0.6207   | 0.7421   | 0.8117   | 0.9821       | 0.6199          | 0.2096   | 0.3854    | 0.8762    | 0.8004     | 0.6737     |
| 0.0433        | 11.71 | 1640 | 0.1679          | 0.5926   | 0.7274        | 0.9563           | 0.9547   | 0.9563 | nan                | 0.0180          | nan           | 0.9578         | 0.6897        | 0.8191        | 0.8546        | 0.9924            | 0.9493               | 0.2805        | 0.4502         | 0.9180         | 0.9611          | 0.8385          | 0.0           | 0.0158     | nan      | 0.8986    | 0.6225   | 0.7553   | 0.8091   | 0.9815       | 0.6179          | 0.2026   | 0.4472    | 0.8755    | 0.7923     | 0.6859     |
| 0.0682        | 11.86 | 1660 | 0.1669          | 0.5896   | 0.7204        | 0.9563           | 0.9545   | 0.9563 | nan                | 0.0089          | nan           | 0.9535         | 0.6839        | 0.7987        | 0.8583        | 0.9927            | 0.9408               | 0.2789        | 0.4190         | 0.9263         | 0.9594          | 0.8244          | 0.0           | 0.0082     | nan      | 0.8971    | 0.6198   | 0.7405   | 0.8112   | 0.9815       | 0.6198          | 0.2055   | 0.4170    | 0.8749    | 0.8050     | 0.6839     |
| 0.0606        | 12.0  | 1680 | 0.1677          | 0.5893   | 0.7194        | 0.9570           | 0.9551   | 0.9570 | nan                | 0.0132          | nan           | 0.9607         | 0.6806        | 0.7861        | 0.8662        | 0.9927            | 0.9448               | 0.2621        | 0.4212         | 0.9148         | 0.9696          | 0.8211          | 0.0           | 0.0125     | nan      | 0.8981    | 0.6187   | 0.7325   | 0.8177   | 0.9819       | 0.6193          | 0.2222   | 0.4170    | 0.8747    | 0.7819     | 0.6842     |
| 0.1011        | 12.14 | 1700 | 0.1670          | 0.5865   | 0.7170        | 0.9571           | 0.9551   | 0.9571 | nan                | 0.0184          | nan           | 0.9563         | 0.7031        | 0.7381        | 0.8613        | 0.9926            | 0.9501               | 0.2573        | 0.3967         | 0.9251         | 0.9721          | 0.8331          | 0.0           | 0.0177     | nan      | 0.8977    | 0.6280   | 0.7038   | 0.8175   | 0.9822       | 0.6160          | 0.2230   | 0.3938    | 0.8761    | 0.7839     | 0.6844     |
| 0.1188        | 12.29 | 1720 | 0.1686          | 0.5793   | 0.7084        | 0.9562           | 0.9540   | 0.9562 | nan                | 0.0139          | nan           | 0.9631         | 0.6868        | 0.6758        | 0.8630        | 0.9924            | 0.9434               | 0.2647        | 0.3671         | 0.9080         | 0.9662          | 0.8567          | 0.0           | 0.0124     | nan      | 0.8950    | 0.6190   | 0.6564   | 0.8174   | 0.9820       | 0.6161          | 0.2226   | 0.3647    | 0.8700    | 0.8038     | 0.6721     |
| 0.047         | 12.43 | 1740 | 0.1607          | 0.5739   | 0.7025        | 0.9562           | 0.9541   | 0.9562 | nan                | 0.0206          | nan           | 0.9568         | 0.6793        | 0.7052        | 0.8636        | 0.9930            | 0.9336               | 0.2676        | 0.2595         | 0.9224         | 0.9620          | 0.8667          | 0.0           | 0.0179     | nan      | 0.8945    | 0.6143   | 0.6751   | 0.8181   | 0.9819       | 0.6225          | 0.2219   | 0.2588    | 0.8746    | 0.8105     | 0.6707     |
| 0.0513        | 12.57 | 1760 | 0.1527          | 0.5850   | 0.7180        | 0.9571           | 0.9551   | 0.9571 | nan                | 0.0310          | nan           | 0.9570         | 0.7189        | 0.7108        | 0.8751        | 0.9935            | 0.9408               | 0.2617        | 0.3651         | 0.9129         | 0.9696          | 0.8801          | 0.0           | 0.0270     | nan      | 0.8967    | 0.6382   | 0.6866   | 0.8267   | 0.9818       | 0.6316          | 0.2235   | 0.3629    | 0.8721    | 0.7949     | 0.6629     |
| 2.1943        | 12.71 | 1780 | 0.1521          | 0.5853   | 0.7182        | 0.9571           | 0.9551   | 0.9571 | nan                | 0.0280          | nan           | 0.9619         | 0.6966        | 0.7361        | 0.8645        | 0.9931            | 0.9419               | 0.2766        | 0.3722         | 0.9119         | 0.9620          | 0.8730          | 0.0           | 0.0238     | nan      | 0.8969    | 0.6283   | 0.6931   | 0.8200   | 0.9823       | 0.6365          | 0.2114   | 0.3692    | 0.8738    | 0.8042     | 0.6698     |
| 0.0588        | 12.86 | 1800 | 0.1443          | 0.5943   | 0.7290        | 0.9577           | 0.9558   | 0.9577 | nan                | 0.0252          | nan           | 0.9513         | 0.6982        | 0.7767        | 0.8719        | 0.9926            | 0.9466               | 0.2799        | 0.4529         | 0.9298         | 0.9730          | 0.8499          | 0.0           | 0.0226     | nan      | 0.8978    | 0.6323   | 0.7222   | 0.8240   | 0.9821       | 0.6480          | 0.2058   | 0.4497    | 0.8749    | 0.7873     | 0.6797     |
| 0.0596        | 13.0  | 1820 | 0.1397          | 0.5998   | 0.7289        | 0.9588           | 0.9567   | 0.9588 | nan                | 0.0117          | nan           | 0.9547         | 0.6907        | 0.7723        | 0.8819        | 0.9934            | 0.9271               | 0.2788        | 0.5085         | 0.9256         | 0.9645          | 0.8377          | 0.0           | 0.0105     | nan      | 0.8995    | 0.6280   | 0.7109   | 0.8317   | 0.9817       | 0.6622          | 0.2077   | 0.5053    | 0.8758    | 0.7990     | 0.6845     |
| 0.0483        | 13.14 | 1840 | 0.1472          | 0.5937   | 0.7231        | 0.9577           | 0.9557   | 0.9577 | nan                | 0.0049          | nan           | 0.9627         | 0.6929        | 0.7769        | 0.8666        | 0.9919            | 0.9469               | 0.2783        | 0.4522         | 0.9173         | 0.9577          | 0.8286          | 0.0           | 0.0044     | nan      | 0.8987    | 0.6271   | 0.7233   | 0.8223   | 0.9822       | 0.6396          | 0.2066   | 0.4483    | 0.8750    | 0.8070     | 0.6843     |
| 0.0827        | 13.29 | 1860 | 0.1471          | 0.5911   | 0.7184        | 0.9578           | 0.9557   | 0.9578 | nan                | 0.0015          | nan           | 0.9599         | 0.6530        | 0.7314        | 0.8711        | 0.9922            | 0.9463               | 0.2737        | 0.4788         | 0.9207         | 0.9603          | 0.8317          | 0.0           | 0.0014     | nan      | 0.8991    | 0.6024   | 0.6945   | 0.8225   | 0.9821       | 0.6334          | 0.2137   | 0.4739    | 0.8756    | 0.8034     | 0.6821     |
| 0.0552        | 13.43 | 1880 | 0.1454          | 0.5930   | 0.7223        | 0.9576           | 0.9556   | 0.9576 | nan                | 0.0136          | nan           | 0.9568         | 0.6701        | 0.7427        | 0.8729        | 0.9930            | 0.9468               | 0.2724        | 0.4850         | 0.9191         | 0.9662          | 0.8290          | 0.0           | 0.0119     | nan      | 0.8990    | 0.6118   | 0.7012   | 0.8248   | 0.9816       | 0.6347          | 0.2172   | 0.4813    | 0.8737    | 0.7899     | 0.6822     |
| 0.068         | 13.57 | 1900 | 0.1448          | 0.5940   | 0.7236        | 0.9580           | 0.9560   | 0.9580 | nan                | 0.0064          | nan           | 0.9579         | 0.6975        | 0.7405        | 0.8728        | 0.9928            | 0.9481               | 0.2726        | 0.4839         | 0.9195         | 0.9687          | 0.8222          | 0.0           | 0.0059     | nan      | 0.8992    | 0.6306   | 0.7038   | 0.8266   | 0.9818       | 0.6366          | 0.2175   | 0.4799    | 0.8743    | 0.7823     | 0.6842     |
| 0.0591        | 13.71 | 1920 | 0.1427          | 0.5951   | 0.7259        | 0.9584           | 0.9564   | 0.9584 | nan                | 0.0080          | nan           | 0.9574         | 0.7088        | 0.7468        | 0.8777        | 0.9928            | 0.9485               | 0.2770        | 0.4749         | 0.9209         | 0.9738          | 0.8238          | 0.0           | 0.0074     | nan      | 0.8995    | 0.6376   | 0.7098   | 0.8306   | 0.9820       | 0.6494          | 0.2104   | 0.4714    | 0.8752    | 0.7779     | 0.6849     |
| 0.053         | 13.86 | 1940 | 0.1340          | 0.6069   | 0.7335        | 0.9602           | 0.9581   | 0.9602 | nan                | 0.0129          | nan           | 0.9609         | 0.7142        | 0.7513        | 0.8969        | 0.9933            | 0.9277               | 0.2742        | 0.5545         | 0.9155         | 0.9662          | 0.8346          | 0.0           | 0.0114     | nan      | 0.9008    | 0.6409   | 0.7080   | 0.8474   | 0.9820       | 0.6892          | 0.2118   | 0.5495    | 0.8749    | 0.7883     | 0.6856     |
| 0.0777        | 14.0  | 1960 | 0.1390          | 0.6075   | 0.7417        | 0.9594           | 0.9573   | 0.9594 | nan                | 0.0141          | nan           | 0.9607         | 0.7186        | 0.7504        | 0.8801        | 0.9923            | 0.9473               | 0.2735        | 0.6207         | 0.9162         | 0.9755          | 0.8504          | 0.0           | 0.0127     | nan      | 0.9018    | 0.6429   | 0.7125   | 0.8332   | 0.9822       | 0.6581          | 0.2135   | 0.6064    | 0.8745    | 0.7776     | 0.6819     |
| 0.0424        | 14.14 | 1980 | 0.1363          | 0.6102   | 0.7436        | 0.9598           | 0.9578   | 0.9598 | nan                | 0.0142          | nan           | 0.9583         | 0.7215        | 0.7595        | 0.8913        | 0.9920            | 0.9501               | 0.2749        | 0.6195         | 0.9191         | 0.9763          | 0.8471          | 0.0           | 0.0127     | nan      | 0.9013    | 0.6443   | 0.7191   | 0.8437   | 0.9822       | 0.6749          | 0.2102   | 0.6055    | 0.8739    | 0.7809     | 0.6835     |
| 0.0791        | 14.29 | 2000 | 0.1346          | 0.6110   | 0.7455        | 0.9599           | 0.9579   | 0.9599 | nan                | 0.0127          | nan           | 0.9545         | 0.7073        | 0.7649        | 0.8931        | 0.9924            | 0.9514               | 0.2758        | 0.6445         | 0.9238         | 0.9763          | 0.8491          | 0.0           | 0.0118     | nan      | 0.9016    | 0.6375   | 0.7184   | 0.8445   | 0.9821       | 0.6752          | 0.2085   | 0.6289    | 0.8741    | 0.7767     | 0.6842     |
| 0.0449        | 14.43 | 2020 | 0.1319          | 0.6103   | 0.7360        | 0.9607           | 0.9587   | 0.9607 | nan                | 0.0132          | nan           | 0.9594         | 0.7066        | 0.7546        | 0.9082        | 0.9928            | 0.9357               | 0.2743        | 0.5683         | 0.9179         | 0.9645          | 0.8362          | 0.0           | 0.0117     | nan      | 0.9006    | 0.6371   | 0.7120   | 0.8578   | 0.9821       | 0.7085          | 0.2107   | 0.5602    | 0.8744    | 0.7935     | 0.6850     |
| 0.0614        | 14.57 | 2040 | 0.1326          | 0.6100   | 0.7397        | 0.9607           | 0.9586   | 0.9607 | nan                | 0.0188          | nan           | 0.9574         | 0.7049        | 0.7635        | 0.9047        | 0.9927            | 0.9391               | 0.2755        | 0.5764         | 0.9218         | 0.9713          | 0.8499          | 0.0           | 0.0165     | nan      | 0.9009    | 0.6374   | 0.7156   | 0.8548   | 0.9821       | 0.7039          | 0.2101   | 0.5676    | 0.8751    | 0.7832     | 0.6827     |
| 0.0683        | 14.71 | 2060 | 0.1343          | 0.6065   | 0.7360        | 0.9603           | 0.9582   | 0.9603 | nan                | 0.0137          | nan           | 0.9577         | 0.6810        | 0.7431        | 0.9022        | 0.9923            | 0.9469               | 0.2703        | 0.5811         | 0.9213         | 0.9687          | 0.8538          | 0.0           | 0.0127     | nan      | 0.9011    | 0.6232   | 0.7022   | 0.8507   | 0.9821       | 0.6864          | 0.2155   | 0.5725    | 0.8747    | 0.7823     | 0.6815     |
| 0.0873        | 14.86 | 2080 | 0.1300          | 0.6133   | 0.7419        | 0.9613           | 0.9593   | 0.9613 | nan                | 0.0192          | nan           | 0.9577         | 0.7116        | 0.7551        | 0.9125        | 0.9923            | 0.9345               | 0.2737        | 0.5976         | 0.9234         | 0.9687          | 0.8561          | 0.0           | 0.0168     | nan      | 0.9013    | 0.6418   | 0.7082   | 0.8615   | 0.9823       | 0.7184          | 0.2128   | 0.5865    | 0.8756    | 0.7860     | 0.6811     |
| 0.0502        | 15.0  | 2100 | 0.1322          | 0.6132   | 0.7450        | 0.9609           | 0.9588   | 0.9609 | nan                | 0.0206          | nan           | 0.9558         | 0.6844        | 0.7721        | 0.9074        | 0.9928            | 0.9443               | 0.2718        | 0.6305         | 0.9225         | 0.9763          | 0.8611          | 0.0           | 0.0184     | nan      | 0.9019    | 0.6258   | 0.7197   | 0.8552   | 0.9821       | 0.6995          | 0.2149   | 0.6173    | 0.8751    | 0.7825     | 0.6797     |


### Framework versions

- Transformers 4.33.2
- Pytorch 2.0.1
- Datasets 3.0.0
- Tokenizers 0.13.3