zyznull commited on
Commit
b234304
1 Parent(s): 7dc05cb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1049 -0
README.md CHANGED
@@ -2601,6 +2601,1055 @@ model-index:
2601
  value: 86.60631843011362
2602
  - type: max_f1
2603
  value: 79.14949970570925
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2604
  ---
2605
 
2606
  ## gte-Qwen2-7B-instruct
 
2601
  value: 86.60631843011362
2602
  - type: max_f1
2603
  value: 79.14949970570925
2604
+ - task:
2605
+ type: STS
2606
+ dataset:
2607
+ type: C-MTEB/AFQMC
2608
+ name: MTEB AFQMC
2609
+ config: default
2610
+ split: validation
2611
+ revision: b44c3b011063adb25877c13823db83bb193913c4
2612
+ metrics:
2613
+ - type: cos_sim_pearson
2614
+ value: 65.58442135663871
2615
+ - type: cos_sim_spearman
2616
+ value: 72.2538631361313
2617
+ - type: euclidean_pearson
2618
+ value: 70.97255486607429
2619
+ - type: euclidean_spearman
2620
+ value: 72.25374250228647
2621
+ - type: manhattan_pearson
2622
+ value: 70.83250199989911
2623
+ - type: manhattan_spearman
2624
+ value: 72.14819496536272
2625
+ - task:
2626
+ type: STS
2627
+ dataset:
2628
+ type: C-MTEB/ATEC
2629
+ name: MTEB ATEC
2630
+ config: default
2631
+ split: test
2632
+ revision: 0f319b1142f28d00e055a6770f3f726ae9b7d865
2633
+ metrics:
2634
+ - type: cos_sim_pearson
2635
+ value: 59.99478404929932
2636
+ - type: cos_sim_spearman
2637
+ value: 62.61836216999812
2638
+ - type: euclidean_pearson
2639
+ value: 66.86429811933593
2640
+ - type: euclidean_spearman
2641
+ value: 62.6183520374191
2642
+ - type: manhattan_pearson
2643
+ value: 66.8063778911633
2644
+ - type: manhattan_spearman
2645
+ value: 62.569607573241115
2646
+ - task:
2647
+ type: Classification
2648
+ dataset:
2649
+ type: mteb/amazon_reviews_multi
2650
+ name: MTEB AmazonReviewsClassification (zh)
2651
+ config: zh
2652
+ split: test
2653
+ revision: 1399c76144fd37290681b995c656ef9b2e06e26d
2654
+ metrics:
2655
+ - type: accuracy
2656
+ value: 53.98400000000001
2657
+ - type: f1
2658
+ value: 51.21447361350723
2659
+ - task:
2660
+ type: STS
2661
+ dataset:
2662
+ type: C-MTEB/BQ
2663
+ name: MTEB BQ
2664
+ config: default
2665
+ split: test
2666
+ revision: e3dda5e115e487b39ec7e618c0c6a29137052a55
2667
+ metrics:
2668
+ - type: cos_sim_pearson
2669
+ value: 79.11941660686553
2670
+ - type: cos_sim_spearman
2671
+ value: 81.25029594540435
2672
+ - type: euclidean_pearson
2673
+ value: 82.06973504238826
2674
+ - type: euclidean_spearman
2675
+ value: 81.2501989488524
2676
+ - type: manhattan_pearson
2677
+ value: 82.10094630392753
2678
+ - type: manhattan_spearman
2679
+ value: 81.27987244392389
2680
+ - task:
2681
+ type: Clustering
2682
+ dataset:
2683
+ type: C-MTEB/CLSClusteringP2P
2684
+ name: MTEB CLSClusteringP2P
2685
+ config: default
2686
+ split: test
2687
+ revision: 4b6227591c6c1a73bc76b1055f3b7f3588e72476
2688
+ metrics:
2689
+ - type: v_measure
2690
+ value: 47.07270168705156
2691
+ - task:
2692
+ type: Clustering
2693
+ dataset:
2694
+ type: C-MTEB/CLSClusteringS2S
2695
+ name: MTEB CLSClusteringS2S
2696
+ config: default
2697
+ split: test
2698
+ revision: e458b3f5414b62b7f9f83499ac1f5497ae2e869f
2699
+ metrics:
2700
+ - type: v_measure
2701
+ value: 45.98511703185043
2702
+ - task:
2703
+ type: Reranking
2704
+ dataset:
2705
+ type: C-MTEB/CMedQAv1-reranking
2706
+ name: MTEB CMedQAv1
2707
+ config: default
2708
+ split: test
2709
+ revision: 8d7f1e942507dac42dc58017c1a001c3717da7df
2710
+ metrics:
2711
+ - type: map
2712
+ value: 88.19895157194931
2713
+ - type: mrr
2714
+ value: 90.21424603174603
2715
+ - task:
2716
+ type: Reranking
2717
+ dataset:
2718
+ type: C-MTEB/CMedQAv2-reranking
2719
+ name: MTEB CMedQAv2
2720
+ config: default
2721
+ split: test
2722
+ revision: 23d186750531a14a0357ca22cd92d712fd512ea0
2723
+ metrics:
2724
+ - type: map
2725
+ value: 88.03317320980119
2726
+ - type: mrr
2727
+ value: 89.9461507936508
2728
+ - task:
2729
+ type: Retrieval
2730
+ dataset:
2731
+ type: C-MTEB/CmedqaRetrieval
2732
+ name: MTEB CmedqaRetrieval
2733
+ config: default
2734
+ split: dev
2735
+ revision: cd540c506dae1cf9e9a59c3e06f42030d54e7301
2736
+ metrics:
2737
+ - type: map_at_1
2738
+ value: 29.037000000000003
2739
+ - type: map_at_10
2740
+ value: 42.001
2741
+ - type: map_at_100
2742
+ value: 43.773
2743
+ - type: map_at_1000
2744
+ value: 43.878
2745
+ - type: map_at_3
2746
+ value: 37.637
2747
+ - type: map_at_5
2748
+ value: 40.034
2749
+ - type: mrr_at_1
2750
+ value: 43.136
2751
+ - type: mrr_at_10
2752
+ value: 51.158
2753
+ - type: mrr_at_100
2754
+ value: 52.083
2755
+ - type: mrr_at_1000
2756
+ value: 52.12
2757
+ - type: mrr_at_3
2758
+ value: 48.733
2759
+ - type: mrr_at_5
2760
+ value: 50.025
2761
+ - type: ndcg_at_1
2762
+ value: 43.136
2763
+ - type: ndcg_at_10
2764
+ value: 48.685
2765
+ - type: ndcg_at_100
2766
+ value: 55.513
2767
+ - type: ndcg_at_1000
2768
+ value: 57.242000000000004
2769
+ - type: ndcg_at_3
2770
+ value: 43.329
2771
+ - type: ndcg_at_5
2772
+ value: 45.438
2773
+ - type: precision_at_1
2774
+ value: 43.136
2775
+ - type: precision_at_10
2776
+ value: 10.56
2777
+ - type: precision_at_100
2778
+ value: 1.6129999999999998
2779
+ - type: precision_at_1000
2780
+ value: 0.184
2781
+ - type: precision_at_3
2782
+ value: 24.064
2783
+ - type: precision_at_5
2784
+ value: 17.269000000000002
2785
+ - type: recall_at_1
2786
+ value: 29.037000000000003
2787
+ - type: recall_at_10
2788
+ value: 59.245000000000005
2789
+ - type: recall_at_100
2790
+ value: 87.355
2791
+ - type: recall_at_1000
2792
+ value: 98.74000000000001
2793
+ - type: recall_at_3
2794
+ value: 42.99
2795
+ - type: recall_at_5
2796
+ value: 49.681999999999995
2797
+ - task:
2798
+ type: PairClassification
2799
+ dataset:
2800
+ type: C-MTEB/CMNLI
2801
+ name: MTEB Cmnli
2802
+ config: default
2803
+ split: validation
2804
+ revision: 41bc36f332156f7adc9e38f53777c959b2ae9766
2805
+ metrics:
2806
+ - type: cos_sim_accuracy
2807
+ value: 82.68190018039687
2808
+ - type: cos_sim_ap
2809
+ value: 90.18017125327886
2810
+ - type: cos_sim_f1
2811
+ value: 83.64080906868193
2812
+ - type: cos_sim_precision
2813
+ value: 79.7076890489303
2814
+ - type: cos_sim_recall
2815
+ value: 87.98223053542202
2816
+ - type: dot_accuracy
2817
+ value: 82.68190018039687
2818
+ - type: dot_ap
2819
+ value: 90.18782350103646
2820
+ - type: dot_f1
2821
+ value: 83.64242087729039
2822
+ - type: dot_precision
2823
+ value: 79.65313028764805
2824
+ - type: dot_recall
2825
+ value: 88.05237315875614
2826
+ - type: euclidean_accuracy
2827
+ value: 82.68190018039687
2828
+ - type: euclidean_ap
2829
+ value: 90.1801957900632
2830
+ - type: euclidean_f1
2831
+ value: 83.63636363636364
2832
+ - type: euclidean_precision
2833
+ value: 79.52772506852203
2834
+ - type: euclidean_recall
2835
+ value: 88.19265840542437
2836
+ - type: manhattan_accuracy
2837
+ value: 82.14070956103427
2838
+ - type: manhattan_ap
2839
+ value: 89.96178420101427
2840
+ - type: manhattan_f1
2841
+ value: 83.21087838578791
2842
+ - type: manhattan_precision
2843
+ value: 78.35605121850475
2844
+ - type: manhattan_recall
2845
+ value: 88.70703764320785
2846
+ - type: max_accuracy
2847
+ value: 82.68190018039687
2848
+ - type: max_ap
2849
+ value: 90.18782350103646
2850
+ - type: max_f1
2851
+ value: 83.64242087729039
2852
+ - task:
2853
+ type: Retrieval
2854
+ dataset:
2855
+ type: C-MTEB/CovidRetrieval
2856
+ name: MTEB CovidRetrieval
2857
+ config: default
2858
+ split: dev
2859
+ revision: 1271c7809071a13532e05f25fb53511ffce77117
2860
+ metrics:
2861
+ - type: map_at_1
2862
+ value: 72.234
2863
+ - type: map_at_10
2864
+ value: 80.10000000000001
2865
+ - type: map_at_100
2866
+ value: 80.36
2867
+ - type: map_at_1000
2868
+ value: 80.363
2869
+ - type: map_at_3
2870
+ value: 78.315
2871
+ - type: map_at_5
2872
+ value: 79.607
2873
+ - type: mrr_at_1
2874
+ value: 72.392
2875
+ - type: mrr_at_10
2876
+ value: 80.117
2877
+ - type: mrr_at_100
2878
+ value: 80.36999999999999
2879
+ - type: mrr_at_1000
2880
+ value: 80.373
2881
+ - type: mrr_at_3
2882
+ value: 78.469
2883
+ - type: mrr_at_5
2884
+ value: 79.633
2885
+ - type: ndcg_at_1
2886
+ value: 72.392
2887
+ - type: ndcg_at_10
2888
+ value: 83.651
2889
+ - type: ndcg_at_100
2890
+ value: 84.749
2891
+ - type: ndcg_at_1000
2892
+ value: 84.83000000000001
2893
+ - type: ndcg_at_3
2894
+ value: 80.253
2895
+ - type: ndcg_at_5
2896
+ value: 82.485
2897
+ - type: precision_at_1
2898
+ value: 72.392
2899
+ - type: precision_at_10
2900
+ value: 9.557
2901
+ - type: precision_at_100
2902
+ value: 1.004
2903
+ - type: precision_at_1000
2904
+ value: 0.101
2905
+ - type: precision_at_3
2906
+ value: 28.732000000000003
2907
+ - type: precision_at_5
2908
+ value: 18.377
2909
+ - type: recall_at_1
2910
+ value: 72.234
2911
+ - type: recall_at_10
2912
+ value: 94.573
2913
+ - type: recall_at_100
2914
+ value: 99.368
2915
+ - type: recall_at_1000
2916
+ value: 100.0
2917
+ - type: recall_at_3
2918
+ value: 85.669
2919
+ - type: recall_at_5
2920
+ value: 91.01700000000001
2921
+ - task:
2922
+ type: Retrieval
2923
+ dataset:
2924
+ type: C-MTEB/DuRetrieval
2925
+ name: MTEB DuRetrieval
2926
+ config: default
2927
+ split: dev
2928
+ revision: a1a333e290fe30b10f3f56498e3a0d911a693ced
2929
+ metrics:
2930
+ - type: map_at_1
2931
+ value: 26.173999999999996
2932
+ - type: map_at_10
2933
+ value: 80.04
2934
+ - type: map_at_100
2935
+ value: 82.94500000000001
2936
+ - type: map_at_1000
2937
+ value: 82.98100000000001
2938
+ - type: map_at_3
2939
+ value: 55.562999999999995
2940
+ - type: map_at_5
2941
+ value: 69.89800000000001
2942
+ - type: mrr_at_1
2943
+ value: 89.5
2944
+ - type: mrr_at_10
2945
+ value: 92.996
2946
+ - type: mrr_at_100
2947
+ value: 93.06400000000001
2948
+ - type: mrr_at_1000
2949
+ value: 93.065
2950
+ - type: mrr_at_3
2951
+ value: 92.658
2952
+ - type: mrr_at_5
2953
+ value: 92.84599999999999
2954
+ - type: ndcg_at_1
2955
+ value: 89.5
2956
+ - type: ndcg_at_10
2957
+ value: 87.443
2958
+ - type: ndcg_at_100
2959
+ value: 90.253
2960
+ - type: ndcg_at_1000
2961
+ value: 90.549
2962
+ - type: ndcg_at_3
2963
+ value: 85.874
2964
+ - type: ndcg_at_5
2965
+ value: 84.842
2966
+ - type: precision_at_1
2967
+ value: 89.5
2968
+ - type: precision_at_10
2969
+ value: 41.805
2970
+ - type: precision_at_100
2971
+ value: 4.827
2972
+ - type: precision_at_1000
2973
+ value: 0.49
2974
+ - type: precision_at_3
2975
+ value: 76.85
2976
+ - type: precision_at_5
2977
+ value: 64.8
2978
+ - type: recall_at_1
2979
+ value: 26.173999999999996
2980
+ - type: recall_at_10
2981
+ value: 89.101
2982
+ - type: recall_at_100
2983
+ value: 98.08099999999999
2984
+ - type: recall_at_1000
2985
+ value: 99.529
2986
+ - type: recall_at_3
2987
+ value: 57.902
2988
+ - type: recall_at_5
2989
+ value: 74.602
2990
+ - task:
2991
+ type: Retrieval
2992
+ dataset:
2993
+ type: C-MTEB/EcomRetrieval
2994
+ name: MTEB EcomRetrieval
2995
+ config: default
2996
+ split: dev
2997
+ revision: 687de13dc7294d6fd9be10c6945f9e8fec8166b9
2998
+ metrics:
2999
+ - type: map_at_1
3000
+ value: 56.10000000000001
3001
+ - type: map_at_10
3002
+ value: 66.15299999999999
3003
+ - type: map_at_100
3004
+ value: 66.625
3005
+ - type: map_at_1000
3006
+ value: 66.636
3007
+ - type: map_at_3
3008
+ value: 63.632999999999996
3009
+ - type: map_at_5
3010
+ value: 65.293
3011
+ - type: mrr_at_1
3012
+ value: 56.10000000000001
3013
+ - type: mrr_at_10
3014
+ value: 66.15299999999999
3015
+ - type: mrr_at_100
3016
+ value: 66.625
3017
+ - type: mrr_at_1000
3018
+ value: 66.636
3019
+ - type: mrr_at_3
3020
+ value: 63.632999999999996
3021
+ - type: mrr_at_5
3022
+ value: 65.293
3023
+ - type: ndcg_at_1
3024
+ value: 56.10000000000001
3025
+ - type: ndcg_at_10
3026
+ value: 71.146
3027
+ - type: ndcg_at_100
3028
+ value: 73.27799999999999
3029
+ - type: ndcg_at_1000
3030
+ value: 73.529
3031
+ - type: ndcg_at_3
3032
+ value: 66.09
3033
+ - type: ndcg_at_5
3034
+ value: 69.08999999999999
3035
+ - type: precision_at_1
3036
+ value: 56.10000000000001
3037
+ - type: precision_at_10
3038
+ value: 8.68
3039
+ - type: precision_at_100
3040
+ value: 0.964
3041
+ - type: precision_at_1000
3042
+ value: 0.098
3043
+ - type: precision_at_3
3044
+ value: 24.4
3045
+ - type: precision_at_5
3046
+ value: 16.1
3047
+ - type: recall_at_1
3048
+ value: 56.10000000000001
3049
+ - type: recall_at_10
3050
+ value: 86.8
3051
+ - type: recall_at_100
3052
+ value: 96.39999999999999
3053
+ - type: recall_at_1000
3054
+ value: 98.3
3055
+ - type: recall_at_3
3056
+ value: 73.2
3057
+ - type: recall_at_5
3058
+ value: 80.5
3059
+ - task:
3060
+ type: Classification
3061
+ dataset:
3062
+ type: C-MTEB/IFlyTek-classification
3063
+ name: MTEB IFlyTek
3064
+ config: default
3065
+ split: validation
3066
+ revision: 421605374b29664c5fc098418fe20ada9bd55f8a
3067
+ metrics:
3068
+ - type: accuracy
3069
+ value: 54.52096960369373
3070
+ - type: f1
3071
+ value: 40.930845295808695
3072
+ - task:
3073
+ type: Classification
3074
+ dataset:
3075
+ type: C-MTEB/JDReview-classification
3076
+ name: MTEB JDReview
3077
+ config: default
3078
+ split: test
3079
+ revision: b7c64bd89eb87f8ded463478346f76731f07bf8b
3080
+ metrics:
3081
+ - type: accuracy
3082
+ value: 86.51031894934334
3083
+ - type: ap
3084
+ value: 55.9516014323483
3085
+ - type: f1
3086
+ value: 81.54813679326381
3087
+ - task:
3088
+ type: STS
3089
+ dataset:
3090
+ type: C-MTEB/LCQMC
3091
+ name: MTEB LCQMC
3092
+ config: default
3093
+ split: test
3094
+ revision: 17f9b096f80380fce5ed12a9be8be7784b337daf
3095
+ metrics:
3096
+ - type: cos_sim_pearson
3097
+ value: 69.67437838574276
3098
+ - type: cos_sim_spearman
3099
+ value: 73.81314174653045
3100
+ - type: euclidean_pearson
3101
+ value: 72.63430276680275
3102
+ - type: euclidean_spearman
3103
+ value: 73.81358736777001
3104
+ - type: manhattan_pearson
3105
+ value: 72.58743833842829
3106
+ - type: manhattan_spearman
3107
+ value: 73.7590419009179
3108
+ - task:
3109
+ type: Reranking
3110
+ dataset:
3111
+ type: C-MTEB/Mmarco-reranking
3112
+ name: MTEB MMarcoReranking
3113
+ config: default
3114
+ split: dev
3115
+ revision: None
3116
+ metrics:
3117
+ - type: map
3118
+ value: 31.648613483640254
3119
+ - type: mrr
3120
+ value: 30.37420634920635
3121
+ - task:
3122
+ type: Retrieval
3123
+ dataset:
3124
+ type: C-MTEB/MMarcoRetrieval
3125
+ name: MTEB MMarcoRetrieval
3126
+ config: default
3127
+ split: dev
3128
+ revision: 539bbde593d947e2a124ba72651aafc09eb33fc2
3129
+ metrics:
3130
+ - type: map_at_1
3131
+ value: 73.28099999999999
3132
+ - type: map_at_10
3133
+ value: 81.977
3134
+ - type: map_at_100
3135
+ value: 82.222
3136
+ - type: map_at_1000
3137
+ value: 82.22699999999999
3138
+ - type: map_at_3
3139
+ value: 80.441
3140
+ - type: map_at_5
3141
+ value: 81.46600000000001
3142
+ - type: mrr_at_1
3143
+ value: 75.673
3144
+ - type: mrr_at_10
3145
+ value: 82.41000000000001
3146
+ - type: mrr_at_100
3147
+ value: 82.616
3148
+ - type: mrr_at_1000
3149
+ value: 82.621
3150
+ - type: mrr_at_3
3151
+ value: 81.094
3152
+ - type: mrr_at_5
3153
+ value: 81.962
3154
+ - type: ndcg_at_1
3155
+ value: 75.673
3156
+ - type: ndcg_at_10
3157
+ value: 85.15599999999999
3158
+ - type: ndcg_at_100
3159
+ value: 86.151
3160
+ - type: ndcg_at_1000
3161
+ value: 86.26899999999999
3162
+ - type: ndcg_at_3
3163
+ value: 82.304
3164
+ - type: ndcg_at_5
3165
+ value: 84.009
3166
+ - type: precision_at_1
3167
+ value: 75.673
3168
+ - type: precision_at_10
3169
+ value: 10.042
3170
+ - type: precision_at_100
3171
+ value: 1.052
3172
+ - type: precision_at_1000
3173
+ value: 0.106
3174
+ - type: precision_at_3
3175
+ value: 30.673000000000002
3176
+ - type: precision_at_5
3177
+ value: 19.326999999999998
3178
+ - type: recall_at_1
3179
+ value: 73.28099999999999
3180
+ - type: recall_at_10
3181
+ value: 94.446
3182
+ - type: recall_at_100
3183
+ value: 98.737
3184
+ - type: recall_at_1000
3185
+ value: 99.649
3186
+ - type: recall_at_3
3187
+ value: 86.984
3188
+ - type: recall_at_5
3189
+ value: 91.024
3190
+ - task:
3191
+ type: Classification
3192
+ dataset:
3193
+ type: mteb/amazon_massive_intent
3194
+ name: MTEB MassiveIntentClassification (zh-CN)
3195
+ config: zh-CN
3196
+ split: test
3197
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
3198
+ metrics:
3199
+ - type: accuracy
3200
+ value: 81.08607935440484
3201
+ - type: f1
3202
+ value: 78.24879986066307
3203
+ - task:
3204
+ type: Classification
3205
+ dataset:
3206
+ type: mteb/amazon_massive_scenario
3207
+ name: MTEB MassiveScenarioClassification (zh-CN)
3208
+ config: zh-CN
3209
+ split: test
3210
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
3211
+ metrics:
3212
+ - type: accuracy
3213
+ value: 86.05917955615332
3214
+ - type: f1
3215
+ value: 85.05279279434997
3216
+ - task:
3217
+ type: Retrieval
3218
+ dataset:
3219
+ type: C-MTEB/MedicalRetrieval
3220
+ name: MTEB MedicalRetrieval
3221
+ config: default
3222
+ split: dev
3223
+ revision: 2039188fb5800a9803ba5048df7b76e6fb151fc6
3224
+ metrics:
3225
+ - type: map_at_1
3226
+ value: 56.2
3227
+ - type: map_at_10
3228
+ value: 62.57899999999999
3229
+ - type: map_at_100
3230
+ value: 63.154999999999994
3231
+ - type: map_at_1000
3232
+ value: 63.193
3233
+ - type: map_at_3
3234
+ value: 61.217
3235
+ - type: map_at_5
3236
+ value: 62.012
3237
+ - type: mrr_at_1
3238
+ value: 56.3
3239
+ - type: mrr_at_10
3240
+ value: 62.629000000000005
3241
+ - type: mrr_at_100
3242
+ value: 63.205999999999996
3243
+ - type: mrr_at_1000
3244
+ value: 63.244
3245
+ - type: mrr_at_3
3246
+ value: 61.267
3247
+ - type: mrr_at_5
3248
+ value: 62.062
3249
+ - type: ndcg_at_1
3250
+ value: 56.2
3251
+ - type: ndcg_at_10
3252
+ value: 65.592
3253
+ - type: ndcg_at_100
3254
+ value: 68.657
3255
+ - type: ndcg_at_1000
3256
+ value: 69.671
3257
+ - type: ndcg_at_3
3258
+ value: 62.808
3259
+ - type: ndcg_at_5
3260
+ value: 64.24499999999999
3261
+ - type: precision_at_1
3262
+ value: 56.2
3263
+ - type: precision_at_10
3264
+ value: 7.5
3265
+ - type: precision_at_100
3266
+ value: 0.899
3267
+ - type: precision_at_1000
3268
+ value: 0.098
3269
+ - type: precision_at_3
3270
+ value: 22.467000000000002
3271
+ - type: precision_at_5
3272
+ value: 14.180000000000001
3273
+ - type: recall_at_1
3274
+ value: 56.2
3275
+ - type: recall_at_10
3276
+ value: 75.0
3277
+ - type: recall_at_100
3278
+ value: 89.9
3279
+ - type: recall_at_1000
3280
+ value: 97.89999999999999
3281
+ - type: recall_at_3
3282
+ value: 67.4
3283
+ - type: recall_at_5
3284
+ value: 70.89999999999999
3285
+ - task:
3286
+ type: Classification
3287
+ dataset:
3288
+ type: C-MTEB/MultilingualSentiment-classification
3289
+ name: MTEB MultilingualSentiment
3290
+ config: default
3291
+ split: validation
3292
+ revision: 46958b007a63fdbf239b7672c25d0bea67b5ea1a
3293
+ metrics:
3294
+ - type: accuracy
3295
+ value: 76.87666666666667
3296
+ - type: f1
3297
+ value: 76.7317686219665
3298
+ - task:
3299
+ type: PairClassification
3300
+ dataset:
3301
+ type: C-MTEB/OCNLI
3302
+ name: MTEB Ocnli
3303
+ config: default
3304
+ split: validation
3305
+ revision: 66e76a618a34d6d565d5538088562851e6daa7ec
3306
+ metrics:
3307
+ - type: cos_sim_accuracy
3308
+ value: 79.64266377910124
3309
+ - type: cos_sim_ap
3310
+ value: 84.78274442344829
3311
+ - type: cos_sim_f1
3312
+ value: 81.16947472745292
3313
+ - type: cos_sim_precision
3314
+ value: 76.47058823529412
3315
+ - type: cos_sim_recall
3316
+ value: 86.48363252375924
3317
+ - type: dot_accuracy
3318
+ value: 79.64266377910124
3319
+ - type: dot_ap
3320
+ value: 84.7851404063692
3321
+ - type: dot_f1
3322
+ value: 81.16947472745292
3323
+ - type: dot_precision
3324
+ value: 76.47058823529412
3325
+ - type: dot_recall
3326
+ value: 86.48363252375924
3327
+ - type: euclidean_accuracy
3328
+ value: 79.64266377910124
3329
+ - type: euclidean_ap
3330
+ value: 84.78068373762378
3331
+ - type: euclidean_f1
3332
+ value: 81.14794656110837
3333
+ - type: euclidean_precision
3334
+ value: 76.35009310986965
3335
+ - type: euclidean_recall
3336
+ value: 86.58922914466737
3337
+ - type: manhattan_accuracy
3338
+ value: 79.48023822414727
3339
+ - type: manhattan_ap
3340
+ value: 84.72928897427576
3341
+ - type: manhattan_f1
3342
+ value: 81.32084770823064
3343
+ - type: manhattan_precision
3344
+ value: 76.24768946395564
3345
+ - type: manhattan_recall
3346
+ value: 87.11721224920802
3347
+ - type: max_accuracy
3348
+ value: 79.64266377910124
3349
+ - type: max_ap
3350
+ value: 84.7851404063692
3351
+ - type: max_f1
3352
+ value: 81.32084770823064
3353
+ - task:
3354
+ type: Classification
3355
+ dataset:
3356
+ type: C-MTEB/OnlineShopping-classification
3357
+ name: MTEB OnlineShopping
3358
+ config: default
3359
+ split: test
3360
+ revision: e610f2ebd179a8fda30ae534c3878750a96db120
3361
+ metrics:
3362
+ - type: accuracy
3363
+ value: 94.3
3364
+ - type: ap
3365
+ value: 92.8664032274438
3366
+ - type: f1
3367
+ value: 94.29311102997727
3368
+ - task:
3369
+ type: STS
3370
+ dataset:
3371
+ type: C-MTEB/PAWSX
3372
+ name: MTEB PAWSX
3373
+ config: default
3374
+ split: test
3375
+ revision: 9c6a90e430ac22b5779fb019a23e820b11a8b5e1
3376
+ metrics:
3377
+ - type: cos_sim_pearson
3378
+ value: 48.51392279882909
3379
+ - type: cos_sim_spearman
3380
+ value: 54.06338895994974
3381
+ - type: euclidean_pearson
3382
+ value: 52.58480559573412
3383
+ - type: euclidean_spearman
3384
+ value: 54.06417276612201
3385
+ - type: manhattan_pearson
3386
+ value: 52.69525121721343
3387
+ - type: manhattan_spearman
3388
+ value: 54.048147455389675
3389
+ - task:
3390
+ type: STS
3391
+ dataset:
3392
+ type: C-MTEB/QBQTC
3393
+ name: MTEB QBQTC
3394
+ config: default
3395
+ split: test
3396
+ revision: 790b0510dc52b1553e8c49f3d2afb48c0e5c48b7
3397
+ metrics:
3398
+ - type: cos_sim_pearson
3399
+ value: 29.728387290757325
3400
+ - type: cos_sim_spearman
3401
+ value: 31.366121633635284
3402
+ - type: euclidean_pearson
3403
+ value: 29.14588368552961
3404
+ - type: euclidean_spearman
3405
+ value: 31.36764411112844
3406
+ - type: manhattan_pearson
3407
+ value: 29.63517350523121
3408
+ - type: manhattan_spearman
3409
+ value: 31.94157020583762
3410
+ - task:
3411
+ type: STS
3412
+ dataset:
3413
+ type: mteb/sts22-crosslingual-sts
3414
+ name: MTEB STS22 (zh)
3415
+ config: zh
3416
+ split: test
3417
+ revision: eea2b4fe26a775864c896887d910b76a8098ad3f
3418
+ metrics:
3419
+ - type: cos_sim_pearson
3420
+ value: 63.64868296271406
3421
+ - type: cos_sim_spearman
3422
+ value: 66.12800618164744
3423
+ - type: euclidean_pearson
3424
+ value: 63.21405767340238
3425
+ - type: euclidean_spearman
3426
+ value: 66.12786567790748
3427
+ - type: manhattan_pearson
3428
+ value: 64.04300276525848
3429
+ - type: manhattan_spearman
3430
+ value: 66.5066857145652
3431
+ - task:
3432
+ type: STS
3433
+ dataset:
3434
+ type: C-MTEB/STSB
3435
+ name: MTEB STSB
3436
+ config: default
3437
+ split: test
3438
+ revision: 0cde68302b3541bb8b3c340dc0644b0b745b3dc0
3439
+ metrics:
3440
+ - type: cos_sim_pearson
3441
+ value: 81.2302623912794
3442
+ - type: cos_sim_spearman
3443
+ value: 81.16833673266562
3444
+ - type: euclidean_pearson
3445
+ value: 79.47647843876024
3446
+ - type: euclidean_spearman
3447
+ value: 81.16944349524972
3448
+ - type: manhattan_pearson
3449
+ value: 79.84947238492208
3450
+ - type: manhattan_spearman
3451
+ value: 81.64626599410026
3452
+ - task:
3453
+ type: Reranking
3454
+ dataset:
3455
+ type: C-MTEB/T2Reranking
3456
+ name: MTEB T2Reranking
3457
+ config: default
3458
+ split: dev
3459
+ revision: 76631901a18387f85eaa53e5450019b87ad58ef9
3460
+ metrics:
3461
+ - type: map
3462
+ value: 67.80129586475687
3463
+ - type: mrr
3464
+ value: 77.77402311635554
3465
+ - task:
3466
+ type: Retrieval
3467
+ dataset:
3468
+ type: C-MTEB/T2Retrieval
3469
+ name: MTEB T2Retrieval
3470
+ config: default
3471
+ split: dev
3472
+ revision: 8731a845f1bf500a4f111cf1070785c793d10e64
3473
+ metrics:
3474
+ - type: map_at_1
3475
+ value: 28.666999999999998
3476
+ - type: map_at_10
3477
+ value: 81.063
3478
+ - type: map_at_100
3479
+ value: 84.504
3480
+ - type: map_at_1000
3481
+ value: 84.552
3482
+ - type: map_at_3
3483
+ value: 56.897
3484
+ - type: map_at_5
3485
+ value: 70.073
3486
+ - type: mrr_at_1
3487
+ value: 92.087
3488
+ - type: mrr_at_10
3489
+ value: 94.132
3490
+ - type: mrr_at_100
3491
+ value: 94.19800000000001
3492
+ - type: mrr_at_1000
3493
+ value: 94.19999999999999
3494
+ - type: mrr_at_3
3495
+ value: 93.78999999999999
3496
+ - type: mrr_at_5
3497
+ value: 94.002
3498
+ - type: ndcg_at_1
3499
+ value: 92.087
3500
+ - type: ndcg_at_10
3501
+ value: 87.734
3502
+ - type: ndcg_at_100
3503
+ value: 90.736
3504
+ - type: ndcg_at_1000
3505
+ value: 91.184
3506
+ - type: ndcg_at_3
3507
+ value: 88.78
3508
+ - type: ndcg_at_5
3509
+ value: 87.676
3510
+ - type: precision_at_1
3511
+ value: 92.087
3512
+ - type: precision_at_10
3513
+ value: 43.46
3514
+ - type: precision_at_100
3515
+ value: 5.07
3516
+ - type: precision_at_1000
3517
+ value: 0.518
3518
+ - type: precision_at_3
3519
+ value: 77.49000000000001
3520
+ - type: precision_at_5
3521
+ value: 65.194
3522
+ - type: recall_at_1
3523
+ value: 28.666999999999998
3524
+ - type: recall_at_10
3525
+ value: 86.632
3526
+ - type: recall_at_100
3527
+ value: 96.646
3528
+ - type: recall_at_1000
3529
+ value: 98.917
3530
+ - type: recall_at_3
3531
+ value: 58.333999999999996
3532
+ - type: recall_at_5
3533
+ value: 72.974
3534
+ - task:
3535
+ type: Classification
3536
+ dataset:
3537
+ type: C-MTEB/TNews-classification
3538
+ name: MTEB TNews
3539
+ config: default
3540
+ split: validation
3541
+ revision: 317f262bf1e6126357bbe89e875451e4b0938fe4
3542
+ metrics:
3543
+ - type: accuracy
3544
+ value: 52.971999999999994
3545
+ - type: f1
3546
+ value: 50.2898280984929
3547
+ - task:
3548
+ type: Clustering
3549
+ dataset:
3550
+ type: C-MTEB/ThuNewsClusteringP2P
3551
+ name: MTEB ThuNewsClusteringP2P
3552
+ config: default
3553
+ split: test
3554
+ revision: 5798586b105c0434e4f0fe5e767abe619442cf93
3555
+ metrics:
3556
+ - type: v_measure
3557
+ value: 86.0797948663824
3558
+ - task:
3559
+ type: Clustering
3560
+ dataset:
3561
+ type: C-MTEB/ThuNewsClusteringS2S
3562
+ name: MTEB ThuNewsClusteringS2S
3563
+ config: default
3564
+ split: test
3565
+ revision: 8a8b2caeda43f39e13c4bc5bea0f8a667896e10d
3566
+ metrics:
3567
+ - type: v_measure
3568
+ value: 85.10759092255017
3569
+ - task:
3570
+ type: Retrieval
3571
+ dataset:
3572
+ type: C-MTEB/VideoRetrieval
3573
+ name: MTEB VideoRetrieval
3574
+ config: default
3575
+ split: dev
3576
+ revision: 58c2597a5943a2ba48f4668c3b90d796283c5639
3577
+ metrics:
3578
+ - type: map_at_1
3579
+ value: 65.60000000000001
3580
+ - type: map_at_10
3581
+ value: 74.773
3582
+ - type: map_at_100
3583
+ value: 75.128
3584
+ - type: map_at_1000
3585
+ value: 75.136
3586
+ - type: map_at_3
3587
+ value: 73.05
3588
+ - type: map_at_5
3589
+ value: 74.13499999999999
3590
+ - type: mrr_at_1
3591
+ value: 65.60000000000001
3592
+ - type: mrr_at_10
3593
+ value: 74.773
3594
+ - type: mrr_at_100
3595
+ value: 75.128
3596
+ - type: mrr_at_1000
3597
+ value: 75.136
3598
+ - type: mrr_at_3
3599
+ value: 73.05
3600
+ - type: mrr_at_5
3601
+ value: 74.13499999999999
3602
+ - type: ndcg_at_1
3603
+ value: 65.60000000000001
3604
+ - type: ndcg_at_10
3605
+ value: 78.84299999999999
3606
+ - type: ndcg_at_100
3607
+ value: 80.40899999999999
3608
+ - type: ndcg_at_1000
3609
+ value: 80.57
3610
+ - type: ndcg_at_3
3611
+ value: 75.40599999999999
3612
+ - type: ndcg_at_5
3613
+ value: 77.351
3614
+ - type: precision_at_1
3615
+ value: 65.60000000000001
3616
+ - type: precision_at_10
3617
+ value: 9.139999999999999
3618
+ - type: precision_at_100
3619
+ value: 0.984
3620
+ - type: precision_at_1000
3621
+ value: 0.1
3622
+ - type: precision_at_3
3623
+ value: 27.400000000000002
3624
+ - type: precision_at_5
3625
+ value: 17.380000000000003
3626
+ - type: recall_at_1
3627
+ value: 65.60000000000001
3628
+ - type: recall_at_10
3629
+ value: 91.4
3630
+ - type: recall_at_100
3631
+ value: 98.4
3632
+ - type: recall_at_1000
3633
+ value: 99.6
3634
+ - type: recall_at_3
3635
+ value: 82.19999999999999
3636
+ - type: recall_at_5
3637
+ value: 86.9
3638
+ - task:
3639
+ type: Classification
3640
+ dataset:
3641
+ type: C-MTEB/waimai-classification
3642
+ name: MTEB Waimai
3643
+ config: default
3644
+ split: test
3645
+ revision: 339287def212450dcaa9df8c22bf93e9980c7023
3646
+ metrics:
3647
+ - type: accuracy
3648
+ value: 89.47
3649
+ - type: ap
3650
+ value: 75.59561751845389
3651
+ - type: f1
3652
+ value: 87.95207751382563
3653
  ---
3654
 
3655
  ## gte-Qwen2-7B-instruct