Ug ZddlZddlZddlmZddlmZmZmZddlZ ddl Z ddl m Z ddl mZddlmZddlmZmZddlmZdd lmZdd lmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.dd l/m0Z0m1Z1dd l2m3Z3dd l4m5Z5m6Z6ddl7m8Z8ddl9m:Z:ddl;mZ>m?Z?m@Z@mAZAddlBmCZCddlDmEZEmFZFddlGmHZHddZIdZJdZKe jLMdddde jNgdZOe jLMddgdfddgdfgddfgdZPd ZQd!ZReAd"ZSeAd#ZTeAd$ZUd%ZVe jLMd&gd'e jWgd(gd)gd*gd+gfgd,gd-fgd.ZXe jLMd&gd/e jWgd+gd+gd0gd0gd1gfgd2gd3fgd4ZYd5ZZd6Z[d7Z\d8Z]e jLMd9eEe jLMd:eFd;Z^d<Z_e jLMd=gd>d?Z`d@ZadAZbe jLMdBe jWgdCe jWgdCdDdEfe jWgdFe jWgdFdDdGfe jWgdFe jWgdCdDdHfe jWgdFe jWgdIdDdJfe jWgdCe jWgdFdDdKfgdLZce jLMdMe jWgdNe jWgdOdDdPfgdQZddRZedSZfdTZge jLMddde jNge jLMdUdgdgfggfge jLMdVe"ee#dWe,e-gdXZhe jLMdUdgdgfggfge jLMdVe"ee#dWe,e-gdYZidZZjd[Zkd\Zld]Zme jLMd^d_d`gdaZndbZoe jLMdcgdddeZpdfZqdgZrdhZse jLMdigdjfdkdlgdmfgdndogpdqZte jLMdrdddggdfgdspdtZuduZve jLMdvgdwdxZwdyZxdzZyd{Zzd|Z{d}Z|d~Z}dZ~dZdZeAdZdZdZdZdZdZdZdZe jLMdddgdZeAdZeAdZeAe jLMdddde jNe jNfgdZe jLMddge jLMdcgde jLMddde jNgdZe jLMdcgddZe jLMddde jNgdZdZdZe jLMddde jNgdZe jLMdddde jNgdZe jLMdddde jNgdZe jLMdddde jNgdZdZdZdZdZdZdZdZdZdZdZdZe jLMdve je je jgdZe jLMdve je je jgdZe jLMdUgdgdfgdddgddgddggfgdgdgdgdgfgdZdZdZdZe jLMdgdgdfgdgdfgdgdfgdZe jLMdVe&e"ee#dWe+e,e-ege jLMdgddZe jLMde jWddge jWddgdfe jWddge jWddgdfe jWddge jWddgdfe jWddge jWddgdfgdZe jLMde(e"e jNe(e#de jNæe(e,e jNe(e-e jNgdĄZdńZdƄZdDŽZdS)N)partial)chain permutationsproduct)linalg)hamming) bernoulli)datasetssvm)make_multilabel_classification)UndefinedMetricWarning)accuracy_scoreaverage_precision_scorebalanced_accuracy_scorebrier_score_lossclass_likelihood_ratiosclassification_reportcohen_kappa_scoreconfusion_matrixf1_score fbeta_score hamming_loss hinge_loss jaccard_scorelog_loss make_scorermatthews_corrcoefmultilabel_confusion_matrixprecision_recall_fscore_supportprecision_score recall_score zero_one_loss)_check_targetsd2_log_loss_score)cross_val_score)LabelBinarizerlabel_binarize)DecisionTreeClassifier) MockDataFrame)assert_allcloseassert_almost_equalassert_array_almost_equalassert_array_equalassert_no_warningsignore_warnings) _nanaverage)CSC_CONTAINERSCSR_CONTAINERS)check_random_stateFc|tj}|j}|j}|r||dk||dk}}|j\}}t j|}td}||||||}}t|dz }t j d}t j || |d|zf}tjddd} | |d||d|||d} |r | ddd f} | ||d} ||d} | | | fS) zMake some classification predictions on a toy dataset using a SVC If binary is True restrict to a binary classification problem instead of a multiclass classification problem N%rlinearT)kernel probability random_state)r load_irisdatatargetshapenparanger3shuffleintrandom RandomStatec_randnr SVCfit predict_probapredict) datasetbinaryXy n_samples n_featuresprnghalfclf y_pred_probay_predy_trues h/var/www/surfInsights/venv3-11/lib/python3.11/site-packages/sklearn/metrics/tests/test_classification.pymake_predictionr[;sz$&& AA "Qx1q51GIz )A R CKKNNN Q41qA y1}  D )   " "C a9cJ&67778A 't! D D DC771UdU8QuuX..<>BBzlabels, show_micro_avgTrr<r5ctddgddg}}t|||d}|rd|vsJd|vsJdSd|vsJd|vsJdS)a3Check the behaviour of passing `labels` as a superset or subset of the labels. WHen a superset, we expect to show the "accuracy" in the report while it should be the micro-averaging if this is a subset. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/27927 rr<T)rqrsz micro avgroNr)rqshow_micro_avgrYrXr{s rZ1test_classification_report_labels_subset_supersetrsVaVFF "66&d S S SF)f$$$$''''''V####&((((((r\cFtjgdgdg}tjgdgdg}t||dksJt||dksJt||dksJt|tj|dksJt|tj|dksJt|tj|jdksJt|tj|jdksJdS)Nrr<r<r<rr<rrr<?r<r)rAarrayr logical_notzerosr@y1y2s rZ.test_multilabel_accuracy_score_subset_accuracyrs) 999iii( ) )B 999iii( ) )B "b ! !S ( ( ( ( "b ! !Q & & & & "b ! !Q & & & & "bnR00 1 1Q 6 6 6 6 "bnR00 1 1Q 6 6 6 6 "bhrx00 1 1Q 6 6 6 6 "bhrx00 1 1Q 6 6 6 6 6 6r\cLtd\}}}t||d\}}}}t|ddgdt|ddgdt|d d gdt|d d gitfd d itffD]\}}|t ||fi|} t| dd|t ||fi|} t| dd|t||fi|} t| d dt|t||fddi|d| z| zd| z| zz ddS)NTrNaverageg\(\?g333333?r5g)\(?g(\?皙?gRQ?rrNbeta) r[rr,r-r.r r!rr+r) rYrXryrSrfskwargs my_assertpsrsfss rZ%test_precision_recall_f1_score_binaryrs't444FFA1NNNJAq!Qa$q111a$q111a$q111q2r(###  X  23   Y A A& A A!"dA... Y|VV > >v > >!"dA... Yx : :6 : :!"dA... Ik66 D D DV D D Ob D2IN 3       r\cfdtddgddgksJdtddgddgksJdtddgddgksJdtddgddgdksJdtddgddgksJdtddgddgksJdtddgddgksJdtddgddgt dksJtddgddgt dt jtddgddgdksJdS) N?r<rrrinfgj@)r r!rrrwpytestapproxr\rZ+test_precision_recall_f_binary_single_classr!s /1a&1a&11 1 1 1 1 ,1v1v.. . . . . (Aq6Aq6** * * * * +q!fq!f1555 5 5 5 5 /2r(RH55 5 5 5 5 ,Bx"b22 2 2 2 2 (B8b"X.. . . . . +r2hRuU||DDD D D D D Bx"be = = =RHr2hS111BB      r\c gd}gd}t|tjd}t|tjd}||f||fg}t|D]\}\}}t ||gdd}t gd|t ||gdd}t tjgd|d D]C}|d kr|d krtt ||gd|t ||d|Dd D]}tj t5t ||tjd |dddn #1swxYwYtj t5t ||tjdd|dddn #1swxYwYtj gdgdg}tj gdgdg}t||d d dg\}} } } ttj || | gtj gddS)N)r<rr5)r<r<rr5rclasses)rr<r5rrrqr)rrrrrmacro)microweightedsamplesrr)Nrrrrrrr<rrr<r<r<rr<rrq)?r<竪?) r'rArB enumerater!r,meanr+rraises ValueErrorrr) rYrX y_true_bin y_pred_binr>iactualrrSrrrys rZ$test_precision_recall_f_extra_labelsr4s.\\F \\F ! ===J ! ===J V z:6 7D( FFff___dSSS!";";";VDDDff___gVVV!"'*C*C*C"D"DfMMM8  G)##Q VVOOOWUUUVVD'JJJ     7 ]: & & W W Z ! g V V V V W W W W W W W W W W W W W W W ]: & &   JryQ/?/?                    Xyyy))), - -F Xyyy))), - -F0 1a&JAq!Q!Q++RX6G6G6G-H-HIIIIIs$2&E$$E( +E( 'F;;F? F? c\gd}gd}t|tjd}t|tjd}||f||fg}t|D]\}\}}t t ||ddg}t t ||d}t dd g|d td |d td |d td |d dD]}|| || ksJdS)N)r<r<r5r)r<rrrrrr<rrqrrrrrUUUUUU?rr)rrr)r'rArBrrr!r,r+) rYrXrrr>r recall_13 recall_allrs rZ&test_precision_recall_f_ignored_labelsrbs{\\F \\F ! ===J ! ===J V z:6 7D( M M FFL&&!QHHH \66$GGG !3*ii.E.E.EFFFOYYw-G-G-GHHH3YYz5R5R5RSSSGYYw%?%?%?@@@6 M MG9W---G1L1L1LLLLLL M M Mr\c .tjgdgdgdgdgdgdg}tjgdgdgdgd gd gd g}d }tjt| 5t ||dddddS#1swxYwYdS)z:Test multiclass-multiouptut for `average_precision_score`.)r5r5r<r<r5rrr<r5r<)r5rr<ffffff?皙?皙?皙?333333?rrrrrrr)rrr)rrrz.multiclass-multioutput format is not supportedmatchr5 pos_labelN)rArrrrr)rYy_scoreerr_msgs rZ-test_average_precision_score_non_binary_classrys X II II II II II II    Fh OO OO OO OO OO OO    G?G z 1 1 1>>1====>>>>>>>>>>>>>>>>>>s*B  BBzy_true, y_scorerrr<r5rrrr) rrrrr<r<r<r<r<r<r<) rrrrr333333?rrfrfr<r<c2t||dksJdS)a( Duplicate values with precision-recall require a different processing than when computing the AUC of a ROC, because the precision-recall curve is a decreasing curve The following situation corresponds to a perfect test statistic, the average_precision_score should be 1. r<NrrYrs rZ-test_average_precision_score_duplicate_valuesrs%8 #67 3 3q 8 8 8 8 8 8r\)r5r5r<r<r)rrr)rrrr)rrrc2t||dksJdS)Nrrrs rZ(test_average_precision_score_tied_valuesrs%: #67 3 3s : : : : : :r\cd}tjt|5tgdgdddddddS#1swxYwYdS)NzNote that pos_label \(set to 2\) is ignored when average != 'binary' \(got 'macro'\). You may use labels=\[pos_label\] to specify a single positive class.rrr<r5r5r5rrr)rwarns UserWarningrrs rZ(test_precision_recall_f_unused_pos_labelrs   k - - -  ' IIyyyAw                      sAA Actd\}}}d}||||d|Dd|DdS)NTrcnt||}t|ddgddgg|\}}}}||z||zz }tj||z||zz||zz||zz}|dkrdn||z } t ||} t | | dt | dddS) Nrrr5decimal= ףp=?)rr-flattenrAsqrtrr,) rYrXcmtpfpfntnnumdentrue_mccmccs rZtestz*test_confusion_matrix_binary..tests ff - -2Q!R1222BB2gRgrBw27+rBw727CDDq11cCi//!#x;;;;!#tQ777777r\c,g|]}t|Srr.0rPs rZ z0test_confusion_matrix_binary.. ! ! !Q#a&& ! ! !r\c,g|]}t|Srrrs rZrz0test_confusion_matrix_binary..#;#;#;qCFF#;#;#;r\r[rYrXryrs rZtest_confusion_matrix_binaryrsr't444FFA 8 8 8 DD ! !& ! ! !#;#;F#;#;#;<<<<.testsF ( 8 82"a1b' 2b!Wq"g4FGHHHHHr\c,g|]}t|Srrrs rZrz;test_multilabel_confusion_matrix_binary..rr\c,g|]}t|Srrrs rZrz;test_multilabel_confusion_matrix_binary..rr\rrs rZ'test_multilabel_confusion_matrix_binaryr%su't444FFAIII DD ! !& ! ! !#;#;F#;#;#;<<<<.tests[ ( 8 8 2q'Ar7#r1gAw%72r(QG9LM   %0>YYY ( G G G 2q'Ar7#r2hB%8B7RG:LM   *5F%%%%,,, ( G G G a1b'"bAr7#a2q'"a1a&!       r\c,g|]}t|Srrrs rZrz?test_multilabel_confusion_matrix_multiclass..$rr\c,g|]}t|Srrrs rZrz?test_multilabel_confusion_matrix_multiclass..$rr\T)r3)Frrs rZ+test_multilabel_confusion_matrix_multiclassr6s|'u555FFA    6 DD ! !& ! ! !#;#;F#;#;#;NNNNNNr\ csc_container csr_containercJtjgdgdgdg}tjgdgdgdg}||}||}||}||}tjgd}dd gddggdd gddggd d gdd ggg} |||g} |||g} | D]'} | D]"} t| | }t|| #(t||d }t|dd gddggddgd dggd dgd d gggt||d d g }t|d d gdd ggdd gddgggt||d d gd }t|d d gddggddgd d ggd dgdd gggt|||d }t|d d gd d ggddgd dggd dgdd gggdS)Nrrr<rr<r<rrrr)r5r<rr<rr5T samplewiser)rqr=) sample_weightr=rr)rArrr-)r7r8rYrX y_true_csr y_pred_csr y_true_csc y_pred_cscr>real_cmtruespreds y_true_tmp y_pred_tmpr s rZ+test_multilabel_confusion_matrix_multilabelrH's Xyyy)))YYY7 8 8F Xyyy)))YYY7 8 8Fv&&Jv&&Jv&&Jv&&JHYYY''MAA1a&1a&!1QFQF3CDG Z ,E Z ,E,,  , ,J,ZDDB r7 + + + + , %VV E E EBraVaV,1v1v.>!Q!Q@PQRRR %VVQF C C CBraVaV,1v1v.>?@@@ %VVQFt T T TBraVaV,1v1v.>!Q!Q@PQRRR %m   BraVaV,1v1v.>!Q!Q@PQRRRRRr\c tjgdgdgdg}tjgdgdgdg}tjtd5t ||d d g dddn #1swxYwYtjtd 5t ||gd gdgdg dddn #1swxYwYd}tjt|5t ||dgdddn #1swxYwYd}tjt|5t ||dgdddn #1swxYwYtjtd5t gdgdddddn #1swxYwYd}tjt|5t gdgdggdgdgddddS#1swxYwYdS)Nrr:r;rrrinconsistent numbers of samplesrr<r5r>zshould be a 1d arrayr<r5r)r5rr)rrrz%All labels must be in \[0, n labels\)rrrzSamplewise metricsrrTr<z'multiclass-multioutput is not supported)r5r<rr<rr5)rArrrrr)rYrXrs rZ'test_multilabel_confusion_matrix_errorsrNQs Xyyy)))YYY7 8 8F Xyyy)))YYY7 8 8F z)J K K KJJ#FF1a&IIIIJJJJJJJJJJJJJJJ z)? @ @ @  # F999iii*K                   7G z 1 1 1AA#FFB4@@@@AAAAAAAAAAAAAAA6G z 1 1 1@@#FFA3????@@@@@@@@@@@@@@@ z)= > > >KK#IIIyyyTJJJJKKKKKKKKKKKKKKK8G z 1 1 1TT#YYY $:YYY A;CC  C -D  DD5EEE;FF"%F"G00G47G4z%normalize, cm_dtype, expected_results))truerTUU?)predrrP)allrgeq?)Nrr5cgddz}tttgd}t|||}t |||jj|ksJdS)Nrr normalize)listrrrr*dtypekind)rUcm_dtypeexpected_resultsy_testrXr s rZtest_confusion_matrix_normalizer\osoYY]F %iii001 2 2F &&I > > >BB())) 8=H $ $ $ $ $ $r\cHgd}gd}t||d}|tjdksJt j5t jdtt||d}dddn #1swxYwY|tjdksJt j5t jdtt||dddddS#1swxYwYdS) N)rrrrr<r<r<r<)rrrrrrrrrOrT@errorrQr)rsumrrrr simplefilterRuntimeWarning)r[rXcm_truecm_preds rZ,test_confusion_matrix_normalize_single_classres % % %F % % %Fvv@@@G ;;==FM#.. . . . .  " "EEg~666"66VDDDEEEEEEEEEEEEEEE ;;==FM#.. . . . .  " ";;g~6666::::;;;;;;;;;;;;;;;;;;s$-BBB-DDDcgd}gd}tjtd5t||ddddS#1swxYwYdS)z8Test `confusion_matrix` warns when only one label found.rrrrzA single label was found inrN)rrrr)r[rXs rZ"test_confusion_matrix_single_labelrhs \\F \\F k)F G G G))((())))))))))))))))))sAA Azparams, warn_msg)rrrrrrrYrXz2samples of only one class were seen during testing)r<r<r<rrrz:positive_likelihood_ratio ill-defined and being set to nanz+no samples predicted for the positive classrrrr<r<r<z:negative_likelihood_ratio ill-defined and being set to nanz@no samples of the positive class were present in the testing setctjt|5tdi|ddddS#1swxYwYdSNrr)rrrr)paramswarn_msgs rZtest_likelihood_ratios_warningsrosb k 2 2 2**))&)))****************** 6::zparams, err_msg)rr<rr<rr<r<rrr5zeclass_likelihood_ratios only supports binary classification problems, got targets of type: multiclassctjt|5tdi|ddddS#1swxYwYdSrl)rrrr)rmrs rZtest_likelihood_ratios_errorsrss$ z 1 1 1**))&)))******************rpcFtjdgdzdgdzz}tjdgdzdgdzzdgdzz}t||\}}t|dt|d t||\}}t |tjdzt|tjdd tjd gd zdgdzz}t|||\}}t|dt|ddS)Nr<rrrr5 rg?g_B{ %?g-q=)rtolrrrrKgUUUUUU@gqq?)rArrr*r-rr)rYrXposnegr>s rZtest_likelihood_ratiosrzs*XqcAgb( ) )F XqcAgb(A372 3 3F&vv66HCC!!!C!!!'vv66HCsBFQJ'''C!51111 HcURZ3%!)344M&vv]SSSHCC   C!!!!!r\ctjdgdzdgdzz}tjdgdzdgdzzdgdzzdgdzz}t||}t|dd |t||ksJtj|d gd z}tj|d gd z}t||ddg |ksJtt||dtjdgdzdgdzzd gdzz}tjdgdzdgdzzd gdzz}tt||dd tjdgdzdgdzzd gdzz}tjdgdzdgdzzd gdzz}tt||dd tt||ddd tt||ddd dS)Nr(r<<rhru2gʡE?rrr5rrr.,4 g??g+?r8weightsg_vO? quadraticg#?)rArrr+append)rrkappas rZtest_cohen_kapparsV 1#(aS2X% & &B 1#(aS2X%b0A38; < >f===>>>>>>>>>>>>>>> S======s 599ctjd}|ddd}|ddd}t t ||tj||dddS)Nrr5rhsizerr<ru)rArErFrandintr+rcorrcoef)rTrYrXs rZ-test_matthews_corrcoef_against_numpy_corrcoefrPs )   " "C [[AB[ ' 'F [[AB[ ' 'F&&))2;vv+F+Ft+Lbr\c tjd}|ddd}|ddd}|d}t ||| t  t fdt D}t fdt D}tj fdt D}|tj ||zz }t|||}t||d dS) Nrr5rhrrKc g|]Q}tD]?}tD]-}||f||fz||f||fzz .@RSrrange)rkmlCNs rZrz9test_matthews_corrcoef_against_jurman..fs   1XX  1XX    adGa1g !Q$!AqD' 1 1     r\c g|]PddftjfdtDzQS)NcTg|]$}tD]}|k||f%Srrrrgrrrs rZrzDtest_matthews_corrcoef_against_jurman...p8LLL!qLLAQ!VVa1gVVVVr\r`rArrrrrs @rZrz9test_matthews_corrcoef_against_jurman..nst    aaadGKKMMfLLLLLLuQxxLLLMM N   r\c g|]PddftjfdtDzQS)NcTg|]$}tD]}|k||f%Srrrs rZrzDtest_matthews_corrcoef_against_jurman...wrr\rrs @rZrz9test_matthews_corrcoef_against_jurman..ust    adGKKMMfLLLLLLuQxxLLLMM N   r\ru) rArErFrrandrrtr`rr rr+) rTrYrXr>cov_ytypcov_ytytcov_ypyp mcc_jurmanmcc_oursrrs @@rZ%test_matthews_corrcoef_against_jurmanrZs )   " "C [[AB[ ' 'F [[AB[ ' 'FHHRLLM}EEEA AA     1XX   H     1XX   Hv     1XX   HBGHx$7888J }MMMH*b11111r\c Rtjd}d|dddD}t t ||dd|D}t t ||dt |d d g }tj|d d }t t ||dt t gd gd d t t |d gt|zd gd}gd}t t ||d dgdzdgdzz}tj t5t t |||d ddddS#1swxYwYdS)Nrc"g|] }|dkrdnd S)rrrrrrs rZrz*test_matthews_corrcoef..s$ I I IQ!VVcc I I Ir\r5rhrrc"g|] }|dkrdnd S)rrrrs rZrz*test_matthews_corrcoef..s$;;;qc##s;;;r\rrrrrgr)r<rr<r<rr<r<r<rr<r<r<r<r<r<r<rr<r<r<)r<r<r<rrr<r<r<r<rr<r<r<rr<r<r<rr<r<r<rurK) rArErFrr+rr'wherertrrAssertionError)rTrY y_true_inv y_true_inv2y_1y_2masks rZtest_matthews_corrcoefrs )   " "C I Ickk!QRk.H.H I I IF)&&993???<;F;;;J)&*==rBBB #s<<>CCC),,, EEsKKK)&3%#f++2EFFLLL G F FC F F FC)#s33S999 38qcBh D ~ & &RR-c3dKKKSQQQRRRRRRRRRRRRRRRRRRs.!FF #F cB tjd}td d} fd|d|dD}t t ||dgd}gd }t t ||d gd}gd }t t ||d tjd z gd}gd}t t ||dgd}gd}t t ||dgd}gd}t t ||dgd}gd}gd}t t |||dgd}gd}gd}t t |||ddS)Nrrrc4g|]}t|zSr)chr)rrord_as rZrz5test_matthews_corrcoef_multiclass..s# I I Ic%!)nn I I Ir\rhrr)rrr<r<r5r5)r5r5rrr<r<g)r<r<rrrriir)rrrr rr<r5rr<r5rr<r5) r<r<r<r5r5r5rrr)rrr<r<r5rqr<r<r<r<rrKrrr<r<rr)rArErFordrr+rr ) rT n_classesrY y_pred_bad y_pred_minrXrrr>rs @rZ!test_matthews_corrcoef_multiclassrs )   " "C HHEI I I I Ickk!YRk&H&H I I IF)&&993???  F###J)&*==tDDD  F###J)&*==sRWWEUEU?UVVVYYF YYF)&&993???YYF YYF)&&993??? & % %C % % %C)#s33S999 __F __F#OOM&& FFF \\F \\F LLM&& FFFr\n_pointsdi'ctjdd}fd}tjddg|}t t ||dtjgd|}t t ||d||\}}t t ||dt t |||||dS)Ni3ct||}|d}|d}|d}t|}||z|z }||z|z }||z ||zz } ||zd|z zd|z z} | tj| z S)Nr<r<)r<rrr<)rrtrAr ) rYrX conf_matrixtrue_pos false_pos false_negrpos_rateactivity mcc_numeratormcc_denominators rZmcc_safez1test_matthews_corrcoef_overflow..mcc_safes&vv66 t$% % v;;y(H4y(H4 8+h.AA "X-X>!h,Orw7777r\c|}|d|dz zz}|dk}|dk}||fS)Nrr) random_sample)rx_truex_predrYrXrTs rZ random_ysz2test_matthews_corrcoef_overflow..random_yssT""8,,#!2!28!>>>>>r\rW)Int64Float64booleanctjd}tjgd}|||}|gdd}t ||}t ||}t ||dS)zkChecks that confusion_matrix works with pandas nullable dtypes. Non-regression test for gh-25635. pandas) r<rrr<rr<r<rr<r) rrr<r<rr<r<r<r<r N)r importorskiprArSeriesrr-)rWpd y_ndarrayrY y_predictedoutputexpected_outputs rZ%test_confusion_matrix_pandas_nullabler!s  X & &B44455I YYyY . .F))777w)GGK fk 2 2F&y+>>Ov/////r\c tj}t|d\}}}d}t||t jt |j|j}||ksJdS)NFr^a| precision recall f1-score support setosa 0.83 0.79 0.81 24 versicolor 0.33 0.10 0.15 31 virginica 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 rqrrr r=r[rrArBrtrrrxrYrXryrzr{s rZ%test_classification_report_multiclassr&s    D'UCCCFFA O#yT.//00& F _ $ $ $ $ $ $r\cJgdgd}}d}t||}||ksJdS)N) rrrr<r<r<r5r5r5ra| precision recall f1-score support 0 0.33 0.33 0.33 3 1 0.33 0.33 0.33 3 2 0.33 0.33 0.33 3 accuracy 0.33 9 macro avg 0.33 0.33 0.33 9 weighted avg 0.33 0.33 0.33 9 r)rYrXrzr{s rZ.test_classification_report_multiclass_balancedr(sG0002M2M2MFF O#66 2 2F _ $ $ $ $ $ $r\ctj}t|d\}}}d}t||}||ksJdS)NFr^a| precision recall f1-score support 0 0.83 0.79 0.81 24 1 0.33 0.10 0.15 31 2 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 )r r=r[rr%s rZ:test_classification_report_multiclass_with_label_detectionr*sX    D'UCCCFFA O#66 2 2F _ $ $ $ $ $ $r\c tj}t|d\}}}d}t||t jt |j|jd}||ksJdS)NFr^a| precision recall f1-score support setosa 0.82609 0.79167 0.80851 24 versicolor 0.33333 0.09677 0.15000 31 virginica 0.41860 0.90000 0.57143 20 accuracy 0.53333 75 macro avg 0.52601 0.59615 0.50998 75 weighted avg 0.51375 0.53333 0.47310 75 r)rqrrdigitsr$r%s rZ1test_classification_report_multiclass_with_digitsr-s    D'UCCCFFA O#yT.//00& F _ $ $ $ $ $ $r\ctd\}}}tjgd|}tjgd|}d}t||}||ksJd}t||gd}||ksJdS)NFr)bluegreenreda| precision recall f1-score support blue 0.83 0.79 0.81 24 green 0.33 0.10 0.15 31 red 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 a| precision recall f1-score support a 0.83 0.79 0.81 24 b 0.33 0.10 0.15 31 c 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 rrrr[rArr)rYrXryrzr{s rZ7test_classification_report_multiclass_with_string_labelr4s'u555FFA X... / / 7F X... / / 7F O#66 2 2F _ $ $ $ $ O#66 P P PF _ $ $ $ $ $ $r\ctd\}}}tjgd}||}||}d}t||}||ksJdS)NFr)ublue¢ugreen¢ured¢u precision recall f1-score support blue¢ 0.83 0.79 0.81 24 green¢ 0.33 0.10 0.15 31 red¢ 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 r3rYrXryrqrzr{s rZ8test_classification_report_multiclass_with_unicode_labelr7?sp'u555FFA X::: ; ;F F^F F^F O#66 2 2F _ $ $ $ $ $ $r\ctd\}}}tjgd}||}||}d}t||}||ksJdS)NFr)r/greengreengreengreengreenr1a precision recall f1-score support blue 0.83 0.79 0.81 24 greengreengreengreengreen 0.33 0.10 0.15 31 red 0.42 0.90 0.57 20 accuracy 0.53 75 macro avg 0.53 0.60 0.51 75 weighted avg 0.51 0.53 0.47 75 r3r6s rZzaNumber of classes, 2, does not match size of target_names, 3. Try specifying the labels parameterrr2)rrrr)rYrXrrrs rZ@test_classification_report_no_labels_target_names_unequal_lengthrAvs __F __F444L . z 1 1 1IIff<HHHHIIIIIIIIIIIIIIIIIIsA  AAcd}d}td||d\}}td||d\}}d}t||}||ksJdS)Nrr~r<r)rRrQrr;a precision recall f1-score support 0 0.50 0.67 0.57 24 1 0.51 0.74 0.61 27 2 0.29 0.08 0.12 26 3 0.52 0.56 0.54 27 micro avg 0.50 0.51 0.50 104 macro avg 0.45 0.51 0.46 104 weighted avg 0.45 0.51 0.46 104 samples avg 0.46 0.42 0.40 104 )r r)rrQryrYrXrzr{s rZ%test_multilabel_classification_reportrCsII. YQIAv/ YQIAv O#66 2 2F _ $ $ $ $ $ $r\cFtjgdgdg}tjgdgdg}t||dksJt||dksJt||dksJt|tj|dksJt|tj|dksJt|tj|jdksJt|tj|jdksJdS)Nrrrrrr<)rArr"rrr@rs rZ$test_multilabel_zero_one_loss_subsetrEs) 999iii( ) )B 999iii( ) )B R C ' ' ' ' R A % % % % R A % % % % R^B// 0 0A 5 5 5 5 R^B// 0 0A 5 5 5 5 RXbh// 0 0A 5 5 5 5 RXbh// 0 0A 5 5 5 5 5 5r\chtjgdgdg}tjgdgdg}tjddg}t||dksJt||dksJt||dksJt|d|z dksJt|d|z dksJt|tj|jdksJt|tj|jd ksJt||| d ksJt|d|z | d ksJt|tj|| dksJt|d|dt |d|dksJdS) Nrrrr<rUUUUUU?rrrrKgUUUUUU?gUUUUUU?)rArrrr@ zeros_like sp_hamming)rrws rZtest_multilabel_hamming_lossrKs 999iii( ) )B 999iii( ) )B !QA B  5 ( ( ( ( B  1 $ $ $ $ B  1 $ $ $ $ AF # #q ( ( ( ( AF # #q ( ( ( ( BHRX.. / /5 8 8 8 8 BHRX.. / /3 6 6 6 6 Ba 0 0 0H < < < < AF! 4 4 4 A A A A BM"--Q ? ? ?7 J J J J 1r!u % %BqE2a5)A)A A A A A A Ar\ctjgd}tjgd}d}tjt|5t ||dddddn #1swxYwYtjgdgdg}tjgd gd g}d }tjt|5t ||dd dddn #1swxYwYtjgd }tjgd}d}tjt|5t ||ddddn #1swxYwYd}tjt|5t ||ddddn #1swxYwYd}tjt|5t ||ddddddS#1swxYwYdS)N)rr<rr<r<z>pos_label=2 is not a valid label. It should be one of \[0, 1\]rrNr5rrrrrrTarget is multilabel-indicator but average='binary'. Please choose another average setting, one of \[None, 'micro', 'macro', 'weighted', 'samples'\].r)rr<r<rr5rTarget is multiclass but average='binary'. Please choose another average setting, one of \[None, 'micro', 'macro', 'weighted'\].rzJSamplewise metrics are not available outside of multilabel classification.rzNote that pos_label \(set to 3\) is ignored when average != 'binary' \(got 'micro'\). You may use labels=\[pos_label\] to specify a single positive class.rr)rArrrrrrr)rYrXrmsg1msg2msg3rs rZtest_jaccard_score_validationrSs~ Xooo & &F Xooo & &FOG z 1 1 1EEffh!DDDDEEEEEEEEEEEEEEEXyyy))), - -F Xyyy))), - -F 6 z . . .FFffh"EEEEFFFFFFFFFFFFFFFXooo & &F Xooo & &F  z . . .88ffh7777888888888888888 WD z . . .99ffi8888999999999999999  k - - -DDffgCCCCDDDDDDDDDDDDDDDDDDsZ A**A.1A.C&&C*-C*:EE EF  F$'F$G))G-0G-c tjgdgdg}tjgdgdg}t||ddksJt||ddksJt||ddksJt|tj|ddksJt|tj|ddksJt|tj|jddksJt|tj|jddksJtjgdgd g}tjgd gdg}t t||d d t t||d dt t||ddt t||dddgdt t||dddgdtt||dtjgdtjgdgdg}tjgd gdg}t t||d dt t||ddd}tj t|5t||dgd dddn #1swxYwYd}tj t|5t||dgd dddn #1swxYwYd}tj t|5ttjddggtjddggd dksJ dddn #1swxYwYd}tj t|5ttjddgddggtjddgddggddksJ dddn #1swxYwYt|rJdS)Nrrrrrrr<rrrrrrrg?r5rr)rrrrrg?z Got 4 > 2rrrz Got -1 < 0rzXJaccard is ill-defined and being set to 0.0 in labels with no true or predicted samples.zXJaccard is ill-defined and being set to 0.0 in samples with no true or predicted labels.)rArrrrr@r+r-rrrrr rV)recwarnrrrYrXrQrRrs rZtest_multilabel_jaccard_scorerVs 999iii( ) )B 999iii( ) )B R 3 3 3t ; ; ; ; R 3 3 3q 8 8 8 8 R 3 3 3q 8 8 8 8 R^B// C C Cq H H H H R^B// C C Cq H H H H RXbh// C C Cq H H H H RXbh// C C Cq H H H H Xyyy))), - -F Xyyy))), - -F ffgFFFPPP ffgFFFPPP ffiHHH(SSSffiAGGGffiAGGGffd333RX>U>U>U5V5VXyyy))), - -F Xyyy))), - -F ffgFFFPPP ffjIII7SSS D z . . .CCffaS'BBBBCCCCCCCCCCCCCCC D z . . .DDffbT7CCCCDDDDDDDDDDDDDDD - ,C 8 8 8  "(QF8,,bhAx.@.@' R R R                     , ,C 8 8 8  1a&1a&)**1a&1a&)**!                         G}}sJK//K36K3L88L<?L< AN00N47N4A P..P25P2c gd}gd}gd}t}||||}||}tt||}tt||}ddgddgddgdgdgdgdg} ddgdd gd dgdgdgd gdg} d D]>} t | | D]+\} } t || | || | ,?tjddgddgddgg}tjddgddgddgg}t5t ||d dksJ dddn #1swxYwYt|rJdS)N)antrXcatrYrXrYbirdrZ)rYrXrYrYrXrZrZrY)rXrZrYrXrZrYrr<r5)rrrNrrr) r&rJ transformrrzipr+rArr/rV)rUrYrXrqlbrrmulti_jaccard_scorebin_jaccard_scoremulti_labels_listbin_labels_listrm_labelb_labels rZtest_multiclass_jaccard_scorerd:sA G G GF G G GF # # #F   BFF6NNNf%%Jf%%J!-@@ z:FF       1v1v1vsQC!dCO8 #$5 G G   GW ##GGDDD!!''BBB      X1v1v1v. / /F X1v1v1v. / /F   FFVVZ@@@AEEEEEFFFFFFFFFFFFFFFG}}s3EE EctdgdgddksJd}tjt|5tddgddgddksJ dddn #1swxYwYtdgdgddd ksJt jgd }t jgd }t t||dd t t||dd dt|rJdS)Nr<rrNrrzOJaccard is ill-defined and being set to 0.0 due to no true or predicted samplesrrr)r<rr<r<r)r<rr<r<r<rrMr)rrrr rArr+rV)rUrrYrXs rZ!test_average_binary_jaccard_scorerf_s !qc8 4 4 4 ; ; ; ; ' ,C 8 8 8FFaVaVX>>>#EEEEEFFFFFFFFFFFFFFF !qcQ A A AS H H H H Xooo & &F Xooo & &F ffhGGGQQQffh!DDDgG}}sA""A&)A&c6tjgdgdg}tjgdgdg}d}tjt|5t ||dd}|tjdksJ ddddS#1swxYwYdS) NrrrrzJaccard is ill-defined and being set to 0.0 in samples with no true or predicted labels. Use `zero_division` parameter to control this behavior.rrrrrr)rArrrr rr)rYrXrscores rZ(test_jaccard_score_zero_division_warningrkvsXyyy))), - -F Xyyy))), - -F C ,C 8 8 8++ffivVVV c*******++++++++++++++++++s.BBBzzero_division, expected_scorer)r<rcRtjgdgdg}tjgdgdg}tj5tjdt t ||d|}dddn #1swxYwY|tj|ksJdS)Nrrhr_rri) rArrrrar rrr)rexpected_scorerYrXrjs rZ*test_jaccard_score_zero_division_set_valuernsXyyy))), - -F Xyyy))), - -F  " "  g'=>>> FI]                  FM.11 1 1 1 1 1 1s.BB BcZtjgdgdgdg}tjgdgdgdg}t||d\}}}}t|gddt|gddt|gd dt|gd dt ||dd }|}t|gd dt||d \}}}}t |dt |dt |d|Jt t ||dd tj|t||d\}}}}t |dt |dt |d|Jt t ||dd d|z|zd|z|zz t||d\}}}}t |dt |dt |d|Jt t ||dd tj||t||d\}}}}t |dt |dt |d|Jt t ||dd ddS)Nr<rrrrr<rrr)r<rr<rr)rrrrr5)rrrr)rrr<r)r<r<r<r<rr)rrr<rrg?rg?rrrrrrrArrr,rr+rrrYrXrSrrrf2rcs rZ+test_precision_recall_f1_score_multilabel_1rvs$ X|||\\\<<<@ A AF X|||\\\<<<@ A AF0NNNJAq!Qa!5!5!5q999a!5!5!5q999a!7!7!7;;;aq111 VV!T : : :BGb///15551QQQJAq!Q7###3+,,, 999FFG<<>>r\z%zero_division, zero_division_expected)rrrc  tjgdgdgdg}tjgdgdgdg}t||d|\}}}}t||dddgd t|dd d|gd d }t||d d |gd t|gdd t ||d d|} |} t| |dd |gd t||d|\}}}}tj|rd n|} dtj| z} t |d | z| z t |d| z| z d}t |||Jt t ||d d|t| dt||d|\}}}}t |d t |d t |d|Jt t ||d d|d|z|zd|z|zz t||d|\}}}}t ||d krdndt |d d} t |d| z |Jt t ||d d|t| | t||d\}}}}t |dt |dt |d|Jd } t t ||d d|| d dS)!Nrqrprrgrxrirrr5rrrr<ryrrrrzrr?g?rrrgrrrrg@rrrdgZd;O?)rArrr,rrr+r0)rzero_division_expectedrYrXrSrrr expected_frurc value_to_sumvalues_to_averageexpected_results rZ7test_precision_recall_f1_score_with_an_empty_predictionrsX|||\\\<<<@ A AF X|||\\\<<<@ A AF 1MJAq!Qa"8#sC!H!LLLa#sC1G!H!LLLJa*gq*!EqIIIaq111 VV!T W W WBGb:tQ "CQGGG0}JAq!Q!788T11>TL*@!A!AABA ,0AABBBC,.2CCDDD J:&&& 999  '     B%%%   1}JAq!Q5!!!30111 999 FG=    ! a1q519% 1 -JAq!Q$:a$?$?55SIII3M->>??? 999 FJm    B((( 1SSSJAq!Q5!!!5!!!5!!! 999O FI]     r\r)rrrrctjd}tj|}tt|||||\}}}}tt |||||} |Jtj|r!|||| fD]} tj| sJdSt|}t||t||t||t| t|dS)Nrhrrrrr~) rArrHr.rrrrwr+) rrrrYrXrSrrrfbetar}s rZ"test_precision_recall_f1_no_labelsrys(Xg  F ]6 " "F#' # JAq!Q  #    E 999 x !Q& $ $F8F## # # # #-((M=)))=)))=)))u]3344444r\ctjd}tj|}t}t jt 5||||d\}}}}dddn #1swxYwYt|dt|dt|d|Jt jt 5t|||d}dddn #1swxYwYt|ddS)Nrrrr) rArrHrrrr r+r) rrYrXfuncrSrrrrs rZ1test_precision_recall_f1_no_labels_check_warningsrs Xg  F ]6 " "F *D , - -EET&&'DDD 1aEEEEEEEEEEEEEEE111 999 , - -GGFFG#FFFGGGGGGGGGGGGGGGq!!!!!s$ A**A.1A.C""C&)C&ctjd}tj|}tt||dd|\}}}}tt ||dd|}tj|}t||||gdt||||gdt||||gdt|gddt||||gddS)Nrrrr~r5rh)rArrHr.rrrr,)rrYrXrSrrrrs rZ/test_precision_recall_f1_no_labels_average_noners Xg  F ]6 " "F$' # JAq!Q VV#t=   EJ}--Ma- !NPQRRRa- !NPQRRRa- !NPQRRRaA...em]M%RTUVVVVVr\c.tjd}tj|}tjt 5t ||dd\}}}}dddn #1swxYwYt|gddt|gddt|gddt|gddtjt 5t||dd}dddn #1swxYwYt|gdddS)Nrr<rrhr5rr) rArrHrrr rr,r)rYrXrSrrrrs rZ4test_precision_recall_f1_no_labels_average_none_warnrs Xg  F ]6 " "F , - -  4 FDq   1a               aA...aA...aA...aA... , - -BBFFDAAABBBBBBBBBBBBBBBeYYY22222s$A''A+.A+C77C;>C;c rtt}}dD]}d}tj||5|gdgd|dddn #1swxYwYd}tj||5|gdgd|dddn #1swxYwYd}tj||5|t jd d gd d ggt jd d gd d ggd dddn #1swxYwYd }tj||5|t jd d gd d ggt jd d gd d ggd dddn #1swxYwYd }tj||5|t jd d gd d ggt jd d gd d ggddddn #1swxYwYd}tj||5|t jd d gd d ggt jd d gd d ggddddn #1swxYwYd }tj||5|d d gddgddddn #1swxYwYd}tj||5|ddgd d gddddn #1swxYwYt jd5}t jdtd d gd d gdd}t| j |ksJd}t| j |ksJd }t| j |ksJ ddddS#1swxYwYdS)NNrrzPrecision is ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.rrr<r<r5rzRecall is ill-defined and being set to 0.0 in labels with no true samples. Use `zero_division` parameter to control this behavior.zPrecision is ill-defined and being set to 0.0 in samples with no predicted labels. Use `zero_division` parameter to control this behavior.r<rrzRecall is ill-defined and being set to 0.0 in samples with no true labels. Use `zero_division` parameter to control this behavior.Precision is ill-defined and being set to 0.0 due to no predicted samples. Use `zero_division` parameter to control this behavior.rzRecall is ill-defined and being set to 0.0 due to no true samples. Use `zero_division` parameter to control this behavior.rrNTralwaysF-score is ill-defined and being set to 0.0 due to no true nor predicted samples. Use `zero_division` parameter to control this behavior.) rr rrrArrrrarpopr)rrJrrrs rZtest_prf_warningsrs *,BqA.55  \!3 ' ' ' 5 5 AiiiG 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5  \!3 ' ' ' 5 5 AiiiG 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5   as # # #UU "(QFQF# $ $bhAA/?&@&@)TTTTUUUUUUUUUUUUUUU  as # # #UU "(QFQF# $ $bhAA/?&@&@)TTTTUUUUUUUUUUUUUUU   as # # #SS "(QFQF# $ $bhAA/?&@&@'RRRRSSSSSSSSSSSSSSS  as # # #SS "(QFQF# $ $bhAA/?&@&@'RRRRSSSSSSSSSSSSSSS   as # # #.. 1a&2r(H----...............  as # # #.. 2r(QFH----...............   - - -0h''''AAIIII  6::<<'((C////  6::<<'((C////  6::<<'((C/////-000000000000000000sA  A A -B  B B 0?C;;C?C??E))E-0E- ?GGG:?II  I (JJ J *K  K K )B5N,,N03N0c t}dD]2}t|gdgd||t|gdgd||3t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|tjddgddggtjddgddggd|t|ddgd d gd |t|d d gddgd |t jd 5}t jd tddgddgd |t|dksJ ddddS#1swxYwYdS)Nrrrrir<rrrrrNTrr)rr.rArrrrart)rrrrs rZ)test_prf_no_warnings_if_zero_division_setrYs (A.   yyy)))WM      yyy)))WM       1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#   1a&1a&!"" 1a&1a&!""#  Aq6B8X] B8aVX]   - - - h'''' FQFHM    6{{a                   sAG!!G%(G%c tttjddgddggtjddgddggd|t jd5}t jdttjddgddggtjddgddggd||dkr-t|j d ksJnt|dksJtddgddg|dkr,t|j d ksJddddS#1swxYwYdS) Nr<rrriTrrrr) r.r!rArrrrarrrrtrrs rZtest_recall_warningsrs 1a&1a&!"" 1a&1a&!""#    - - -h''' Hq!fq!f% & & Hq!fq!f% & &'     F " "FJJLL())."""""" v;;!####aVaV$$$ F " "FJJLL())."""""+sC&EEEc tjd5}tjdtt jddgddggt jddgddggd||dkr-t |jd ksJnt|dksJtddgddg|dkr,t |jd ksJdddn #1swxYwYttt jddgddggt jddgddggd|dS) NTrrr<rrrirr) rrrar rArrrrrtr.rs rZtest_precision_warningsrs   - - -h''' Hq!fq!f% & & Hq!fq!f% & &'     F " "FJJLL())."""""" v;;!####AA''' F " "FJJLL())."""""+6 1a&1a&!"" 1a&1a&!""# sC&DD D c 0tjd5}tjdtt t dfD]3}|t jddgddggt jddgddggd| t|dksJ|t jddgddggt jddgddggd| t|dksJ|t jddgddggt jddgddggd| |d kr.t| j d ksJt|dksJ5 ddddS#1swxYwYdS) NTrrr5rr<rrrirr) rrrarrrrArrtrrr)rrrjs rZtest_fscore_warningsrs6   - - -"(h''' ! < < <= ( (E E1a&1a&)**1a&1a&)**+      v;;!#### E1a&1a&)**1a&1a&)**+      v;;!#### E1a&1a&)**1a&1a&)**+      && ,--2------ 6{{a'''''? ("("("("("("("("("("("("("("("("("("(sE'F  FFcgd}gd}d}tjgdgdgdg}tjgdgdgdg}d}|||f|||ffD]q\}}}tttt t d fD]A} tjt| 5| ||dddn #1swxYwYBrdS) N)r<r5rr)r<r5rr<rOrrrr:rNr5rr) rArr r!rrrrrr) y_true_mc y_pred_mcmsg_mc y_true_ind y_pred_indmsg_indrYrXrr}s rZ'test_prf_average_binary_data_non_binaryr sV I I 1 999iii;<(> %K(****%%l33 :|u,,,,|u,,,,,"5"*R..999"5"*R..999z** , ,r#2#w+++ , , , , , , , , , , , , , , , ) B B 3 z - - -r2sl. E99FF/G  G G H++H/ 2H/ .J  J J M&&M* -M* N66N:=N:cNddg}ddg}t||ddksJdS)Nrr<rr)r#ris rZAtest__check_targets_multiclass_with_both_y_true_and_y_pred_binaryr s:VFWF && ) )! , < < < < < >>>???????????????Hq!fq!fq!fq!fq!fq!fqRSfUVVM YYF  z=)A)A B B BNN& fMMMMNNNNNNNNNNNNNNNNNNs$A::A>A>!DDDc tjgdgdgdgdgdg}tjgd}tjgd}tjd|ddz |ddzd|ddz |ddzd|ddz |dd zd|d dz |d dzd|d dz |d d zg}tj|dd| tj|}t ||| |ksJdS) Nr皙rrrr)rr<r5r<r5)rr<r5rr<rr5rrrrrrrYrqrrs rZ.test_hinge_loss_multiclass_with_missing_labelsr szH ( ( ( ( ( ( ( ( ( ( ( ( ( ( (  MXooo & &F Xlll # #F8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9  LGL!T|4444w|,, fmF ; ; ;?O O O O O O Or\c tjgdgdgdgdgdg}tjgd}tjgd}tjd|ddz |ddzd|dd z |ddzd|d d z |d dzd|d dz |d d zd|d d z |d dzg}tj|dd| tj|}t t ||| |dS)N)rrr)g333333ÿrr)rrr)rg(\gzGڿ)rr5r5rr5rr<rr5rrrr)rArrrr+rrs rZ@test_hinge_loss_multiclass_missing_labels_only_two_unq_in_y_truer s H ! ! ! ! ! ! ! ! ! ! ! ! ! ! !  MXooo & &F Xiii F8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9  LGL!T|4444w|,,6=888:Jr\c Vgd}gdgdgdgdgdgdg}tjd|ddz |ddzd|ddz |ddzd|ddz |dd zd|d dz |d dzd|d d z |d dzd|d dz |d d zg}tj|dd| tj|}t |||ksJdS) N)r/r0r1r0whiter1rrrrr<rr5rrrrr)rYrrrs rZ+test_hinge_loss_multiclass_invariance_listsr sw? > >F$$$$$$$$$$$$$$$$$$ M8 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9 a # #mA&6q&9 9    LGL!T|4444w|,, fm , ,0@ @ @ @ @ @ @r\c gd}tjddgddgddgddgddgd d gg}t||}tjt jtj|d k|ddd f }t ||gd }gdgdgdg}t||d}t |d|dz}|dz}t||d}t |dgd }ddgddgddgg}tjt5t||dddn #1swxYwYgd}ddgddgddgddgg}t||}t |dddg}ddgddgg}tjddgddgg}d}tjt| 5t||dddn #1swxYwYddgddgddgg}d!}tjt| 5t||dddn #1swxYwYtjtj |ddd f }t||d dg"}t ||gd#}gd$gdgd%g}t||gd&"}t |tj d dS)'Nnorryesrrrrrf{Gz?Gz?rr{gMbP?g+?rr<rMrrr)rrr)rrrTrTg躕ʀ?r5Fg.L`@rrrrhamspamrrCT?rrzly_true contains only one label \(2\). Please provide the true labels explicitly through the labels argument.rzDFound input variables with inconsistent numbers of samples: \[3, 2\]rr)rrrrrrrL) rArrrr logpmfr*rrrlog) rYrXloss loss_truer error_str true_log_losscalculated_log_lossy_score2s rZ test_log_lossr; s  4 4 4F X sc3Z$SzD$<%QVXF FF # #D)"(6*:*:e*CVAAAqD\RRSSSID)$$$YYFoo @F FFd 3 3 3DD)$$$ aKF aKF FFe 4 4 4DD-(((YYFCj3*sCj 1F z " "!!   !!!!!!!!!!!!!!!, + +FCj3*sCj3* =F FF # #DD)$$$VFCj3* %Fhc S#J/00G C z 3 3 3!!   !!!!!!!!!!!!!!!Cj3*sCj 1FWI z 3 3 3!!   !!!!!!!!!!!!!!! WRVGAAAqDM22333M"67Aq6BBB'777YYF///BH FHYYY 7 7 7DD26#;;,'''''s6D55D9<D95GGGH""H&)H&ctjddg|}tjddg|}t||}tj|sJdS)zCheck the behaviour internal eps that changes depending on the input dtype. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/24315 rr<rN)rArrisfinite)rWrYrXrs rZtest_log_loss_epsr| s_Xq!fE * * *F Xq!fE * * *F FF # #D ;t  r\ctjgd}tjddgddgddgddgg|}tjtd 5t ||d d d d S#1swxYwYd S) zGCheck that log_loss raises a warning when y_pred values don't sum to 1.rrrrrrrrz$The y_pred values do not sum to one.rN)rArrrrr)rWrYrXs rZ'test_log_loss_not_probabilities_warningr sXlll # #F XSzC:SzC:Fe T T TF k)O P P P!!   !!!!!!!!!!!!!!!!!!rr:rrcVt||tjdksJdS)z6Check that log_loss returns 0 for perfect predictions.rN)rrrris rZ!test_log_loss_perfect_predictionsr s/ FF # #v}Q'7'7 7 7 7 7 7 7r\cntjgd}tjddgddgddgddgg}ttfg} ddlm}m}|||fn#t$rYnwxYw|D];\}}||||}}t||} t| d>>(88*EEE(vv>> KKK(Va@@*MMM z " "--,,,--------------- z " "//#.../////////////// z " "//#...///////////////Xlll # #F X*** + +FW z 7 7 7))((()))))))))))))))("u55t<<<(!se44d;;;(!se44d;;;(%3%5III4PPP(%3%5III4PPPPPsH1DDD:EE!E>FF"%F"2HHHcd}tjt|5tgdgdddddS#1swxYwYdS)Nz%y_pred contains classes not in y_truerrhr)rrrrrs rZ#test_balanced_accuracy_score_unseenr s 1C k - - -66 999555666666666666666666sAAAz y_true,y_pred)rrrr)rrrr)rrrrct||dtj|}t5t ||}dddn #1swxYwY|t j|ksJt ||d}t |tj||d}|||z d|z z ksJdS)NrrT)adjustedrr<)r!rAuniquer/rrr full_like)rYrX macro_recallbalancedrchances rZtest_balanced_accuracy_scorer" s  &0A0AL   ;;*66::;;;;;;;;;;;;;;; v}\22 2 2 2 2&vvEEEH $VR\&&)-L-L M MF 6)a&j9 9 9 9 9 9 9sAAArr))FTr)rr)zeroonec\tjd}d|d}}|||d}|tur||}n|}||||}tjtj|rJdS) zCheck that the metric works with different types of `pos_label`. We can expect `pos_label` to be a bool, an integer, a float, a string. No error should be raised for those types. *rurT)rreplacerrN) rArErFchoiceruniformranyr)r}rrTrQrrYrXrs rZ*test_classification_metric_pos_label_typesr+ s* )   # #Cwr{yI ZZiZ > >F !!!),, VFFi 8 8 8Fvbhv&&'''''''r\zy_true, y_pred, expected_scorerrcZt||dtj|ksJdS)zCheck the behaviour of `zero_division` for f1-score. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/26965 rrN)rrr)rYrXrms rZ2test_f1_for_small_binary_inputs_with_zero_divisionr- s4 FF# 6 6 6&-:W:W W W W W W Wr\scoringrr5)rrctjd\}}tdd||}t ||||dddS) aZCheck that we validate `np.nan` properly for classification metrics. With `n_jobs=2` in cross-validation, the `np.nan` used for the singleton will be different in the sub-process and we should not use the `is` operator but `math.isnan`. Non-regression test for: https://github.com/scikit-learn/scikit-learn/issues/27563 r)r;r) max_depthr;r5r)r.n_jobs error_scoreN)r make_classificationr(rJr%)r.rOrP classifiers rZ9test_classification_metric_division_by_zero_nan_validatonr5% s^&  'Q 7 7 7DAq'!!DDDHHANNJJ1gaWUUUUUUr\cztjgd}tjgd}d}tjt|5t ||dddn #1swxYwYd}tjt|5t |||ddddS#1swxYwYdS) z)Check the message for future deprecation.rrz$y_prob was deprecated in version 1.5r)y_probNz/`y_prob` and `y_proba` cannot be both specified)r7y_proba)rArrr FutureWarningrrr)rYrXrn error_msgs rZ)test_brier_score_loss_deprecation_warningr;> s]X((( ) )F X555 6 6F5H m8 4 4 4                      BI z 3 3 3                         s$ A((A,/A,B00B47B4c gd}gd}tjddgddgddgddgdd gd d gg}tjddgddgddgddgddgddgg}t|| }t||d }t||d }d||z z }|t j|ksJtjgd}|dd|z |dddf<|dd|z |dddf<t|||}t|||d }t|||d }d||z z }|t j|ksJtjddgddgddgddgddgddgg}t||}d|cxkrdksnJt||} | t j|ksJtjddgddgddgddgddgddgg}t||}|dksJt||} | t j|ksJgd}tjddgddgddgddgddgddgg}t||}|dksJt||} | dksJgd}gd}tjddgddgddgddgg}t||}|dksJt||} | dksJgd}t|||} | dksJgd}gd}tjgd gd gd!gd"g}t||}d|cxkrdksnJt|||}d|cxkrdksnJtjgd#gd$gd"gd%g}t||}|dksJt|||}|dksJdS)&Nrjrrrfrrrgffffff?g?rrriF)rYrXrUr<)r5r<rrrr<rr)rYrXr>)rYrXr>rUrrrrr{)rr<r<r<)rrrr)r5r5r5r5rK)highr=lowneutral)gffffff?rrr)rrrr)rrr)rrrrr)rArr$rrrr`) rY y_true_stringrX y_pred_nulld2_scorelog_likelihoodlog_likelihood_null d2_score_truer>d2_score_stringd2_score_with_sample_weights rZtest_d2_log_loss_scorerHT s   F;;;M X #J #J #J #J 4L 4L    F( #J #J #J #J #J #J    K!v>>>HVFeLLLN"&PUVVV)<<>O fmH55 5 5 5 5X #J #J #J #J 4L #J    F!00H a<<<<' v>>O fmH55 5 5 5 5  F X #J #J #J #J #J #J    F!00H q====' v>>O a    \\F///M Xd|dD\D$<$N O OF 00H q====' v>>O a     LLM"3m### '! + + + +0 / /F(((M X OO OO OO OO  F!00H     C       }MMMH     C       X OO OO OO OO  F!00H a<<<< }MMMH a<<<<<rbs 2222222222 888888!!!!!!!!!!!!!!;;;;;;555555.NMMMMMMM333333@@@@@@@@//////000000.----->>>>>>>>777777 )()()()(`>D>D>DBWWW<61a*@AA  BA T{aVUOiii=OP)))( 7 7 7   D$*J*J*JZMMM,>>>6 LL BH#OO#OO#OO#OO     . - - = = = (99)(9 OO BH#OO#OO#OO#OO#OO     II OO *;;+*;    ===* = = = O O OF.99.99%S%S:9:9%SPTTT<+%%%;;;&))) #"(#5#5#566""(#5#5#566   A  #"(#5#5#566""(#5#5#566   I  #"(#5#5#566""(#5#5#566   :  #"(#5#5#566""(#5#5#566   I  #"(#5#5#566""(#5#5#566   O  E),,Z**[,,Z*#"(???33""(???33   <  ***"""2>444 1a.99)aS1#JR+ABB  !$$$  ' 'CB:9 ')aS1#JR+ABB  !$$$ CB$2$2$2N R R RF555pc5\22UU32UB7(7(7(t$S$S$STT , ,UT ,000"((("...& ;< QAB '( 888  taVYYY'-M-M-M%%%6"A"A"ABB00CB0"%%%4%%%$%%%(%%%6 % % %F%%%,%%%.XXX I I I%%%< 6 6 6BBB(%D%D%DPJJJZ"""J. + + +868:LMM 2 2NM 2?U?U?UD===@+&&2626"23[[  [|!%%$M$M$MNN1a.99!5!5:9ON&%!5H$M$M$MNN""ON"&1a.99WW:9W@3338e0e0e0P1a.99< < :9< ~61a*@AA!!BA!H61a*@AA""BA"J61a*@AA#(#(BA#(L'''>___D===888AAA6***"NNN8PPP4@AAA8>(>(>(B2:rz2:"FGG  HG 2:rz2:"FGG!!HG! III aVaVaV,- YYY 99956888 )))$ Q Q QF666    3334   3334   3334 : : :  #&&&'   CCC((  ($$ 1a&  828QF++S1 1a&  828QF++S1 1a&  828QF++S1 1a&  828QF++S1 XXX  HBF333 Karv>>> O26::: L777  V V V    ,SSSl.9.9.9.9.9r\