M/PhB<dZddlZddlZddlmZmZmZmZm Z ddl Z ddl Z ddl mcmZddl mZmZmZmZmZmZddlmZddlmZddlmZmZdd d d d d Ze j dee j dedZ!e j dedZ"dZ#dZ$dZ%dZ&dZ'GddZ(Gdde(Z)dZ*dZ+dZ,dZ-dZ.d Z/d!Z0d"Z1d#Z2d$Z3d%Z4d&Z5d'Z6d(Z7d)Z8e j d*ej9d+d,d-e j de:e;d.gze j d/d0d1gd2Ze j d*ej9d+d,d-e j de:e;d.gzd9Z?dS):z> Created on Fri Mar 01 14:56:56 2013 Author: Josef Perktold N)assert_allcloseassert_almost_equalassert_array_less assert_equal assert_raises)confint_proportions_2indepmultinomial_proportions_confintpower_proportions_2indepproportion_confint%samplesize_proportions_2indep_onetailscore_test_proportions_2indep)HypothesisTestWarning)Holder) res_binomres_binom_methodsz agresti-coull asymptoticexactwilsonbayes) agresti_coullnormalbetarjeffreyscasemethodcb|\}}tjt|}t|j|}t|j|}t j|st j|rtj d|dks||kr|dkrtj d|dkr|dkrtj dt||d|}t|d}t|d }t|||gd t||z dS) NzSkipping due to NaN valuerrz%Skipping nobs 0 or count and jeffreyszUKKKK eDk4:T%+ - - -DU1X_T*E!HOD,ABD    VAYt_fQio65IIII u||~~t{{}}D&, . . .EFU1XuQx0u====  a 0',q/&*6;;;FVAY%vay'781X_Q'q);<5JJJJ!T $(.000GWQZ%vay7EJJJJ!tDz(.000GWQZ%vay7DIIIIIIr9cd}tjd|dd}tjd|z |d|dz d z }t||d dS) N rrrg(@r!rr; r$)smpropr samplesize_confint_proportionr)r2r6ress r7'test_samplesize_confidenceinterval_propr[ksb D  "2t4 I I IB  .s4x"Q%"Q%-19L M MCT2......r9cTtjdd}t|dddS)N?皙?gAJ?rVrW)rXproportion_effectsizer)ess r7test_proportion_effect_sizerars0  %c3 / /B.;;;;;;r9c ddlm}|D]B\\}}}t|jd|}t |j||jd|d|CdS)Nr!)res_multinomialrr"z " method, r#)'results.results_multinomial_proportionsrcitemsr proportionsrcis precision)rcr descriptionrGris r7$test_confint_multinomial_proportionsrlwsHHHHHH+:+@+@+B+B99' &+-f.@$5;=== JV%5777+77 9 9 9 9 999r9cdD]#}tttdgdz|$ttttjddz dD]#}tt tdgdz|$dS)N)皙rr!g?2r r!)unknown_method sisok_methodz unknown-glazrd)r ValueErrorr r*rBNotImplementedErrorrs r7#test_multinomial_proportions_errorsrvs!--j"AcBhe - - - - -*=)B--!#%%%E//)+JcBhv / / / / ///r9ctjgddd}tjgddd}tjddg}gd}tj|dd }gd }tj|dd }t ||d t |tj||z dd t ||d dS)N)gnvB?gTw?L?g&Od¨?gsʊ~?g"?gc@?gVE?g/E~ܻ?gW$U>?g \P?gG \+?gYfE?ga?r;)g/x$?g "1?rxgh?g:]?gu"?gx?g@?g6?gaS?gy\?gDU?g|E?g]F?g W:r sison_glazrd)rzrr|r}r~rrh㈵>atolrMb@?)r*arrayrCrXr rmaximum)ci01ci0 ci0_shiftpci_01ci_0s r7*test_confint_multinomial_proportions_zerosrs/ 8  %WR]]  (  %WR]]+{344I%%%A  21d:F H H HE###A  1!T9E G G GDE4d++++D"*S9_a88tDDDDE4d++++++r9c eZdZdZdZdZdS)CheckProportionMixinctj|j|jd}t |d|jjdt |d|jjdtj|j|j|jj d}t |d|jjdt |d|jjdtj|jd|jd|j j }t |d|j jdt |d|j jddS)NvaluerrVrWr!) rXproportions_chisquare n_successr2r res_prop_test statisticp_valueres_prop_test_val null_valueres_prop_test_1)selfpts r7 test_proptestz"CheckProportionMixin.test_proptestsE  )$.$)4 P P PBqE4#5#?LLLLBqE4#5#=rJJJJ )$.$)*.*@*KA*NPPPBqE4#9#CRPPPPBqE4#9#A2NNNN )$.*;TYq\*.*>*IKKKBqE4#7#A2NNNNBqE4#7#?LLLLLLr9ctj|j|jd}t |j|jtj|j|jd}t ||jtj |j|jd}t |j|jdt|jdz ddS)Nmultitest_methodhhommelr!rVrW) rXproportions_chisquare_allpairsrr2r pvals_rawres_ppt_pvals_rawpval_correctedres_ppt_pvals_holm"proportions_chisquare_pairscontrollen)rpptpptds r7test_pairwiseproptestz*CheckProportionMixin.test_pairwiseproptests3DNDI37999CM4+ABBB3DNDI36888C..00$2IJJJ8"&)hHHHDNCM:M3ty>>A;M:M,N$& ( ( ( ( ( (r9ctj|jdd|jddd}t t |jdgd}t|j|j|dS)Nr<r)rr!r<) rXrrr2rrrrr)rrr3s r7test_number_pairs_1493z+CheckProportionMixin.test_number_pairs_1493s~3DN2A24F48IbqbMEIKKK S''+++iiCM4+A#+FGGGGGr9N)__name__ __module__ __qualname__rrrr9r7rrsIMMM$ ( ( (HHHHHr9rc eZdZdZdZdZdS)TestProportionctjgd|_tjgd|_tjgd|_tjgd|_t }d|_d|_d|_ tjgd d d d |_ d |_ d |_ d|_d|_d|_||_t }tjdg d d d |_tjd g d d d |_d|_ tjgd d d d |_ tjgd d d d |_ d |_ d|_d|_d|_||_t }d|_d |_d|_ d|_ d|_ tjddg|_ d|_d|_d|_||_dS)N)r|ZrK)V]R)gDu?n?gC?gg n`?g۾?gws?)gwGT?r绶ws?g)?rrg3Ob =&@r<guJ?)Κ)?g{?g?gEJԮD?r!F)orderNULL two.sidedzG4-sample test for equality of proportions without continuity correctionzsmokers2 out of patientsg~g*@gv R%?)?rrrzA4-sample test for given proportions without continuity correctionz;smokers2 out of patients, null probabilities rep(c(0.9), 4)g_@gv´?rrg]'$OD?g 8s?z71-sample proportions test without continuity correctionz4smokers2[1] out of patients[1], null probability 0.9)r*rrr2rrrr parameterrrCestimaterconf_int alternativer data_namerrr)rrrrs r7 setup_methodzTestProportion.setup_methods"6"6"677H11122 !#+++""#%(,,,##  "3 "#  4 !#+++""wq#w&& $.  !+ $/ ! ? "< *#HH&(h 0''wq#w&& #')h 0''wq#w&& #%6!%'X///&&wq#w&& "(*x111((wq#w&& $&0"(3%#f &c#!2!(($5!$%!"3#4 %("#%8->-?-A$B$B &1#!Z$Z!.r9ctjddg}tjddg}tj||d\}}t |dt |ddS)NrorUScrgyt/yg;u `?)r*rrXproportions_ztestr)rr1r2statpvals r7test_default_valuesz"TestProportion.test_default_values$sk!R!!xR!!-eTFFF dD"5666D"566666r9cd}d}d}tj|||\}}t|dt|dtttj||ddS)Nrorrrgu—?g}r'=?)rXrrrrt)rr1r2rrrs r7 test_scalarzTestProportion.test_scalar,sn-eTGGG dD.111D.111j&":E4tTTTTTTr9N)rrrrrrrr9r7rrsJA/A/A/H777UUUUUr9rclt}d|_d|_d|_ddg|_d|_d|_d|_d |_d |_ t}d|_d|_d |_d d g|_d|_d|_d|_d |_d |_ t}d|_d|_d|_ddg|_d|_d|_d|_d |_d |_ d|fd|fd|fg}|D]4\}}tj ddd|}t||jd5tj dddd}tj dddd\}} t||jdt| |jd dt||jdddS)N3g-$Ǻl?rg&dB?g jZ?gUUUUUU?lesszExact binomial testz 51 and 235gs0,j.?g.6?r!greatergJfJ"f?gK-A?g+H3?rlargersmaller two-sidedproprrVrWrrrr{)rrrrrrrrrrrX binom_testrr ) binom_test_lessbinom_test_greaterbinom_test_2sidedalltestsaltres0rZci_2sr(r)s r7test_binom_testr7s"hhO "O #O/O !#56O1O!'O"(O2O ,O #% #& !4#5q"9"4$*!%." 5#/ "$"% 2"46H!I!3#) $/!4".-.O,/02H;; TCf#FFFCr:::::  %b#T& I I IE.r3c6<>>>NFF092FFFF 8 ;RHHHH 2 ;A >KKKKKKr9cd}d}d}d}tj||||\}}t||tj||||}t ||tj|dz|||}t ||d}tj||||\}}t|d tj||||}t ||tj|dz |||}t ||d }tj||||\}}tj||||}t ||tj|dz |||}t ||tj||||}t ||tj|dz |||}t ||dS) Nr333333?r)r rrr!rrr)rXbinom_test_reject_intervalrrr)r r2rrr(r)rs r7test_binom_rejection_intervalrrsM E D DK6tTCNPPPNFF  VT.9 ; ; ;DdE"""  VaZD.9 ; ; ;DeT"""K6tTCNPPPNFF  VT.9 ; ; ;DdE"""  VaZD.9 ; ; ;DeT"""K6tTCNPPPNFF  VT)4 6 6 6DdE"""  VaZD)4 6 6 6DeT"""  VT)4 6 6 6DdE"""  VaZD)4 6 6 6DeT"""""r9cLtjdddd}tjddg|R}t|dgdzd tjd ddd}tjd dg|R}t|dgdzd tjt jd dddd}tjt jd dd|d |d }t j|}t|d t j|jzd dS)Nr=rTrr{)rr rr<rUrWror!r皙?) rXr binom_tostrr*rBasarrayrDshape)r6bts r7test_binom_tostrs1  "2r& D D DB  2r 'B ' ' 'BTFQJ3333  "1bs C C CB  1b &2 & & &BTFQJ3333  "29Q#3#3R)- / / /B  29Q++RA1 > >B BBEBGBH$5$55rBBBBBBr9cdtjdddz}tjddd|d }tjgd }t ||d tjddd}d }t||tjddd}tjdd|dd }tjgd}t tj |d|d dS)Nrrg ףp= ?r=r]gffffff?ir)p_altr ) gS?g+?g rh?g&†W?g%u?gNё\C?g?W[?g??g%u?g(?rrW)i iLrTr^ rxrxrxRI&¶?Gx $(?n4@?JY?6>W[?z6>W[?7d?) r*linspacerXpower_binom_tostrrbinom_tost_reject_intervalrrBr)rpower res_powerrej_int res_rej_intr2s r7test_power_binom_tostrs  "+ar** *E  #Ccd K K KE===>>Iy!4444/S#>>GK+&&& 9Rb ! !D  #Cd#T J J JE55566I 5!,,iCCCCCCr9c tjdddddddd }t|d d tj5tjd t tjddtjdddddddd }tj gd}ttj |d |d tjddtjdddddddddd d }tj gd}ttj |d |d tjddtjddddddddd d }tj gd}ttj |d |d ddddS#1swxYwYdS)Nr{rr=rrTbinom)rr discretedistrgm4@?rrWignorer^rTrr]F) rxrxrxrrgI +?gV-?rg rh?rr;r!rr r r  variance_prop continuitycritval_continuityr)rr r r rr) rxrxrxrrrrrrgRI&?) rXpower_ztost_proprwarningscatch_warnings simplefilterrr*rBrrrrs r7test_power_ztost_proprs  #Cb4"&W 6 6 667 9Evq1111  " "HHh(=>>>'S")BR2H2H.1-4666679H&&&''  BJua00)QGGGG'S")BR2H2H.1-4D34LLLMNO H66677  BJua00)QGGGG'S")BR2H2H.1-4C;<>>>?@A H66677  BJua00)QGGGG=HHHHHHHHHHHHHHHHHHsE0GG GcHtjddgddg}ddlm}m}||dd}t |dd gd ||d d d }t |dddd t |dddd t |dddS)Nr!ri)zconfintztostr{)r ddofgAf?gL7A`?rg ףp= ?gRQ?)rg"@r;g~zrA)r*repeatstatsmodels.stats.weightstatsrrrr)xfairrrrrZs r7 test_ztostrs Iq!fsGn - -E >======= 8E1 - - -D/333 %tT * * *CAq 61---Aq 7A...c!ff%%%%%r9c ntjt5tjddt jddddddddd d d }dddn #1swxYwYt jgd }tt j |d |d tjt5tjddt jdddddddddd d }dddn #1swxYwYt jgd}tt j |d |d tjt5tjddt jdddddddddd d }dddn #1swxYwYt jgd}tt j |d |d tjt5tjddt jdddddddddd d }dddn #1swxYwYt jgd}tt j |d |d tjt5tjddt jddddddddd d d }dddn #1swxYwYt jgd}tt j |d |d dS)Nr^rrTrr]rFnormrr ) rxrxrxgݼiO?gk?g?g-9?gmb?gn?gFm?rrWr!) rxrxg=P?gs=?gd-v?gvȋT1x?g,Ѝ?gxhG?gv10?g@I?T) rxrxrxʶ?a\q/?ʔ?g[7?SX#?F=D[?gN8P?) rxrxrxr"r#r$gSii?r%r&gs?) rxrxrxrxgY'WF]J?gY?g6?g 7D?g=J?go0J?) r,warnsrrXrr*rBrrrrs r7test_power_ztost_prop_normr(sN + , ,OO'S")BR2H2H.1-3334LLLMNOOOOOOOOOOOOOOOO JJJKKI 5!,,iCCCC + , ,OO'S")BR2H2H.1-3334LLLMNOOOOOOOOOOOOOOOO &&&''I 5!,,iCCCC + , ,OO'S")BR2H2H.1-3334LLLMNOOOOOOOOOOOOOOOO JJJKKI 5!,,iCCCC + , ,OO'S")BR2H2H.1-3334LLLMNOOOOOOOOOOOOOOOO JJJKKI 5!,,iCCCC + , ,OO'S")BR2H2H.1-3434LLLMNOOOOOOOOOOOOOOOO HHHIII 5!,,iCCCCCCsY9AA#&A#>9DD D"9F''F+.F+9I  II*9K//K36K3cDtjdddd}tjddd}t|d|ddtjt jdd gt jdd gd d}tjt jdd gt jdd g}t|d|ddtjt jdd gt jd d gd d}tjt jdd gt jd d g}t|d|ddt d |d ddS)Ng4@r])rprop_varrr!rVrWr=rTriPry)rXrrrr*rr)res1res2s r7test_proportion_ztestsr.As  #B3 E E ED  'Cs ; ; ;DQa"5555  #BJBx$8$8$&JRy$9$9*+d < < gv !>)g`ţޝ?g`$0?r7F)g^?g`9>L@rJrr?)gh'?g۞ IE@r<rK)rLrMrNrOr6ci1s r7test_confint_2indep_propcisrSslMFEMFE B $VUFE-3,3 F F FCC%(((( B $VUFE-3,; = = =CC$'''' B $VUFE-3,2u F F FCC$'''' B $VUFE-9,3 F F FCC$'''' B $VUFE-4,3 G G GCC$''''''r9c d\}}d\}}dD]}t|||||}t|j|jd|dkrdnd }t||||||d dd \}}t||||||dzd dd \} } t|| d t|| d t||||||dz d dd \} } t|| d t|| d dS)Nr0r3)r5r<rC)r6绽|=r?r5r?F)r6rreturn_resultsr;:0yE>)r r prop1_null prop2_null) rLrMrNrOcorZvals0pv0s1pv1s r7test_score_test_2indeprasMFEMFE%--+FE6546888UCCCC<@@@S ,vuc3:r%111  E6666,vucDj#r%111  E6666 % % % FF,&#*c2%111  1 u5999993::r9cfd\}}d\}}t}gd|_ddg|_tj||||d}t |j|jd t |j|jd gd }tj|d}d d g}t |j|d dS)N)P)$()g6[?gsA?ga4?gQ@gS㥛@rrqrrr<)C r1rvg6^?gLMw?) rp0_rootsrrX_confint_riskratio_koopmanr_p_rootsconfint_confint_riskratio_paired_nam) x0n0x1n1 results_namrZtablerespci_olds r7test_score_confint_koopman_namresFB FB ((K333K!5>K  +BB4 H H HCCL+"6Q????CK!5A>>>> NNE  /T B B BD "FDL&q111111r9c tddd}t|jddtdddddd d }t|dd tddd dt|jddtddd d}t |jdtddd dd}t|ddtdddd}t|ddtdddddd d }t|ddd dlm}tdddd}t|jdd |ddd!|j|j"}t|ddtdddddd d }t||d#$d%}d&}td'd(|d)}t|j|d td'd(|d*}t||d+$dS),Ngпg?g8b->-S@rrXrr!rrr)r<r rrrg*O@r)rg?r]rF)rrWg333333ÿg?g#T@)rW)normal_sample_size_one_tailgy&1gQ?i&rV)r<gB ܺ?gHz>r)std_nullstd_alternativer>r?g,KE ?rng?g@r;rA) r rrr rstatsmodels.stats.powerrrstd_alt)pow_nrrZn2pwr_sts r7test_power_2indeprs #E4 : :DDJ$////-eT3a48:E G G GAAxd++++UD( JJJJDJ$//// #D#xY O O ODdj$''' #D#xX38 : : :DD#D)))) #E4 O O ODD#D))))-eT3a48:E G G GAAwT****DCCCCC "65#R @ @ @CCIyt4444##FIx-0\47K A A AAAs&&&& .vui56d!;F H H HBB&&&& F A "4ar : : :CCIvD1111 .tS& J J JBB%%%%%%r9r1r=rror array_likeFTc |r|gdzn|}d}t|||}t||z ||}ttj|dtj|dddz dS)Nr<drdrVryr rr*r)r1rr_countrabs r7test_ci_symmetryrs ' 1eWq[[EF A5!F333A1u9a777ABHQKKrx$$B$'8'8!899999r9r2/rp0c |r|gdzn|}|r ||z gdzn||z }t||d}t||d}ttj|dtj|dddz dS)Nr<rrdrVryr)r2r1rr nobs_m_countrrs r7test_ci_symmetry_binom_testrs' 1eWq[[EF)3ED5L>A%%L64 ===A<lCCCABHQKKrx$$B$'8'8!899999r9cjtjt5tddddddn #1swxYwYtjt5tddddddn #1swxYwYtjt5tt jdgdddddn #1swxYwYtdd d}td d d}td d d}t ||t ||dS) Ng%@rTrrdr=g4@g$@g5@rgG@)r,raisesrtr r*rr)rrcs r7test_int_checkrs z " "::4L9999::::::::::::::: z " "::2tL9999::::::::::::::: z " "FF28TF++R EEEEFFFFFFFFFFFFFFF 4L999A2r,777A2tL999AAqAqs19==A<<BB &CCCc d}t||g||}t||z ||z g||}ttj|dtj|dddz dS)NrrdrVryr)r1rrrrs r7test_ci_symmetry_arrayrsy AE5>1V<<rs.  ---------BAAAAA,,,,,,[[[[[[[[#2(!$%  **.115521+*5*>22(J(J32(JV///<<< 999 / / /#,#,#,L(H(H(H(H(H(H(H(HVUUUUUUUUUU)UUUUUUp8L8L8Lv+#+#+#^CCC&DDD,#H#H#HL&&&"=D=D=D@&&&6S:S:S:l&(&(&(R---6939393x0:0:0:f22262&2&2&j)")BA"6"677 dd>&&(())\N:t}55::6587 :"b**)")B--00t}55::6510+*:    )")BA"6"677 dd>&&(())\N:::87:::r9