M/Ph7pdZddlmZddlZddlmZddZddZddZ ddZ d d Z ddZ ddZ dZddZdS)zy Statistical tests to be used in conjunction with the models Notes ----- These functions have not been formally tested. )statsN) ValueWarningctj|}tj|d|}tj|dz|tj|dz|z }|S)a Calculates the Durbin-Watson statistic. Parameters ---------- resids : array_like Data for which to compute the Durbin-Watson statistic. Usually regression model residuals. axis : int, optional Axis to use if data has more than 1 dimension. Default is 0. Returns ------- dw : float, array_like The Durbin-Watson statistic. Notes ----- The null hypothesis of the test is that there is no serial correlation in the residuals. The Durbin-Watson test statistic is defined as: .. math:: \sum_{t=2}^T((e_t - e_{t-1})^2)/\sum_{t=1}^Te_t^2 The test statistic is approximately equal to 2*(1-r) where ``r`` is the sample autocorrelation of the residuals. Thus, for r == 0, indicating no serial correlation, the test statistic equals 2. This statistic will always be between 0 and 4. The closer to 0 the statistic, the more evidence for positive serial correlation. The closer to 4, the more evidence for negative serial correlation. axis)npasarraydiffsum)residsr diff_residsdws [/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/statsmodels/stats/stattools.py durbin_watsonrs_DZ  F'&!$///K  QT * * *RVFAID-I-I-I IB Ictj|}|j|}|dkr?ddlm}|dt |zt tjtjfStj ||S)z Omnibus test for normality Parameters ---------- resid : array_like axis : int, optional Default is 0 Returns ------- Chi^2 score, two-tail probability r)warnzPomni_normtest is not valid with less than 8 observations; %i samples were given.r) r r shapewarningsrintrnanr normaltest)rrnrs r omni_normtestr6s Z  F TA1uu!!!!!! #%(VV,-9 ; ; ;vrv~  F . . ..rctjtj|t}|jdkrt dt j||}dt j||z}|j |}|dz |dzd|dz dzzzz}t j |d}||||fS)a The Jarque-Bera test of normality. Parameters ---------- resids : array_like Data to test for normality. Usually regression model residuals that are mean 0. axis : int, optional Axis to use if data has more than 1 dimension. Default is 0. Returns ------- JB : {float, ndarray} The Jarque-Bera test statistic. JBpv : {float, ndarray} The pvalue of the test statistic. skew : {float, ndarray} Estimated skewness of the data. kurtosis : {float, ndarray} Estimated kurtosis of the data. Notes ----- Each output returned has 1 dimension fewer than data The Jarque-Bera test statistic tests the null that the data is normally distributed against an alternative that the data follow some other distribution. The test statistic is based on two moments of the data, the skewness, and the kurtosis, and has an asymptotic :math:`\chi^2_2` distribution. The test statistic is defined .. math:: JB = n(S^2/6+(K-3)^2/24) where n is the number of data points, S is the sample skewness, and K is the sample kurtosis of the data. dtyper z'resids must contain at least 2 elementsr@g?) r atleast_1dr floatsize ValueErrorrskewkurtosisrchi2sf)rrr'r(rjbjb_pvs r jarque_berar-QsP]2:fE::: ; ;F {QBCCC :f4 ( ( (D5>&t4444H  TA b&TQY&X\a,?!?? @B JMM"a E udH $$rc||}d}tj||}tj|gd|\}}}||}|jf}|9t |j}||dt|}tj ||}tj ||}tj tj||z dz|} tj ||} ||zd|zz ||z z } ||z tjt||z |z } ||z | z } | | | | fS)a Calculates the four skewness measures in Kim & White Parameters ---------- y : array_like Data to compute use in the estimator. axis : int or None, optional Axis along which the skewness measures are computed. If `None`, the entire array is used. Returns ------- sk1 : ndarray The standard skewness estimator. sk2 : ndarray Skewness estimator based on quartiles. sk3 : ndarray Skewness estimator based on mean-median difference, standardized by absolute deviation. sk4 : ndarray Skewness estimator based on mean-median difference, standardized by standard deviation. Notes ----- The robust skewness measures are defined .. math:: SK_{2}=\frac{\left(q_{.75}-q_{.5}\right) -\left(q_{.5}-q_{.25}\right)}{q_{.75}-q_{.25}} .. math:: SK_{3}=\frac{\mu-\hat{q}_{0.5}} {\hat{E}\left[\left|y-\hat{\mu}\right|\right]} .. math:: SK_{4}=\frac{\mu-\hat{q}_{0.5}}{\hat{\sigma}} .. [*] Tae-Hwan Kim and Halbert White, "On more robust estimation of skewness and kurtosis," Finance Research Letters, vol. 1, pp. 56-73, March 2004. Nr)9@I@R@rrr @)ravelr sort percentilemeanr%listrinserttuplereshapesqrtrr'abs)yrq1q2q3murmu_bq2_bsigmask1sk2sk3sk4s rrobust_skewnessrIsR` | GGII 4Aq"4"4"44@@@JBB B VIE RX T1e  :b% D :b% D GBGa$h]T22 3 3E *QT " " "C 7S2X "r' *C 7bgc!d(mm$777 7C 7e C S# r@r0cT|d|z |d|z f}tj||\}}}}tj|||k}tj|||k} tj|||k} tj|||k} | |z | | z z S)a KR3 estimator from Kim & White Parameters ---------- y : array_like, 1-d Data to compute use in the estimator. alpha : float, optional Lower cut-off for measuring expectation in tail. beta : float, optional Lower cut-off for measuring expectation in center. Returns ------- kr3 : float Robust kurtosis estimator based on standardized lower- and upper-tail expected values Notes ----- .. [*] Tae-Hwan Kim and Halbert White, "On more robust estimation of skewness and kurtosis," Finance Research Letters, vol. 1, pp. 56-73, March 2004. Y@)r r5r6) r=alphabetaperc lower_alpha upper_alpha lower_beta upper_betal_alphau_alphal_betau_betas r_kr3rXs2 55=$ 5D79}Q7M7M4Kj*gaK())GgaK())G WQq:~& ' 'F WQq:~& ' 'F g &6/ 22rrJr0g@r/c|\}}|\}}tjd}tjj}tjj}|tjddz \} } } } } }d|d<|| z | | z z| | z z |d<|tj|dz |dz f\}}d||z|z d||z|z z |d<|tj|dz |dz f\}}d |zd |zz |d<|S) an Calculates the expected value of the robust kurtosis measures in Kim and White assuming the data are normally distributed. Parameters ---------- ab : iterable, optional Contains 100*(alpha, beta) in the kr3 measure where alpha is the tail quantile cut-off for measuring the extreme tail and beta is the central quantile cutoff for the standardization of the measure db : iterable, optional Contains 100*(delta, gamma) in the kr4 measure where delta is the tail quantile for measuring extreme values and gamma is the central quantile used in the the standardization of the measure Returns ------- ekr : ndarray, 4-element Contains the expected values of the 4 robust kurtosis measures Notes ----- See `robust_kurtosis` for definitions of the robust kurtosis measures )g?r2g@rJr"g@rr!rrrLr g)r zerosrnormppfpdfarray)abdgrMrNdeltagammaexpected_valuer_r`r>r?r@q5q6q7q_alphaq_betaq_deltaq_gammas rexpected_robust_kurtosisrns/4KE4LE5Xa[[N *.C *.C S*H!I!IA!MNNBBBN1r'b2g.27;N1c"(EEM4%<#@AABBOGVSS\\)E1a##f++o6LMN1s28UU]EEM$BCCDDGWD7N;N1 rTc z|(|jdkr!|jdkr|}d}|\}}|\}}dddddd |d |z |d |z f } tj|| | \ } } } } }}}}}}|rt ||ntjd }tj||d |dz }|| z | | z z|| z z |dz }|jdkrt|||}ntj t||||}||dz}||z ||z z |dz }||||fS)a Calculates the four kurtosis measures in Kim & White Parameters ---------- y : array_like Data to compute use in the estimator. axis : int or None, optional Axis along which the kurtosis are computed. If `None`, the entire array is used. a iterable, optional Contains 100*(alpha, beta) in the kr3 measure where alpha is the tail quantile cut-off for measuring the extreme tail and beta is the central quantile cutoff for the standardization of the measure db : iterable, optional Contains 100*(delta, gamma) in the kr4 measure where delta is the tail quantile for measuring extreme values and gamma is the central quantile used in the the standardization of the measure excess : bool, optional If true (default), computed values are excess of those for a standard normal distribution. Returns ------- kr1 : ndarray The standard kurtosis estimator. kr2 : ndarray Kurtosis estimator based on octiles. kr3 : ndarray Kurtosis estimators based on exceedance expectations. kr4 : ndarray Kurtosis measure based on the spread between high and low quantiles. Notes ----- The robust kurtosis measures are defined .. math:: KR_{2}=\frac{\left(\hat{q}_{.875}-\hat{q}_{.625}\right) +\left(\hat{q}_{.375}-\hat{q}_{.125}\right)} {\hat{q}_{.75}-\hat{q}_{.25}} .. math:: KR_{3}=\frac{\hat{E}\left(y|y>\hat{q}_{1-\alpha}\right) -\hat{E}\left(y|y<\hat{q}_{\alpha}\right)} {\hat{E}\left(y|y>\hat{q}_{1-\beta}\right) -\hat{E}\left(y|y<\hat{q}_{\beta}\right)} .. math:: KR_{4}=\frac{\hat{q}_{1-\delta}-\hat{q}_{\delta}} {\hat{q}_{1-\gamma}-\hat{q}_{\gamma}} where :math:`\hat{q}_{p}` is the estimated quantile at :math:`p`. .. [*] Tae-Hwan Kim and Halbert White, "On more robust estimation of skewness and kurtosis," Finance Research Letters, vol. 1, pp. 56-73, March 2004. Nrrg)@r/gB@g@O@r1gU@rLrr\Fr r!) squeezendimr3r r5rnr]rr(rXapply_along_axis)r=rrbrcexcessrMrNrdrerOe1e2e3e5e6e7fdf1mdfgf1mgrfkr1kr2kr3kr4s rrobust_kurtosisr%s| YY[[  " "qv{{ GGIIKE4LE5 $dD$ 55=% 8D13q$DH2J2J2J.BBBBb$ 1.r2666%'Xa[[ .D% ( (>!+< ! C "9 #nQ&7 7C S# rctjtj|}|jdkrt dtj|}|jd}|dzdkr||dzdz ||dzzdz }n||dz dz}||z }||dk}||dk}|dddf}||z }tj|dk|dk}tj||<||z}||z } tj |dk} | retj | | ftj | z } | dtj | zz} tj | } | | d| | df<tj| S)a- Calculates the medcouple robust measure of skew. Parameters ---------- y : array_like, 1-d Data to compute use in the estimator. Returns ------- mc : float The medcouple statistic Notes ----- The current algorithm requires a O(N**2) memory allocations, and so may not work for very large arrays (N>10000). .. [*] M. Hubert and E. Vandervieren, "An adjusted boxplot for skewed distributions" Computational Statistics & Data Analysis, vol. 52, pp. 5186-5201, August 2008. rz#y must be squeezable to a 1-d arrayrr gN)r rpr rqr&r4r logical_andinfr oneseyetriufliplrmedian) r=rmfzlowerupperstandardizationis_zerospreadhnum_ties replacementss r _medcouple_1dr~s4 2:a==!!Av{{>???  A  A1uzzQ maQi'1 , A!|_ BA a3hKE a3hKE !!!T'NEemOnUc\5C<88G!vOG U]F Avesl##H0w(344rvh7G7GG BGL1111 y.. #/)8)hYZZ  9Q<<rctj|tj}|!t|Stjt||S)a Calculate the medcouple robust measure of skew. Parameters ---------- y : array_like Data to compute use in the estimator. axis : {int, None} Axis along which the medcouple statistic is computed. If `None`, the entire array is used. Returns ------- mc : ndarray The medcouple statistic with the same shape as `y`, with the specified axis removed. Notes ----- The current algorithm requires a O(N**2) memory allocations, and so may not work for very large arrays (N>10000). .. [*] M. Hubert and E. Vandervieren, "An adjusted boxplot for skewed distributions" Computational Statistics & Data Analysis, vol. 52, pp. 5186-5201, August 2008. r)r r doublerr3rr)r=rs r medcouplersJ6 1BI&&&A |QWWYY''' }dA 6 66r)r)rYrZ)rrYrZT)__doc__scipyrnumpyr statsmodels.tools.sm_exceptionsrrrr-rIrXrnrrrrrrs 888888%%%%P////64%4%4%4%nIIIIX!3!3!3!3H****ZVVVVr;;;|777777r