M/PhdZddlZddlmZddlmZddlm Z GddZ e dkrdgZ de vrd Z ejeje d f eje dffZejejejd d dejd ddd fjZejgdgdgdgZejgdgdgdgZejeeZedejej zz ZejegdZedejej zzZe eeZee ede!dddee dSdSdS)zQ Created on Sun Nov 14 08:21:41 2010 Author: josef-pktd License: BSD (3-clause) N)pca) LeaveOneOutc4eZdZdZdZd dZdZd dZd ZdS) FactorModelUnivariatea  Todo: check treatment of const, make it optional ? add hasconst (0 or 1), needed when selecting nfact+hasconst options are arguments in calc_factors, should be more public instead cross-validation is slow for large number of observations cjtj||_tj||_dS)N)npasarrayendogexog)selfr r s i/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/statsmodels/sandbox/datarich/factormodels.py__init__zFactorModelUnivariate.__init__s(Z&& Jt$$ NrTc||j}ntj|}t||d\}}}}||_|r#t j|d|_d|_n||_d|_||_ ||_ dS)zget factor decomposition of exogenous variables This uses principal component analysis to obtain the factors. The number of factors kept is the maximum that will be considered in the regression. N)keepdim normalizeT)prependr) r rr r exog_reducedsm add_constantfactorshasconstevalsevecs)r xraddconstxredfactrrs r calc_factorsz"FactorModelUnivariate.calc_factors s 9 AA 1 A$'7a$H$H$H dE5   ?4>>>DLDMMDLDM  rct|ds|tj|j|jddd|dzfS)Nfactors_wconstr)hasattrr rOLSr rfit)r nfacts r fit_fixed_nfactz%FactorModelUnivariate.fit_fixed_nfact7s^t-..      vdj$,qqq%'z":;;??AAArc Lt|ds||j}||jjd|z }||zdkrt dt |d}|j}g}td||zD] }|jddd|f}tj || } |s|tt|}d} |D]u\} } tj || || ddf } | || | j| j|| ddfz dzz } vn t"j} ||| j| j| j| gt#j|x|_}t"jt#j|ddddfd t#j|dddfd t#j|ddd fd f|_dS) aWestimate the model and selection criteria for up to maxfact factors The selection criteria that are calculated are AIC, BIC, and R2_adj. and additionally cross-validation prediction error sum of squares if `skip_crossval` is false. Cross-validation is not used by default because it can be time consuming to calculate. By default the cross-validation method is Leave-one-out on the full dataset. A different cross-validation sample can be specified as an argument to cv_iter. Results are attached in `results_find_nfact` rNrzFnothing to do, number of factors (incl. constant) should be at least 1 @r)r#r rrshape ValueErrorminr rangerr$r%rlenmodelpredictparamsrnanappendaicbic rsquared_adjarrayresults_find_nfactr_argminargmax best_nfact)r maxfact skip_crossvalcv_iterry0resultskrresprederr2inidxoutidxres_l1os r fit_find_nfactz$FactorModelUnivariate.fit_find_nfact<sQ$tY''      = ?l(+h6G H  ! !-.. .gr"" Zq'(*++ N NA<"1"%D&T""&&((C! "?)#b''22G%,\\ME6 fRYU111W >>BBDDGF!(!6!6w~tFSTSTSTH~!V!V"WY[!\\HH\ 6 NNAsw1A8L M M M M,.HW,=,=='%7111QqS5>!!W>WYwqqqt}Q//!12rct|ds||j}d}|dz }|ddt|jzzz }ddlm}dd }d gd gd zz}t| }|||d|}|dz }|dz }|d| zz }|dz }|dz }|dz }|dz }|S)zprovides a summary for the selection of the number of factors Returns ------- sumstr : str summary of the results for selecting the number of factors r<z, Best result for k, by AIC, BIC, R2_adj, L1Oz z%5d %4d %6d %5dr) SimpleTablezk, AIC, BIC, R2_adj, L1Oz, z%6dz%10.3f) data_fmtsN)txt_fmtz" PCA regression on simulated data,z+ DGP: 2 factors and 4 explanatory variables z) Notes: k is number of components of PCA,z& constant is added additionallyz- k=0 means regression on constant onlyz? L1O: sum of squared prediction errors for leave-one-out) r#rLr<tupler@statsmodels.iolib.tablerOsplitdict__str__)r rEsumstrrOheaders numformattxt_fmt1tabls r summary_find_nfactz(FactorModelUnivariate.summary_find_nfact~s!t122 "    ! ! !)FF -"3eDO6L6L"LLL777777,22488Gxjl* I...{7GT8DDD<<EE$''CC@@GGYY r)NrT)NTN) __name__ __module__ __qualname____doc__rr r'rLr^rr rrs{%%% .BBB @2@2@2@2D#####rr__main__ri)sizerPr-)?rgr*r*)r*r*rgrg)@r+rgr*)皙?rhrgr*)r*r*g?riri)rgrgrgzwith cross validation - slowerF)rArBrC)"rbnumpyrstatsmodels.apiapirstatsmodels.sandbox.toolsr#statsmodels.sandbox.tools.cross_valrrr_examplesnobsc_randomnormalonesf0repeateyearangeTf2xcoefr;dotx0r.ytruerDmodprintr^rLrcrr rs))))));;;;;; PPPPPPPPf zsHH}} U29##$q#22GBGT!H4E4EE F%  &"&))Aa001ddd1CCDF"(000000000233"(333333222455RVB  c")"""1111r,,,'' S))u{);;; ;##B++ c$$&&''' ./// 4udKKK c$$&&'''''-}r