J/PhW,ddlZddlmZddlmZmZmZmZdgZ ddgZ ddgZ d Z Gd de Zd Zd Zd ZdZdZdS)N) PatsyError) safe_isnansafe_scalar_isnan no_picklingassert_no_picklingNAActionNoneNaNraisedropc@dd|DS)Nz, c,g|]}t|S)repr).0opts M/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/patsy/missing.py z!_desc_options..3s333Cd3ii333)join)optionss r _desc_optionsr2s# 99337333 4 44rcDeZdZdZdddgfdZdZdZdZd Zd Z e Z d S) raAn :class:`NAAction` object defines a strategy for handling missing data. "NA" is short for "Not Available", and is used to refer to any value which is somehow unmeasured or unavailable. In the long run, it is devoutly hoped that numpy will gain first-class missing value support. Until then, we work around this lack as best we're able. There are two parts to this: First, we have to determine what counts as missing data. For numerical data, the default is to treat NaN values (e.g., ``numpy.nan``) as missing. For categorical data, the default is to treat NaN values, and also the Python object None, as missing. (This is consistent with how pandas does things, so if you're already using None/NaN to mark missing data in your pandas DataFrames, you're good to go.) Second, we have to decide what to do with any missing data when we encounter it. One option is to simply discard any rows which contain missing data from our design matrices (``drop``). Another option is to raise an error (``raise``). A third option would be to simply let the missing values pass through into the returned design matrices. However, this last option is not yet implemented, because of the lack of any standard way to represent missing values in arbitrary numpy matrices; we're hoping numpy will get this sorted out before we standardize on anything ourselves. You can control how patsy handles missing data through the ``NA_action=`` argument to functions like :func:`build_design_matrices` and :func:`dmatrix`. If all you want to do is to choose between ``drop`` and ``raise`` behaviour, you can pass one of those strings as the ``NA_action=`` argument directly. If you want more fine-grained control over how missing values are detected and handled, then you can create an instance of this class, or your own object that implements the same interface, and pass that as the ``NA_action=`` argument instead. r r r c f||_|jtvr(td|dttdt |t rtdt ||_|jD]3}|tvr(td|dttd4dS)aThe :class:`NAAction` constructor takes the following arguments: :arg on_NA: How to handle missing values. The default is ``"drop"``, which removes all rows from all matrices which contain any missing values. Also available is ``"raise"``, which raises an exception when any missing values are encountered. :arg NA_types: Which rules are used to identify missing values, as a list of strings. Allowed values are: * ``"None"``: treat the ``None`` object as missing in categorical data. * ``"NaN"``: treat floating point NaN values as missing in categorical and numerical data. .. versionadded:: 0.2.0 zinvalid on_NA action z (should be one of )z$NA_types should be a list of stringszinvalid NA_type N) on_NA_valid_NA_responses ValueErrorr isinstancestrtupleNA_types_valid_NA_types)selfrr"NA_types r__init__zNAAction.__init__[s" :0 0 0*+055-@S2T2T2T2TV  h $ $ ECDD Dh }  Go-- j/6ww o8V8V8V8VX.  rcTd|jvrt|rdSd|jvr|dSdS)zgReturn True if `obj` is a categorical NA value. Note that here `obj` is a single scalar value.r Tr NF)r"r)r$objs ris_categorical_NAzNAAction.is_categorical_NA|s? DM ! !&7&<&< !4 T] " "s{4urctj|jt}d|jvr|tj|z}|jdkrtj|d}|S)zReturns a 1-d mask array indicating which rows in an array of numerical values contain at least one NA value. Note that here `arr` is a numpy array or pandas DataFrame.dtyper )axis)npzerosshapeboolr"isnanndimany)r$arrmasks ris_numerical_NAzNAAction.is_numerical_NAs] x ... DM ! ! BHSMM !D 9q==6$Q'''D rc(t|t|cxkrt|ksnJt|dkr|S|jdkr||||S|jdkr||||SJ)aTakes a set of factor values that may have NAs, and handles them appropriately. :arg values: A list of `ndarray` objects representing the data. These may be 1- or 2-dimensional, and may be of varying dtype. All will have the same number of rows (or entries, for 1-d arrays). :arg is_NAs: A list with the same number of entries as `values`, containing boolean `ndarray` objects that indicate which rows contain NAs in the corresponding entry in `values`. :arg origins: A list with the same number of entries as `values`, containing information on the origin of each value. If we encounter a problem with some particular value, we use the corresponding entry in `origins` as the origin argument when raising a :class:`PatsyError`. :returns: A list of new values (which may have a differing number of rows.) rr r )lenr_handle_NA_raise_handle_NA_drop)r$valuesis_NAsoriginss r handle_NAzNAAction.handle_NAs$6{{c&kk9999S\\999999 v;;!  M : ((AA A Z6 ! !''@@ @ Lrczt||D])\}}tj|rtd|*|S)Nzfactor contains missing values)zipr/r5r)r$r=r>r?is_NAorigins rr;zNAAction._handle_NA_raisesN 11 K KME6ve}} K !A6JJJ K rctj|djdt}|D]}||z}|fd|DS)Nrr+c$g|] }|df S).r)rv good_masks rrz,NAAction._handle_NA_drop..s"222a)S.!222r)r/r0r1r2)r$r=r>r? total_maskrCrHs @rr<zNAAction._handle_NA_drops^XfQioa0===   E % JJK 222262222rN) __name__ __module__ __qualname____doc__r&r)r8r@r;r<r __getstate__rrrrr6s""H$vuoB   8 333LLLrcddl}|ttd|ttd|ttdt tdS)Nrpordr)r asdfr"r )pytestraisesrrr)rTs rtest_NAAction_basicrVskMMM MM*hfM555 MM*hMAAA MM*hM777xzz"""""rcgdgdgddgfD]}t|}dD]}tjd|zt}ddg}|jd kr%|jd d krtj||dd gf<ntj||<tjd t}d|vrd ||<| |}tj ||sJdS) Nr r rS)r)r-))r+rrXr-rYT) rr/onesfloatr4r1nanr0r2r8 array_equal)r"action extra_shaper6nan_rows exp_NA_mask got_NA_masks r test_NAAction_NA_types_numericalrcs%6(UFO< < <8,,,+ < +{;; ; ; ; ; < < @D@gI@?g@g@rjg@g@g@g @)TFTFFrir+)TFFFTrrXrYr-rkrl) rr/asarrayr\r0r2r@r:r])r^ in_valuesr> out_valuess rtest_NAAction_droprrsV f  F $$$%% 11122 S"&MC:c{S#Jbf VWWI 44455 $ 44455F !!)VdVaZ@@J z??a     >*Q-!Q 0 0000 >*Q-$ 6 6666 >*Q-3*sCj)A B BBBBBBrctd}tjddgtjddgg}tjddggdz}|||ddg}tj|d|dsJtj|d|dsJdd lm}|d dd}|d dd }tjd}tjddgtjd tjgg}tjddgtjdd gg} |||||gJ#t$r}|j |usJYd}~dSd}~wwxYw)Nr rQg?g333333?r-rXFr)OriginrRrnrmT) rr/ror@r] patsy.originrtaranger\rrD) r^in_arrsr>got_arrsrto1o2in_idxes rtest_NAAction_raiser}s G $ $ $Fz3*%%rz1a&'9'9:Gj%(( )A -F$>>H >(1+wqz 2 2222 >(1+wqz 2 2222###### 1  B 1  BYq\\Fz3*%%rz3-'@'@AGj%(("*eT]*C*C DF&2r(333 x2~~~~~~~~~~s E(( F2 FF)numpyr/patsyr patsy.utilrrrr__all__r#rrobjectrrVrcrfrrr}rrrrsNUUUUUUUUUUUU ,5/'555FFFFFvFFFR###<<<"GGGCCC&r