hMh{QddlZddlZddlmZddlmZddlm Z ddl Z ddl Z ddlmZmZddlZ dd Z ddZ ddZ ddZdS)N)gridspec) hierarchy)nullity_filter nullity_sort r?rr-Tc t||||}t||d}|jd}|jd}|j}t j||dft j}gd||d k<|||d k<| tj | | rHtj dd | }| dtj |d}ntj dd}tj |d}n| durtjdd} | }||d|d|d|j|jd|jd|jdd|jdd|jdd|jdd| s| vt3|jdkr^d}|t9t;d||t9|j| ||n|g| r+g}t?|j tBj"krtCj#|j $j%d|j $j%d| j}tCj#|j $j%d|j $j%d| &d}nt?|j tBj'krttCj#|j d|j d| j}tCj#|j d|j d| &d}ntQd  |D]/}|)|j *|0n#tP$rtQd!wxYw|+||,|t[|d"z d#zd$n]|+d|jddz g|,d|jdgt[|d"z d#zd$d%t;d|dz D}|D]}|.|d&d'(| r|/t`1d)}t9t;d|}t9te|j}tg|}ti|}| |} | |}!|d|dt[tjj6ddkr|7dn|8d|jdd|jdd|jdd|jdd|9d|:|||*| rd+}"tw|jd<r|"=}"tw|jd>r|"?}"d}||||z d z zg||"g| |||j|+gn*|g|+g|@|||!f|d z|!ft[|d"z d,zd-d.|@||| f|d z | ft[|d"z d,zd-d.|A|d z |d zg|:|g| gd/|d01|:|g|!gd/|d01|jd|S)2a A matrix visualization of the nullity of the given DataFrame. :param df: The `DataFrame` being mapped. :param filter: The filter to apply to the heatmap. Should be one of "top", "bottom", or None (default). :param n: The max number of columns to include in the filtered DataFrame. :param p: The max percentage fill of the columns in the filtered DataFrame. :param sort: The row sort order to apply. Can be "ascending", "descending", or None. :param figsize: The size of the figure to display. :param fontsize: The figure's font size. Default to 16. :param labels: Whether or not to display the column names. Defaults to the underlying data labels when there are 50 columns or less, and no labels when there are more than 50 columns. :param label_rotation: What angle to rotate the text labels to. Defaults to 45 degrees. :param sparkline: Whether or not to display the sparkline. Defaults to True. :param width_ratios: The ratio of the width of the matrix to the width of the sparkline. Defaults to `(15, 1)`. Does nothing if `sparkline=False`. :param color: The color of the filled columns. Default is `(0.25, 0.25, 0.25)`. :return: The plot axis. filternpcolumnssortaxisrr)dtype)rrr?Nfigsize) width_ratiosg{Gz?)wspaceFzqPlotting a sparkline on an existing axis is not currently supported. To remove this warning, set sparkline=False.none) interpolationautovisibletoprightbottomleft2rotationhafontsize)freqc,|dSNz%Y-%m-%dstrftimets S/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/missingno/missingno.pyzmatrix..f45JJz4J4Jc,|dSr3r4r6s r8r9zmatrix..nr:r;z5Dataframe index must be PeriodIndex or DatetimeIndex.z3Could not divide time index into desired frequency.r)r/r-cg|]}|dzS)r).0xs r8 zmatrix..s===AC===r;-white) linestylecolorr)rFzData Completenesscenter)xyxytextr/var..g$@)rF markersize)Brrshapenotnullvaluesnpzerosfloat32pltfigurerGridSpecupdatesubplotwarningswarnimshow set_aspectgridxaxistick_topset_ticks_positionyaxisspines set_visiblelenr set_xtickslistrangeset_xticklabelstypeindexpd PeriodIndex date_range to_timestampdatemap DatetimeIndexKeyErrorappendget_loc set_yticksset_yticklabelsintaxvlineastypeboolsumreversedminmaxmpl __version__set_axis_bgcolor set_facecolor set_ymarginplotstrislowerlowerisupperupperannotateset_xlim)#dfrrrrrr rFr/labelslabel_rotation sparkliner1axheightwidthzggsax1ax0r.ts_listts_arrayts_ticksvaluein_between_pointcompleteness_srsx_domainy_rangemin_completenessmax_completenessmin_completeness_indexmax_completeness_indexlabels# r8matrixr s| 0 6Q! 4 4 4B bt) 4 4 4B Xa[F HQKE A &%#2:666AAa#gJAa#gJ z 7####  )"1alCCCB IITI " " "+be$$CC"1a((Bk"Q%   E ! ! M?   IJJqJ'''NN6HHUHII  (((I  (((Ju!!%(((Jw##E***Jx$$U+++Jv""5)))&.S__%:%:  tE!UOO,,--- D,,~"W_```` r \ >>R^ + +}RX%:%:%<%<%A!%D%'X%:%:%<%<%A"%E*.00006 }RX%:%:%<%<%A!%D%'X%:%:%<%<%A"%E*.000035K5K1L1L H "(^^r/ / /}RXa["(2,*.00006 }RXa["(2,*.000035K5K1L1L HRSS S R! 8 8rx//667777 8 R R RPQQ Q R w Hs8b=23E/F/FQRSSSS 28A;?+,,, Q ,s8b=2;M7N7NYZ[[[>=q%!))<)<===,DD $7 CCCC@-::<<..t4488a8@@a(())x 0 78899w<<w<<!(/?!@!@!(/?!@!@  v sq! " "a ' '   + + + +   i ( ( ( 5%%e,,, 7''... 8((/// 6&&u---  (%000  'E2:a=!!))++ & 2:a=!!))++ & B NN,0@CS0SWX/XXY Z Z Z   .RRZ  [ [ [ I   NN2     NN2    NN2    %)+AB-13IJ!(R-""455     %)+AB-13IJ!(R-""455   ! ! ! &*,.+ L L LaQR[!1!1 L L Lr;)r/rcNg|]!}t|tz"Sr?rrs r8rBzbar..s+HHH!SSWW--HHHr;)r/r-r.cNg|]!}t|tz"Sr?rrs r8rBzbar..$rr;)r/r.cNg|]!}t|tz"Sr?rrs r8rBzbar..2rr;Fr"r?)"rrreisnullr|rrUgcarbarbarhriget_xticklabelstwinxrtset_ylimrv get_yticksrw set_yscaleget_ylimtwinyrf get_xticksrget_xlimrQ set_xscaler^rcrdr_rarb)rrr/rrrrFrrrrr orientationnullity_countsr plot_argsaxesax2ax3s` r8rrs. 6Q! 4 4 4B bt& 1 1 1BWWryy{{000N rz??R   KK"K zgii ?2:"$$ u(<(< x@W@W"S__ 4r 9S@A##PU]`aaIh+#b'' !'+88i8888,#b'' !',99y999 5DC%&.S__%:%:     ! !NwQY    iikk C ) LL!Q NN3>>++ , , ,    L L L L3>>;K;K L L LW_  ` ` ` ` NN5 ! ! ! LL ( ( ( HHHHs~~7G7GHHHS[\\\iikk C s~~''((( S\\^^$$$   !H~RX     iikk C U LL!Q  NN3>>++ , , ,    L L L L3>>;K;K L L LW_  ` ` ` NN3>>++ , , ,    5V  T T T T NN5 ! ! ! LL ( ( ( NN3>>++ , , ,    L L L L3>>;K;K L L LW_  ` ` ` NN3>>++ , , ,    5V  T T Tiikk C s~~''(((  ) NN5 ! ! ! LL ( ( ( S\\^^$$$HHUOOO,, %$$U+++ '&&u--- (''... &%%e,,, ##F+++ ##F++++ Jr;r= RdBur0c t||||}t||d}| )tj|tj}n| }|jdddt tj| dDf}| }tj |}d|tj |<|r#tj||| || dd |d z i| | ntj||| || | | |j||j|d |||jd||jd|jd|jd|jD]}t3|}d|cxkrdkrnn|dId|cxkrdkrnn|do|dkr|d|dkr|dd|cxkrdkrnn|d|t9|d|S)a Presents a `seaborn` heatmap visualization of nullity correlation in the given DataFrame. Note that this visualization has no special support for large datasets. For those, try the dendrogram instead. :param df: The DataFrame whose completeness is being heatmapped. :param filter: The filter to apply to the heatmap. Should be one of "top", "bottom", or None (default). See `nullity_filter()` for more information. :param n: The cap on the number of columns to include in the filtered DataFrame. See `nullity_filter()` for more information. :param p: The cap on the percentage fill of the columns in the filtered DataFrame. See `nullity_filter()` for more information. :param sort: The column sort order to apply. Can be "ascending", "descending", or None. :param figsize: The size of the figure to display. This is a `matplotlib` parameter which defaults to (20, 12). :param fontsize: The figure's font size. :param labels: Whether or not to label each matrix entry with its correlation (default is True). :param label_rotation: What angle to rotate the text labels to. Defaults to 45 degrees. :param cmap: What `matplotlib` colormap to use. Defaults to `RdBu`. :param vmin: The normalized colormap threshold. Defaults to -1, e.g. the bottom of the color scale. :param vmax: The normalized colormap threshold. Defaults to 1, e.g. the bottom of the color scale. :return: The plot axis. rrrNrc$g|] \}}|dk |S)rr?)r@irs r8rBzheatmap..ts(XXX41aRSVWRWRWQRWRWRWr;rGTsizer)maskcmaprcbarannot annot_kwsvminvmax)rrrrrrr(r,r)r-r/r"Fgffffff?rz<1r0gffffffz>-11z-1gg?)rrrUrVriloc enumeraterRvarrcorr zeros_liketriu_indices_fromsnsheatmapr_ tick_bottomriget_majorticklabelsrwrbrapatchrdtextsfloatget_textset_textround)rrrrrrr/rrrrrrrrcorr_matrtextr7s r8rrOs6 6Q! 4 4 4B bt& 1 1 1B z 7####gii XX9RVBIIKKf-M-M-M#N#NXXXX YByy{{!!H = " "D'+D d # #$ * H4ds68a<*@D * * * * * H4dsD * * * *I %%''.WW_ 5577!hWWWI  (((I  (((I%    ' ' $--// " " 1====q===== MM$     !____u_____ MM% !VV MM#     "WW MM$     Q          MM"     MM%1++ & & & & Jr;averagec 2|sFt|jdks |dks|dkrd}nddt|jzdz dzf}| )tj|tj} n| } t |||| }t j| tj } tj | |} |st|jdkrd }nd}tj| ||jd d || | d| d|dkr| j| jd| jd| jdd| jdd| jdd| jd d| jd|dkr0| | j|d n5|dkr/| | j|d|dks|dkr+| dt|dz dzn*| dt|dz dz| S)a) Fits a `scipy` hierarchical clustering algorithm to the given DataFrame's variables and visualizes the results as a `scipy` dendrogram. The default vertical display will fit up to 50 columns. If more than 50 columns are specified and orientation is left unspecified the dendrogram will automatically swap to a horizontal display to fit the additional variables. :param df: The DataFrame whose completeness is being dendrogrammed. :param method: The distance measure being used for clustering. This is a parameter that is passed to `scipy.hierarchy`. :param filter: The filter to apply to the heatmap. Should be one of "top", "bottom", or None (default). :param n: The cap on the number of columns to include in the filtered DataFrame. :param p: The cap on the percentage fill of the columns in the filtered DataFrame. :param figsize: The size of the figure to display. This is a `matplotlib` parameter which defaults to `(25, 10)`. :param fontsize: The figure's font size. :param orientation: The way the dendrogram is oriented. Defaults to top-down if there are less than or equal to 50 columns and left-right if there are more. :param label_rotation: What angle to rotate the text labels to. Defaults to 45 degrees. :return: The plot axis. r+r'r)rr rNrrr* descendingcdS)Nblackr?)cs r8r9zdendrogram..s'r;)rr distance_sortlink_color_funcleaf_font_sizerr$Fr%r"r()r-r.yrr=)r labelsizerA)rerrUrVrrrR transposerrzrxrQrlinkage dendrogramtolistr]r^r_r`rarbrcrdrrir tick_params) rmethodrrrrrr/rrrrArs r8rrs 0 > rz??b K5$8$8K8rs&######////////JQUYyyyyzU^;?DDDDPQUCGMMMMb[]QQQQQQr;