.Ph!dZddlZddlZddlZddlZddlmZddlmZm Z m Z m Z dZ dZ ee dZd Zd Zdd ZGd d eZGddeZGdde ZdZdS)z%Numpy pickle compatibility functions.N)BytesIO) _ZFILE_PREFIX Unpickler_ensure_native_byte_order _reconstructc,d|S)z(Convert an int to an hexadecimal string.z{:#x})format)an_ints Z/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/joblib/numpy_pickle_compat.pyhex_strr s >>& ! !!cZt|tr|S|dS)Nlatin1) isinstancebytesencode)ss r asbytesrs+!U 88H  rlic|dtttz}||}|ttd}t |d}|d}|dkr||t j|d|}t||ks Jd|z|S)zRead the z-file and return the content as a string. Z-files are raw data compressed with zlib used internally by joblib for persistence. Backward compatibility is not guaranteed. Do not use for external purposes. rNr zIIncorrect data length while decompressing %s.The file could be corrupted.)seeklenr_MAX_LENreadintzlib decompress) file_handle header_lengthlength next_bytedatas r read_zfiler& sQ &&1M   m , ,F C &&(( )F __F  ##ID ''' ?;++--r6 : :D t99    ')4 5    KrcP|ttt|}|t |t |tjt ||dS)zWrite the data in the given file as a Z-file. Z-files are raw data compressed with zlib used internally by joblib for persistence. Backward compatibility is not guaranteed. Do not use for external purposes. N) writerr rrljustrrcompress)r!r%r*r#s r write_zfiler+Bsm$$$ SYY  Fgfll84455666dmGDMM8<<=====rc eZdZdZddZdZdS)NDArrayWrapperzAn object to be persisted instead of numpy arrays. The only thing this object does, is to carry the filename in which the array has been persisted, and the array subclass. Tc0||_||_||_dSz4Constructor. Store the useful information for later.N)filenamesubclass allow_mmap)selfr0r1r2s r __init__zNDArrayWrapper.__init__[s    $rctj|j|j}t |dd}i}|r |j|d<dtj|j j j vrd|d<|j j |fi|}t|}t|drJ|j|j j|j jfvr+t#|jdd}||S|S)zReconstruct the array.r2T mmap_mode allow_pickle__array_prepare__)rb)ospathjoin_dirnamer0getattrr6inspect signaturenpload parametersrhasattrr1ndarraymemmaprr8)r3 unpicklerr0r2kwargsarray new_arrays r rzNDArrayWrapper.readas7<< 2DMBBT<66   6"+"5F;  W.y|/@AAL L L&*F> "! !(55f55*%00 5- . . 4= L L I 4 4 %T]D#>>I..u55 5LrN)T__name__ __module__ __qualname____doc__r4rrr r-r-TsA %%%% rr-ceZdZdZdZdZdS)ZNDArrayWrapperaTAn object to be persisted instead of numpy arrays. This object store the Zfile filename in which the data array has been persisted, and the meta information to retrieve it. The reason that we store the raw buffer data of the array and the meta information, rather than array representation routine (tobytes) is that it enables us to use completely the strided model to avoid memory copies (a and a.T store as fast). In addition saving the heavy information separately can avoid creating large temporary buffers when unpickling data with large arrays. c0||_||_||_dSr/)r0state init_args)r3r0rUrTs r r4zZNDArrayWrapper.__init__s   "rc$tj|j|j}t |j}t|d5}t|}dddn #1swxYwY|j |fz}| ||S)z?Reconstruct the array from the meta-information and the z-file.rbN) r:r;r<r=r0rrUopenr&rT __setstate__)r3rGr0rIfr%rTs r rzZNDArrayWrapper.reads7<< 2DMBBdn- (D ! ! !Qa==D ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! dW$ 5!!! s A%%A),A)NrKrPrr rRrRs<  ###     rrRcxeZdZdZejZddZdZdZ e ee j d<dS)ZipNumpyUnpicklerz:A subclass of the Unpickler to unpickle our numpy pickles.NcJtj||_tj||_||_|||_tj ||j ddl }n#t$rd}YnwxYw||_ dS)z Constructor.rN)r:r;basename _filenamedirnamer=r6 _open_pickler!rr4numpy ImportErrorrA)r3r0r!r6rAs r r4zZipNumpyUnpickler.__init__s))(3311 ",,[994!1222         BBB sB BBc:tt|SN)rr&)r3r!s r razZipNumpyUnpickler._open_picklesz+..///rc.tj|t|jdtr`|jt d|j}||}|j |dSdS)zSet the state of a newly created object. We capture it to replace our place-holder objects, NDArrayWrapper, by the array we are interested in. We replace them directly in the stack of pickler. Nz@Trying to unpickle an ndarray, but numpy didn't import correctly) r load_buildrstackr-rArcpoprappend)r3nd_array_wrapperrIs r rhzZipNumpyUnpickler.load_builds T""" djnn 5 5 %w!V $z~~// $))$//E J  e $ $ $ $ $ % %rrre) rLrMrNrOrdispatchcopyr4rarhpickleBUILDrPrr r\r\snDD!&&((H    000%%%"!+HV\!_rr\ct|d5}t||} |}n*#t$r}t d}||_|d}~wwxYw t |dr|jn/#t |dr|jwwxYw|cdddS#1swxYwYdS)a&Reconstruct a Python object from a file persisted with joblib.dump. This function ensures the compatibility with joblib old persistence format (<= 0.9.3). Parameters ---------- filename: string The name of the file from which to load the object Returns ------- result: any Python object The object stored in the file. See Also -------- joblib.dump : function to save an object Notes ----- This function can load numpy array files saved separately during the dump. rW)r!zyYou may be trying to read with python 3 a joblib pickle generated with python 2. This feature is not supported by joblib.Nr!) rXr\rBUnicodeDecodeError ValueError __cause__rDr!close)r0r!rGobjexcnew_excs r load_compatibilityrysH4 h   &hKHHH  ...""CC!    ;G !$G M  y-00 .%++---y-00 .%++---- .)sCC 9B A AA  B$*C ,B::C  CC)r)rOr?r:roriornumpy_pickle_utilsrrrrr rrr _CHUNK_SIZEr&r+objectr-rRr\ryrPrr r~sw++ """  3wwu~~   D > > > >$*****V***ZnD&+&+&+&+&+ &+&+&+R.....r