.Ph%dZddlZddlZddlZddlZddlZddlmZmZ ddl Z n #e $rdZ YnwxYwej Z ejZeZ ddlZn #e $rdZYnwxYwdZdZdZdZd Zd Zd Zd Zejdd ZddZdZddZdZ dS)zFUtilities for fast persistence of big data, with optional compression.N) _COMPRESSORS _ZFILE_PREFIXicXt|d|}t|tjS)z=Check if fileobj is a raw file object, e.g created with open.raw)getattr isinstanceioFileIO)fileobjs Y/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/joblib/numpy_pickle_utils.py _is_raw_filer&s%gug..G gry ) ))cdtjD}|ttgz }t |S)Nc6g|]}t|jS)lenprefix).0 compressors r z)_get_prefixes_max_len...s#OOO:J%&&OOOr)rvaluesrrmax)prefixess r _get_prefixes_max_lenr,s?OO9L9N9NOOOH ]##$$H x==rctjdko`|jjdkpP|jjdko@|jjo4t d|jjDpptjdko`|jjdkpP|jjdko@|jjo4t d|jjDS)z2Check if numpy array is having byte order mismatchbig<|c38K|]}|djdkVdS)rrN byteorderres r z6_is_numpy_array_byte_order_mismatch..<-SS!!#-SSSSSSrlittle>c38K|]}|djdkVdS)rr(Nr!r#s r r%z6_is_numpy_array_byte_order_mismatch..Fr&r)sysr"dtypefieldsallrarrays r #_is_numpy_array_byte_order_mismatchr03s  K !S (  %,TK&TSSu{7I7P7P7R7RSSSSS  ! K !S (  %,TK&TSSu{7I7P7P7R7RSSSSS#rct|r?||jd}|S)zzUse the byte order of the host while preserving values Does nothing if array already uses the system byte order. =)r0byteswapviewr+ newbyteorderr.s r _ensure_native_byte_orderr6LsG +511E  %%ek&>&>s&C&CDD Lrcht}t|dr||}n*||}|d|t rdStjD]#\}}||j r|cS$dS)zReturn the compressor matching fileobj. Parameters ---------- fileobj: file object Returns ------- str in {'zlib', 'gzip', 'bz2', 'lzma', 'xz', 'compat', 'not-compressed'} peekrcompatnot-compressed) rhasattrr8readseek startswithrritemsr)r max_prefix_len first_bytesnamers r _detect_compressorrCXs+,,Nwll>22 ll>22  Qm,,x , 2 4 4   D*%%j&788     rc8tj|tS)z0Return a buffered version of a read file object. buffer_size)r BufferedReader_IO_BUFFER_SIZEfobjs r _buffered_read_filerKx T ? ? ??rc8tj|tS)z1Return a buffered version of a write file object.rE)r BufferedWriterrHrIs r _buffered_write_filerO}rLrc#TKt|}|}|dkr'tjd|ztd||fVdS|tvr1t|}||}t |}|d}t|tj r&tjdtzdnc|dkr&tjdtzdn7t|s&tjd tzdn|}||fVdS) aUtility function opening the right fileobject from a filename. The magic number is used to choose between the type of file object to open: * regular file object (default) * zlib file object * gzip file object * bz2 file object * lzma file object (for xz and lzma compressor) Parameters ---------- fileobj: file object filename: str filename path corresponding to the fileobj parameter. mmap_mode: str memory map mode that should be used to open the pickle file. This parameter is useful to verify that the user is not trying to one with compression. Default: None. Returns ------- a tuple with a file like object, and the validated mmap_mode. r9zjThe file '%s' has been generated with a joblib version less than 0.10. Please regenerate this pickle file.) stacklevelNzuIn memory persistence is not compatible with mmap_mode "%(mmap_mode)s" flag passed. mmap_mode option will be ignored.r:ztmmap_mode "%(mmap_mode)s" is not compatible with compressed file %(filename)s. "%(mmap_mode)s" flag will be ignored.zP"%(fileobj)r" is not a raw file, mmap_mode "%(mmap_mode)s" flag will be ignored.) rCwarningswarnDeprecationWarningrdecompressor_filerKr r BytesIOlocalsr)r filename mmap_modervalidated_mmap_modecompressor_wrapperinsts r _validate_fileobject_and_memmapr^s6$G,,J#X   24< =      +++++++  % %".j!9 %77@@D)$//G  "& '2:.. 0 8:@((C !  /// <>DhhG !  "'** 0 <>DhhG  '0#*******rzlibc|d}|d}|tjvr1t|||}t|Std||}t|S)z6Return the right compressor file object in write mode.rr) compresslevelr`)rkeyscompressor_filerO)rYcompresscompressmethodrc file_instances r _write_fileobjectrisa[NQKM*,,,,$^4DD ME  $M222$V,<< M=  $M222riran out of datacdt} ||t|z }||z }t|dkst||krnn#tj$rYnwxYwit||kr$d}t |||t|fz|S)aRead from file-like object until size bytes are read. TODO python2_drop: is it still needed? The docstring mentions python 2.6 and it looks like this can be at least simplified ... Raises ValueError if not EOF is encountered before size bytes are read. Non-blocking objects only supported if they derive from io objects. Required as e.g. ZipExtFile in python 2.6 can return less data than requested. This function was taken from numpy/lib/format.py in version 1.10.2. Parameters ---------- fp: file-like object size: int error_template: str Returns ------- a bytes object The data read in bytes. Trz)EOF: reading %s, expected %d bytes got %d)bytesr<rr BlockingIOError ValueError)fpsizeerror_templatedatarmsgs r _read_bytesrus4 77D  s4yy())A AID1vv{{c$ii4//0!    D   4yyD9c$ii@@AAA sAA##A54A5cltjdd}|dkrddlm}n |dkrddlm}||i|S)NrQz1.r) _reconstructz2.)np __version__numpy.core.multiarrayrwnumpy._core.multiarray)argskwargsnp_major_versionnp_reconstructs r rwrwsg ~bqb)4HHHHHHH T ! !IIIIII >4 *6 * **r)N)r_)rj)!__doc__ contextlibr pickler*rSrrrnumpyrx ImportError _Unpickler Unpickler_PicklerPicklerrangexrangebz2rHrrr0r6rCrKrOcontextmanagerr^ri BUFFER_SIZErurwrrr rsLL  33333333 BBB   /  JJJJ CCC*** 2@@@@ @@@  M+M+M+M+`3333( ****Z + + + + +s%//AAA