MhdZddlZddlZddlmZ ddlmZmZmZm Z m Z m Z m Z ddl mZn#e$rddlmZmZmZmZm Z m Z m Z m Z YnwxYwddlmZmZejded efd Zd Zeefd ZddZeefdZddZdS)z*serialization utilities for apply messagesN)chain) CannedObjectcan can_sequenceistypesequence_typesuncanuncan_sequence)PICKLE_PROTOCOL)r rrrrrr r ) MAX_BYTES MAX_ITEMSzHipykernel.serialize is deprecated. It has moved to ipyparallel.serialize) stacklevelc>g}t|tr|jr~t|jD]i\}}t ||kr d|j|<||8t|t r||j|<j|S)z/extract buffers larger than a certain thresholdN) isinstancerbuffers enumeratelenappend memoryviewtobytes)obj thresholdribufs S/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/ipykernel/serialize.py_extract_buffersr0sG#|$$ / / ,, / /FAs3xx)##!% As####C,, /!$ A Nct|tr@|jr;t|jD](\}}||d|j|<%dSdSdS)zrestore buffers extracted byNr)rrrrpop)rrrrs r_restore_buffersr!@ss#|$$00 ,, 0 0FAs{!(Q A0000 0 0rc~g}t|trKt||kr8t|}|D]%}|t ||&nt|t ret||krRi}t|D]?}t||}|t |||||<@n2t|}|t ||| dtj |t|S)a Serialize an object into a list of sendable buffers. Parameters ---------- obj : object The object to be serialized buffer_threshold : int The threshold (in bytes) for pulling out data buffers to avoid pickling them. item_threshold : int The maximum number of items over which canning will iterate. Containers (lists, dicts) larger than this will be pickled without introspection. Returns ------- [bufs] : list of buffers representing the serialized object. r) rrrrextendrdictsortedrinsertpickledumpsr )rbuffer_thresholditem_thresholdrcobjcks rserialize_objectr.Hs;&G c>"" As3xx.'@'@C   B BA NN+A/?@@ A A A A B T  As3xx.88  ACF A NN+A/?@@ A A ADGG  3xx'.>??@@@ NN1fl499::: Nrc:t|}|d}tj|}t |t r>t |tkr&|D]}t||t||}nt |trXt |tkr@i}t|D]-}||}t||t||||<.n t||t||}||fS)a"reconstruct an object serialized by serialize_object from data buffers. Parameters ---------- buffers : list of buffers/bytes g : globals to be used when uncanning Returns ------- (newobj, bufs) : unpacked object, and the list of remaining unused buffers. r) listr r'loadsrrrr r!r r$r%r )rgbufspobjcannedr,newobjr-s rdeserialize_objectr7ns ==D 88A;;D \$  F fn%% "#f++ *A*A & &A Q % % % %**   "#f++ "9"9 $ $Aq A Q % % %a F1II $ &&&vq!! 4<rc^ttjfd|D}t}ttjfd|D}t t |t ||}tjt|tg} | tj|t| || || S)apack up a function, args, and kwargs to be sent over the wire Each element of args/kwargs will be canned for special treatment, but inspection will not go any deeper than that. Any object whose data is larger than `threshold` will not have their data copied (only numpy arrays and bytes/buffers support zero-copy) Message will be a list of bytes/buffers of the format: [ cf, pinfo, , ] With length at least two + len(args) + len(kwargs) c3:K|]}t|VdSNr.).0argr)r*s r z%pack_apply_message..s2ddX[,S2BNSSddddddrc3FK|]}t|VdSr:r;)r<keyr)r*kwargss rr>z%pack_apply_message..sF  PS VC[*:N K K      r)nargs narg_bufskw_keys) r0r from_iterabler%keysr$rr'r(rr rr#) fargsrAr)r*arg_bufsrD kwarg_bufsinfomsgs ``` rpack_apply_messagerMs&  ddddd_cdddddHV[[]]##G       W^     J c$ii3x==' J J JD <A 0 0 1CJJv|D/22333JJxJJz JrTct|}t|dks Jd|d}tt j||}|d}t j|}|d|d||dd}}g} t |dD]*} t||\} }| | +t| } |r Jdi} |dD]}t||\}}|| |<|r Jd || | fS) zdunpack f,args,kwargs from buffers packed by pack_apply_message() Returns: original f,args,kwargsrznot enough buffers!rNrCrBz#Shouldn't be any arg bufs left overrDz%Shouldn't be any kwarg bufs left over) r0rr r r'r1ranger7rtuple)r3r2copypfrGpinforKrIrJ args_list_r=rHrAr@kwargs runpack_apply_messagerWs\ ::D t99>>>0>>> !B fl2""A HHQKKE <  D 3${"3 34d4 ;L;N;N6OjHI 4= ! !*8Q77 X   D>>>>>> FI.z1==zs BBBBBB dF?rr:)NT)__doc__r'warnings itertoolsripyparallel.serialize.canningrrrrrr r ipyparallel.serialize.serializer ImportErroripykernel.pickleutiljupyter_client.sessionr r warnDeprecationWarningrr!r.r7rMrWrrrcs00  @??????                          87777777  N%.     000,5Y####L@:CS\""""Js+AA