Mhi.dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z ddl m Z mZddlmZmZddlmZddlmZmZmZmZmZddlZddlmZdd lmZdd lmZdZd Z d Z!Gd dZ"GddZ#GddeZ$dS)z.Wrappers for forwarding stdout/stderr over zmqN)b2a_hex) defaultdictdeque)StringIO TextIOBase)local)AnyCallableDequeDictOptional)extract_header)IOLoop) ZMQStreamiceZdZdZddZdZdZdZdZe dZ d Z d Z d Z d Zd ZdZdZdZdZe dZdZdZdZdS) IOPubThreadaAn object for sending IOPub messages in a background thread Prevents a blocking main thread from delaying output from threads. IOPubThread(pub_socket).background_socket is a Socket-API-providing object whose IO is always run in a thread. FcV||_d|_t||_t j|_||_td|_ |r| tj |_ t|_i|_tj|_d|_d|_|tj|jd|_d|j_d|j_d|j_d|j_dS)aCreate IOPub thread Parameters ---------- socket : zmq.PUB Socket the socket on which messages will be sent. pipe : bool Whether this process should listen for IOPub messages piped from subprocesses. F) make_current NIOPub)targetnameT)socket_stoppedBackgroundSocketbackground_socketosgetpid _master_pid _pipe_flagrio_loop_setup_pipe_in threadingr_localr_events _event_pipesLock_event_pipe_gc_lock_event_pipe_gc_seconds_event_pipe_gc_task_setup_event_pipeThread _thread_mainthreaddaemonpydev_do_not_traceis_pydev_daemon_threadr)selfrpipes R/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/ipykernel/iostream.py__init__zIOPubThread.__init__1s  !1$!7!79;;5111  "    ! ! !o'' 27'' 9;3<>3C3C -/#@D     &d.?gNNN ! )- &-1 *" cJfd}j|jsjj@fd}jsj|njjddS)z.The inner loop that's actually run in a threadc^tj_dSN)asyncio ensure_future_run_event_pipe_gcr+r3sr5_start_event_gcz1IOPubThread._thread_main.._start_event_gcTs('.'KjdSr:)r+cancelr>sr5_cancelz)IOPubThread._thread_main.._cancel`s"(//11111r7T)all_fds)r"run_syncrstartr+rAclose)r3r?rBs` r5r.zIOPubThread._thread_mainQs X X X X X o...} ! L    # / 2 2 2 2 2= 2 %%g....(//111 4(((((r7c|jj}|tj}d|_t t jdd}d|zx}|_ | |t||j |_ |j |jdS)zLCreate the PULL socket listening for events that should fire in this thread.rasciiz inproc://%sN)rcontextzmqPULLlingerrrurandomdecode_event_interfacebindrr" _event_pulleron_recv _handle_event)r3ctxpipe_in_uuidifaces r5r,zIOPubThread._setup_event_pipejsk!**SX&& 2''..w77(5(==% U&w == ""4#566666r7cK tj|jd{V |d{Vn5#t$r(}t d|t jYd}~nd}~wwxYwq)z&Task to run event pipe gc continuouslyTNz)Exception in IOPubThread._event_pipe_gc: file)r;sleepr*_event_pipe_gc Exceptionprintsys __stderr__)r3es r5r=zIOPubThread._run_event_pipe_gcvs \- ;<< < < < < < < < \))++++++++++ \ \ \E!EECN[[[[[[[[[ \  \s? A1 A,,A1cK|jsdS|j5t|jD]5\}}|s||j|=6 ddddS#1swxYwYdS)z.run a single garbage collection on event pipesN)r'r)listitemsis_aliverF)r3r/rs r5r]zIOPubThread._event_pipe_gcs   F  % 2 2"&t'8'>'>'@'@"A"A 2 2((2LLNNN)&1 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2sAA>>BBcf |jj}n#t$r|jj}|t j}d|_||j ||j_|j 5||j tj <dddn #1swxYwYYnwxYw|S)zSthread-local event pipe for signaling events that should be processed in the threadrN)r% event_pipeAttributeErrorrrJrKPUSHrMconnectrPr)r'r$current_thread)r3rhrUs r5 _event_pipezIOPubThread._event_pipes  K/JJ K K K+%CCH--J !J    t4 5 5 5%/DK ") K K@J!)":"<"<= K K K K K K K K K K K K K K K Ks4 A)B.8B  B. B$ $B.'B$ (B.-B.ct|j}t|D]%}|j}|&dS)zHandle an event on the event pipe Content of the message is ignored. Whenever *an* event arrives on the event stream, *all* waiting events are processed in order. N)lenr&rangepopleft)r3msgn_events_event_fs r5rTzIOPubThread._handle_eventsRt|$$x  Al**,,G GIIII  r7c|jj}tjd|_|t j}d|_ |d|_ nT#t j $rB}tj d|zdzdd|_ |Yd }~d Sd }~wwxYwt||j|_|j|jd S) z7setup listening pipe for IOPub from forked subprocessesrHrztcp://127.0.0.1z)Couldn't bind IOPub Pipe to 127.0.0.1: %sz' subprocess output will be unavailable. stacklevelFN)rrJrrN _pipe_uuidrKrLrMbind_to_random_port _pipe_portZMQErrorwarningswarnr!rFrr"_pipe_inrS_handle_pipe_msg)r3rUrVrbs r5r#zIOPubThread._setup_pipe_insk!*R..**SX&& %99:KLLDOO|    M;a?<=     $DO MMOOO FFFFF "'4<88  d344444s A((B977B44B9c|jr|sdS|d|jkrtd|tjdS||dddS)z'handle a pipe message from a subprocessNrzBad pipe message: %srZr)r!_is_master_processrzr_r`rasend_multipartr3rrs r5rzIOPubThread._handle_pipe_msgst d&=&=&?&?  F q6T_ $ $ (#CN C C C C F CG$$$$$r7ctj}|tj}d|_|d|jz||fS)Ni ztcp://127.0.0.1:%i)rKContextrrjrMrkr|)r3rUpipe_outs r5_setup_pipe_outzIOPubThread._setup_pipe_outsMkmm::ch''-?@@@H}r7c:tj|jkSr:rrr r>s r5rzIOPubThread._is_master_processy{{d...r7cT|jr|rtStS)z8check for forks, and switch to zmq pipeline if necessary)r!rMASTERCHILDr>s r5_check_mp_modezIOPubThread._check_mp_modes) $"9"9";"; M r7cd|j_|jtj|jdS)zStart the IOPub threadrN)r/rrEatexitregisterstopr>s r5rEzIOPubThread.starts:"    """""r7cd|_|jsdS|j|jj|jd|jrd}t||j D]\}}| dS)zStop the IOPub threadTN)timeoutz,IOPub thread did not terminate in 30 seconds) rr/rfr" add_callbackrjoin TimeoutErrorr'rerF)r3rr_threadrhs r5rzIOPubThread.stops {##%%  F !!$,"3444 $$$ ;   ! ! $@Cs## #$(#4#:#:#<#<   GZ         r7cX|jrdS|jd|_dS)zClose the IOPub thread.N)closedrrFr>s r5rFzIOPubThread.closes0 ;  F  r7c|jduSr:)rr>s r5rzIOPubThread.closeds{d""r7c|jr6|j||jddS|dS)ztSchedule a function to be called in our IO thread. If the thread is not running, call immediately. r7N)r/rfr&appendrmsend)r3fs r5schedulezIOPubThread.schedules\ ;   ! !  L   " " "   ! !# & & & & & ACCCCCr7c@fddS)zsend_multipart schedules actual zmq send in my thread. If my thread isn't running (e.g. forked process), send immediately. cjiSr:) _really_send)argskwargsr3sr5z,IOPubThread.send_multipart..s/d/@@@r7N)rr3rrs```r5rzIOPubThread.send_multiparts/ @@@@@@AAAAAr7c6|jrdS|}|tkr|jj|g|Ri|dS|\}}|j|jg|g|Ri|||dS)z)The callback that actually sends messagesN) rrrrrrrzrFterm)r3rrrrmp_moderUrs r5rzIOPubThread._really_sends ;  F%%'' e   &DK &s Wrapper around IOPub thread that provides zmq send[_multipart]Nc||_dS)zInitialize the socket.N) io_thread)r3rs r5r6zBackgroundSocket.__init__/s "r7c|dr6|dr!t||jJt |jj|r($ / / 8 M1$11*.11#     4>0$77 7ww""4(((r7c<|dks*|dr9|dr$t||dSt jd|d|t d|jJt|jj ||dS)zSet an attribute on the socket.rrzSetting zmq Socket attribute rrwrxN) rrr __setattr__r~rrrsetattrr)r3rvaluers r5rzBackgroundSocket.__setattr__Ds ;  4??4#8#8 T]]4=P=P  GG  e , , , , , M111*.11#     >--- DN)4 7 7 7 7 7r7c&|j|gg|Ri|S)zSend a message to the socket.)r)r3rrrrs r5rzBackgroundSocket.sendSs'"t"C5:4:::6:::r7c8|jJ|jj|i|S)zSchedule send in IO thread)rrrs r5rzBackgroundSocket.send_multipartWs*~))),t~,d=f===r7) rrrrrr6rrrr __classcell__)rs@r5rr*sHHI###)))))" 8 8 8 8 8;;;>>>>>>>r7rc0eZdZUdZdZdZdZdZdZe e e d<dZ dZ d"d d d d Zed ZejdZdZdZdZdZdZedZdZdZdZdede efdZdZdZdZ dZ!edZ"d Z#d!Z$dS)# OutStreamzpA file like object that publishes the stream to a 0MQ PUB socket. Output is handed off to an IO Thread rg?NzUTF-8_excc^t|dd|jSd}tj|)z^ Things like subprocess will peak and write to the fileno() of stderr/stdout. _original_stdstream_copyNfileno)rrioUnsupportedOperationrs r5rzOutStream.filenols6 43T : : F0 0%c***r7c tj|jt}|rt|jrq||dtj|j|tj|jt}|r |jkdSdSdSdS#t$rtj |_ YdSwxYw)aj We've redirected standards streams 0 and 1 into a pipe. We need to watch in a thread and redirect them to the right places. 1) the ZMQ channels to show in notebook interfaces, 2) the original stdout/err, to capture errors in terminals. We cannot schedule this on the ioloop thread, as this might be blocking. replace)errorsN) rread_fidPIPE_BUFFER_SIZE _should_watchwriterOrr^r`exc_infor)r3btss r5_watch_pipe_fdzOutStream._watch_pipe_fdus ''$)%566C ;$, ; 3::Y:778886<<<gdi)9:: ;$, ; ; ; ; ; ; ; ; ; ' ' ' DIIII 'sBB"CCTF)watchfdisattyc:|tjdtd||_t |t sBtjd|ztdt |}|||_||_d| z|_ tj d|_ |j ii|_i|_i|_t%j|_d|_d|_|j|_t3j|_t9t:|_d|_tA||_!d|_"tG|_$|rLtJj&'d stJj&'d rd t$j(vs|d krd |_"|)||rtU|drtU|drq|j"ra |+}n#tX$rd}YnwxYw|7||j-kr,t]j/t]j0|j1d}||_dSd} te| dS)a Parameters ---------- session : object the session object pub_thread : threading.Thread the publication thread name : str {'stderr', 'stdout'} the name of the standard stream to replace pipe : object the pipe object echo : bool whether to echo output watchfd : bool (default, True) Watch the file descriptor corresponding to the replaced stream. This is useful if you know some underlying code will write directly the file descriptor by its number. It will spawn a watching thread, that will swap the give file descriptor for a pipe, read from the pipe, and insert this into the current Stream. isatty : bool (default, False) Indication of whether this stream has terminal capabilities (e.g. can handle colors) NzKpipe argument to OutStream is deprecated and ignored since ipykernel 4.2.3.rwrxzISince IPykernel 4.3, OutStream should be created with IOPubThread, not %rsstream. parent_headerFlinuxdarwinPYTEST_CURRENT_TESTforceTrrwz(echo argument must be a file-like object)3r~rrsession isinstancerrE pub_threadrencodetopic contextvars ContextVar_parent_headerset_thread_to_parent_thread_to_parent_header_parent_header_globalrrr _flush_pending_subprocess_flush_pendingr"_io_loopr$RLock _buffer_lockrr_buffersechobool_isattyrrr%r`platformrenviron_setup_stream_redirectsrrr^_original_stdstream_fdr TextIOWrapperFileIOr ValueError) r3rrrr4rrrecho_fdrrs r5r6zOutStream.__init__sD   M]"      *k22  M&(23"      %Z00J      $ $++--/ FQF\ G G  ###!#(*%%'"9;;#).&"* %O--#H--  F|| "gg   /((11 /69\5L5LX5V5V / +"*<<'!!!%D   ( ( . . .  &tV$$ &w)?)? &%'"&++--$'''"&'*w$:U/U/U "/I $ = #   ! @ oo%- & &s!H66 IIc |jS#t$ra tjj}||jvr|j|}||jv|j|cYS#t$r |j cYcYSwxYwwxYwr:) rget LookupErrorr$rlidentrrKeyErrorr)r3identitys r5rzOutStream.parent_headers 2&**,, , 2 2 2 2$355;$"888#5h?H$"8884X>>>> 2 2 2111111 2 2s- BAA,)B,B=BBBcD||_|j|Sr:)rrr)r3rs r5rzOutStream.parent_header s!%*""&&u---r7c|jS)zpReturn a bool indicating whether this is an 'interactive' stream. Returns: Boolean )rr>s r5rzOutStream.isattys |r7ctj\}}tt|x}|_tj||_tj||||_ d|_ tj |j |_d|j_|jdS)N)rT)rr4rr`rrduprdup2rrr$r-rwatch_fd_threadr0rE)r3rprpwfnos r5rz!OutStream._setup_stream_redirectssB,3C,>,>,E,E,G,GGd)(*s % C  (/t7JKKK&*# ""$$$$$r7c:tj|jkSr:rr>s r5rzOutStream._is_master_process&rr7c.t||_dS)zSet the parent header.N)rr)r3parents r5 set_parentzOutStream.set_parent)s+F33r7cV|jrrd|_tj|jd|jtj|j|jtj|j|j r!|j \}}}tj |||d|_ dS)zClose the stream.FN) rrrrrrr rrFr tracebackprint_exceptionr)r3etypertbs r5rFzOutStream.close-s   4!&D  HT0% 8 8 8  % % ' ' ' GD143N O O O HT2 3 3 3 9 8#y E5"  %eUB 7 7 7r7c|jduSr:)rr>s r5rzOutStream.closed=s$&&r7cfjrdSd_fd}j|dS)zuschedule a flush in the IO thread call this on write, to indicate that flush should be called soon. NTcRjjjdSr:)r call_laterflush_interval_flushr>sr5_schedule_in_threadz6OutStream._schedule_flush.._schedule_in_threadKs& M $ $T%8$+ F F F F Fr7)rrr)r3r"s` r5_schedule_flushzOutStream._schedule_flushAsZ    F" G G G G G   !455555r7c|jr|jj|jjr|jjjt jjkr|j|jt j}|j|j | |j stdtjdSdS|dS)zStrigger actual zmq send send will happen in the background thread NzIOStream.flush timed outrZ)rr/rfrr$rlrr!Eventrwait flush_timeoutr_r`ra)r3evts r5flushzOutStream.flushPs O &2&//113&, 0H0J0J0PPP O $ $T[ 1 1 1/##C O $ $SW - - -88D.// G0s~FFFFFF G G KKMMMMMr7c:d|_d|_|jc |jnH#t$r;}|jt jurtd|t jYd}~nd}~wwxYw|D]\}}|rtj |j _ |j |d}|j d||}|jD]}||}|dS|j |j||jdS) zThis is where the actual send happens. _flush should generally be called in the IO thread, unless the thread has been destroyed (e.g. forked subprocess). FNzFlush failed: rZ)rtextstream)r)r)rrrr)OSErrorr`rar__flush_buffersrrrpidrrr_hooksrrr)r3rbrdatacontentrrhooks r5r!zOutStream._flushhs^ $).& 9  E !!!! E E E9CN22.1..S^DDDD E!//11  LFD $&9;;  #'9d;;l&&x&HH !KD$s))C{# !!O*"#  s1 A61A11A6stringreturnc|j}t|ts!dt|}t ||jd |j|nH#t$r;}|jtj urtd|tj Yd}~nd}~wwxYw|j d}t|| }|j5|jt!||dddn #1swxYwY|r0|jrdSd|_|j |jn|t-|S)zWrite to current stream after encoding if necessary Returns ------- len : int number of items from input parameter written to stream. z"write() argument must be str, not NzWrite failed: rZI/O operation on closed fileT)rrstrtype TypeErrorrrr-r`rar_rrrrr frozensetrerrr!r#ro)r3r4rrrrbis_childs r5rzOutStream.writes#&#&& !EtF||EECC.. 9  E '''' E E E9CN22.1..S^DDDD E ? "0CS// !..000   C C M)FLLNN33 4 : :6 B B B C C C C C C C C C C C C C C C  #- t-1D * O $ $T[ 1 1 1 1  " " "6{{s+A!! B&+1B!!B&AD))D-0D-cj|jd}t||D]}||dS)zWrite lines to the stream.Nr7)rrr)r3sequencerrr4s r5 writelineszOutStream.writelinessI ? "0CS// !  F JJv      r7cdS)z$Test whether the stream is writable.Trr>s r5writablezOutStream.writablestr7c#K|}|D]@\}}|}|t ||fVAdS)zs r5r0zOutStream._hookss+t{G,, # "DK {  r7c:|j|dS)a Registers a hook with the thread-local storage. Parameters ---------- hook : Any callable object Returns ------- Either a publishable message, or `None`. The hook callable must return a message from the __call__ method if they still require the `session.send` method to be called after transformation. Returning `None` will halt that execution path, and session.send will not be called. N)r0rr3r3s r5 register_hookzOutStream.register_hooks " 4     r7c^ |j|dS#t$rYdSwxYw)aB Un-registers a hook with the thread-local storage. Parameters ---------- hook : Any callable object which has previously been registered as a hook. Returns ------- bool - `True` if the hook was removed, `False` if it wasn't found. TF)r0removerrNs r5unregister_hookzOutStream.unregister_hooksD  K  t $ $ $4   55 s  ,,)NN)%rrrrr'r rencodingrr r __annotations__rrr6rrsetterrrrrrFrr#r)r!r8intrr?rAr.rCr0rOrRrr7r5rr]sMN EHD(3-+++'''6  l&l&l&l&l&l&\22X2$... % % %///444 ''X' 6 6 60%%%N)C)HSM))))V,,,!!X! !!!&r7r)%rr;rrrrr`r$rr~binasciir collectionsrrrrrtypingr r r r r rKjupyter_client.sessionrtornado.iolooprzmq.eventloop.zmqstreamrrrrrrrrr7r5r]s44   ********########77777777777777 111111!!!!!!------  D0>0>0>0>0>0>0>0>fddddd dddddr7