MhdZddlmZddlZddlZddlmZddlmZddlm Z ddl m Z m Z Gdd e Z dd Z dddZdddZdddZdS)zToken-related utilities) annotationsN)StringIO) iskeyword) TokenInfo) Generator NamedTuplecBeZdZUded<ded<ded<ded<ded<dS) TokeninttokenstrtextstartendlineN)__name__ __module__ __qualname____annotations__W/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/IPython/utils/tokenutil.pyr r s=JJJ IIIJJJ HHH IIIIIrr return Generator[TokenInfo, None, None]c#lK tj|Ed{VdS#tj$rYdSwxYw)z'wrap generate_tkens to catch EOF errorsN)tokenizegenerate_tokens TokenError)readlines rrrsY+H55555555555  s  33extra_errors_to_catchlist[str] | Nonec# Kgd}|t|tsJ||pgz}g} tj|D]}|||VdS#tj$r t fd|Dr^|r6|djd|djdf}|}|dj }ndx}}d}ttj d|||VnYd dSd wwxYw)N)zunterminated string literalzinvalid non-printable characterz!after line continuation characterc36K|]}|jdvVdS)rN)args).0errorexcs r z/generate_tokens_catch_errors..1s.AAu #AAAAAArr)r) isinstancelistrrappendranyrrrr ERRORTOKEN) rr default_errors_to_catcherrors_to_catchtokensr rrrr's @rgenerate_tokens_catch_errorsr4 sa ! (J7Ld,S,S ( ( (-1F1L"MO F-h77  E MM% KKKK        AAAAAAA A A  r (+VBZ^A->>bz$$H/UCFF F F F F  G F F F F F s0AC1,A:C,,C1cellr cursor_posr tuple[str, int]cd}|d}|D]8}|t|z}|ds|dz }||krn|}9d}||fS)aReturn the line in a cell at a given cursor position Used for calling line-based APIs that don't support multi-line input, yet. Parameters ---------- cell : str multiline block of text cursor_pos : integer the cursor position Returns ------- (line, offset): (string, integer) The line with the current cursor, and the character offset of the start of the line. rT r*r+) splitlineslenendswith)r5r6offsetlinesr next_offsets rline_at_cursorr@?s"F OOD ! !E  s4yy( }}T""  1 K  # # E <rcg}g}d}d}ddi}d}d}dtt|jD} | sdStdg| zt j| dgzD]\} \} } | j\} }| j\}}|dz|vrU| j d}t|| dzD]'\}}||vr||dz t|z||<(d}|| }||z|krnJ| j tjkot| j x}r|r8| r6| j tjkr!| jdkr|d d| j|d <n|| j| 7| j tjkr"| jd kr|d d}|s |r|d nd}n`| j tjkrK| jd kr|r||d n"| jd kr|r|d }|||z|kr|| |z|k}n|r |r|d S|r|S|r|d S|r|S|r|d SdS) avGet the token at a given cursor Used for introspection. Function calls are prioritized, so the token for the callable will be returned if the cursor is anywhere inside the call. Parameters ---------- cell : str A block of Python code cursor_pos : int The location of the cursor in the block where the token should be found Nr*rFc g|] }t| Sr)r )r%tups r z#token_at_cursor..xs)"""s """rr+T.r)=())rrrzip itertoolspairwiserrrr: enumerater;r rNAMErrOPr.pop)r5r6names call_namesclosing_call_namemost_recent_outer_nameoffsetsintersects_with_cursorcur_token_is_namer3prev_toktoknext_tok start_line start_colend_lineend_colr>linenorr=s rtoken_at_cursorr_as0EJ$()-!fG""".x~~/FGG"""F r%( +FdVO<<&&55!/3!$  IG' ares"#"""""((((((((J9=>Dfffffffr