-Ph3dZddlZejeeeeddlmZddlmZmZm Z eZ GddZ dS) z3 Python Lexical Analyser Scanning an input stream N)BOLEOLEOF NOT_FOUND)Errors)rrrczeZdZdZddZdZdZdZdZd Z d Z d e fd Z d Z dZddZdZedZdS)Scannera A Scanner is used to read tokens from a stream of characters using the token set specified by a Plex.Lexicon. Constructor: Scanner(lexicon, stream, name = '') See the docstring of the __init__ method for details. Methods: See the docstrings of the individual methods for more information. read() --> (value, text) Reads the next lexical token from the stream. position() --> (name, line, col) Returns the position of the last token read using the read() method. begin(state_name) Causes scanner to change state. produce(value [, text]) Causes return of a token value to the caller of the Scanner. Ncd|_d|_d|_d|_d|_d|_d|_d|_d|_d|_ d|_ ||_ ||_ ||_ g|_d|_|dd|_d|_d|_t$|_d|_||d|d c|_|_dSdS)a Scanner(lexicon, stream, name = '') |lexicon| is a Plex.Lexicon instance specifying the lexical tokens to be recognised. |stream| can be a file object or anything which implements a compatible read() method. |name| is optional, and may be the name of the file being scanned or any other identifying string. rr r)r rrN)tracebuffer buf_start_posnext_poscur_poscur_line start_poscurrent_scanner_position_tuplelast_token_position_tupletext state_namelexiconstreamnamequeue initial_statebegincur_line_startrcur_char input_state)selfrrr initial_poss T/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/Cython/Plex/Scanners.py__init__zScanner.__init__Js     .8+)3&     ! 2     "1::;;;;!33 t1123D&> !|t~--=C''NN$$$=(DMS,@,@%:*4AA Ar&c |j}|j}|j}|j}|j}|j}|j}|j}|j} t|} d\} } } }}}}|j } |r)td|d||t|fz|d}||||||||f\} } } }}}}|}| |t}|tur|o| d}|r|rtd|dz|}|dkr|}|| z }|| kr||}|dz }no|j| z }|jd }|j|d|z}||_| |z } | |_t|} ||z}|r||}|dz }nd }|d kr t$}d }nn|s t$}d }nb|}n_|d krd }d}nT|dkr|dz }|x}}t&}d}n;|d kr t(}d}n+d }n(|rtd| | | | ||||f\}}}}}}}nd}n||_||_||_||_||_||_|r|td|z|S)z; Inlined version of run_machine for speed. )Nrrrr rrrzState %d, %d/%d:%s -->numberr,NelsezState %dir  r blockedzDoing %s)rrrrr r!rrrlenrr<reprgetrrrr/rrr)r"staterrrr r!rrrbuf_lenb_action b_cur_pos b_cur_lineb_cur_line_start b_cur_char b_input_state b_next_posrr,c new_state buf_indexdiscarddatas r$r;zScanner.run_machine_inlineds`(%)\&*m,0,?=#'#3 &*mk+/+= %([[ $ a)Z)9:}V`"ZM  L.(O['4>>2KKLLL8_F!GX~xV^^i)Z1A:}^hA !Y//II%%3%))F"3"3 < <*y'::;;;!!##&G (= 8I 7**"9- A "&.="@#{//77!%WXX!6!=&, %0 -:*"%f++!W, # &y 1A$MHH "ADyy#&&' %#&&' #$ A%%#H"#KK A%%MH/77NW"H"#KK A%%"H"#KK!HH%)$$$'"9j:J#]J@6VWh{HH"F[M `   ,  &   +!j6)*** r&cH|j}|jrtdd||jfz|dkrX|j|_|}|dkrt |_d|_n|st |_d|_n{||_ns|dkrd|_d|_n^|dkr7|xjdz c_|jx|_ |_t|_d|_n!|dkrt|_d|_nd |_|jr!td ||j|jfzdSdS) NzScanner: next: %s [%d] %dz rrBr rCrDrEr z--> [%d] %d %r) r!rr<rr read_charrr rrrr)r"r!rSs r$r=zScanner.next_charsN"&"2 : W -; 0UU V V V !  =DL  ADyy # #$   " # #$  ! A   DM D   A   MMQ MM15 >D $,DM D   A  DM D  DM : Q "k4<%OO P P P P P Q Qr&returnc|jS)am Return a tuple (name, line, col) representing the location of the last token read using the read() method. |name| is the name that was provided to the Scanner constructor; |line| is the line number in the stream (1-based); |col| is the position within the line of the first character of the token (0-based). rr7s r$r3zScanner.position9s --r&c*|S)zX Python accessible wrapper around position(), only for error reporting. )r3r7s r$ get_positionzScanner.get_positionDs}}r&cR|j||_||_dS)z8Set the current state of the scanner to the named state.N)rget_initial_staterr)r"rs r$rz Scanner.beginJs* L * *: 6 6 $r&c^||j}|j||f|jfdS)a Called from an action procedure, causes |value| to be returned as the token value from read(). If |text| is supplied, it is returned in place of the scanned text. produce() can be called more than once during a single call to an action procedure, in which case the tokens are queued up and returned one at a time by subsequent calls to read(), until the queue is empty, whereupon scanning resumes. N)rrappendr)r"r-rs r$r)zScanner.producePs8 <9D E4=$*MNOOOOOr&cdS)z_ Override this method if you want something to be done at end of file. Nr7s r$r*z Scanner.eof_s r&c|jdS)Nrr\r7s r$ start_linezScanner.start_linefs-a00r&r:r6)__name__ __module__ __qualname____doc__r%r/r4r8r(r;r=tupler3r^rr)r*propertyrfrdr&r$r r sp&Q&Q&Q&QP*999333BBB6ooobQQQ> .% . . . . %%% P P P P   11X111r&r ) rjcythondeclareobjectr rRegexpsrrrrr rdr&r$rqs  6v6VDDDD"""""""""" FHH W1W1W1W1W1W1W1W1W1W1r&