X-Ph6"^UdZddlmZddlmZmZddlmZddlm Z m Z m Z ddl m Z ddlmZddlmZmZdd lmZdd lmZmZdd lmZmZmZmZmZdd lmZdd l m!Z!ddl"m#Z#ddl$m%Z%m&Z&eGddeZ'd2dZ(d3dZ)eZ*de+d<d3dZ,d4d'Z-d5d-Z.d4d.Z/d6d0Z0d1S)7z.Tokenizers for three string formatting methods) annotations)Enumunique)Final)ConversionSpecifierparse_conversion_specifiersparse_format_value)Errors)MessageBuilder)Context Expression)Options)IntegerValue)c_pyssize_t_rprimitiveis_bytes_rprimitiveis_int_rprimitiveis_short_int_rprimitiveis_str_rprimitive) IRBuilder)bytes_build_op) int_to_str_op) str_build_opstr_opceZdZdZdZdZdZdS)FormatOpawFormatOp represents conversion operations of string formatting during compile time. Compare to ConversionSpecifier, FormatOp has fewer attributes. For example, to mark a conversion from any object to string, ConversionSpecifier may have several representations, like '%s', '{}' or '{:{}}'. However, there would only exist one corresponding FormatOp. sdbN)__name__ __module__ __qualname____doc__STRINTBYTESb/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/mypyc/irbuild/format_str_tokenizer.pyrrs) C C EEEr(r specifierslist[ConversionSpecifier]returnlist[FormatOp] | Nonecg}|D]}|jdks |jdkr tj}nF|jdkr tj}n.|jdkr tj}n|jrdStj}|||S)zlConvert ConversionSpecifier to FormatOp. Different ConversionSpecifiers may share a same FormatOp. z%sz{:{}}z%dz%bN) whole_seqrr$r%r&append)r* format_opsspec format_ops r)generate_format_opsr4/s J % % >T ! !T^w%>%> II ^t # # II ^t # # II ^ %44 I)$$$$ r( format_strstr'tuple[list[str], list[FormatOp]] | Nonecg}t|}t|}|dSd}|D]=}|j}|||||t |jz}>|||d||fS)zTokenize a printf-style format string using regex. Return: A list of string literals and a list of FormatOps. Nr)rr4 start_posr0lenr/)r5literalsr*r1last_endr2 cur_starts r)tokenizer_printf_styler>Es H,G ,S,SJ$Z00JtH33N  8I#56777s4>222 OOJxyy)*** Z r(r EMPTY_CONTEXTc t|tttt i}|dSt |}|dSg}d}|D]F}||||jdz |jt|j zdz}G|||dd|D}||fS)a Tokenize a str.format() format string. The core function parse_format_value() is shared with mypy. With these specifiers, we then parse the literal substrings of the original format string and convert `ConversionSpecifier` to `FormatOp`. Return: A list of string literals and a list of FormatOps. The literals are interleaved with FormatOps and the length of returned literals should be exactly one more than FormatOps. Return None if it cannot parse the string. Nrcbg|],}|dddd-S)z{{{z}}})replace).0xs r) z)tokenizer_format_call..s6JJJA $$$,,T377JJJr() r r?r r rr4r0r9r:r/)r5r*r1r;r<r2s r)tokenizer_format_callrI`s $M>&2C2CR#H#HJt$Z00JtHH<< 8dnq.@#@ABBB>C$7$77!; OOJxyy)***JJJJJH Z r(builderrr1list[FormatOp]exprslist[Expression]lineintlist[Value] | Nonect|t|krdSg}t||D]J\}}||}|tjkrt |r||}nt|st|r1| t||g|}n| t||g|}ne|tj krRt|st|r1| t||g|}ndSdS| |L|S)zkConvert expressions into string literal objects with the guidance of FormatOps. Return None when fails.N)r:zip node_typerr$racceptrr primitive_oprrr%r0) rJr1rLrN convertedrGr3rSvar_strs r)convert_format_expr_to_strrXsz  :#e**$$tIE:.."" 9%%a((  $ $ ++ R!..++"9-- R1H1S1S R!..}w~~a?P?P>QSWXX!..vq8I8I7JDQQ (, & & ++ /Fy/Q/Q !..}w~~a?P?P>QSWXXtt44!!!! r(r;list[str] | None substitutions list[Value]rctdtg}|t||D]D\}}|r(|||||E|dr.|||dn||t |dkr|dS|st |dkr|dStt |dz t|d<|t||S)abMerge the list of literals and the list of substitutions alternatively using 'str_build_op'. `substitutions` is the result value of formatting conversions. If the `literals` is set to None, we simply join the substitutions; Otherwise, the `literals` is the literal substrings of the original format string and its length should be exactly one more than substitutions. For example: (1) 'This is a %s and the value is %d' -> literals: ['This is a ', ' and the value is', ''] (2) '{} and the value is {}' -> literals: ['', ' and the value is', ''] rNrA) rrrRr0load_strextendr:call_crrJr;rZrN result_listars r)join_formatted_stringsrfsF*!(+A B BCK-00 " "DAq 8""7#3#3A#6#6777   q ! ! ! ! B< ?   w// == > > >=))) ;1### S--221~S--13IJJKN >>, T : ::r(cdt|t|krdSg}t||D]z\}}||}|tjks|tjkr(t |r||}ndSdS||{|S)zjConvert expressions into bytes literal objects with the guidance of FormatOps. Return None when fails.N) r:rRrSrr&r$rrTr0) rJr1rLrNrVrGr3rS var_bytess r)convert_format_expr_to_bytesris  :#e**$$tIE:.. $ $ 9%%a((  & &)x|*C*C"9-- #NN1-- tt44#### r( list[str]cVtdtg}t||D]D\}}|r(|||||E|dr.|||dt |dkr|dS|st |dkr|dStt |dz t|d<|t||S)zbMerge the list of literals and the list of substitutions alternatively using 'bytes_build_op'.rr]rAr^r_)rrrRr0load_bytes_from_str_literalr:rbrrcs r)join_formatted_bytesrms- !(+A B BCKHm,,1  G   wBB1EE F F F1|N7>>x|LLMMM ;1222666 S--221~S--13IJJKN >>.+t < <r?__annotations__rIrXrfrirmr'r(r)r}sa444"""""" ((((((******** '''''''',+++++55555522222299999999     t   ,    0wyy # # # # L:(;(;(;(;V.======r(