X-Ph|D UdZddlmZddlmZmZddlmZmZm Z m Z m Z m Z m Z mZmZmZmZmZmZmZddlmZmZddlmZmZmZmZmZmZmZm Z ddl!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:ddl;mZ>m?Z?m@Z@mAZAdd lBmCZCmDZDmEZEmFZFdd lGmHZHmIZImJZJmKZKdd lLmMZMdd lNmOZOmPZPmQZQddlRmSZSede egee fZTiZUdeVd< dqdrdZWdsdZX dqdtd!ZY dqdud$ZZeZd%dsd&Z[eZd'eZd(eZd)eZd*eZd+eZd,eZd-eZd.dsd/Z\eZd0dsd1Z]eZd2dsd3Z^eZd2dsd4Z_eZd5dsd6Z`eZd7dsd8ZaeZd9eZd:dsd;ZbeZd5eZd<eZd=eZd9eZd:eZd>eZd?eZd@e9eZdAe7eZdBe(eZdBe8dsdCZceZdDdsdEZdeZdFdsdGZedvdPZfeZdQdsdRZgeZdSeZdTeZdUeZdVdsdWZheZdXdsdYZieZdZdsd[ZjeZd\e(dsd]ZkeZd^e9dsd_ZleZd@e9dsd`ZmeZdae9dsdbZneZd+dsdcZoeZd,dsddZpeZd-dsdeZqeZd.dsdfZrdwdjZseZd(dsdkZteZdldsdmZueZd)dsdnZveZdodsdpZwdS)xa0Special case IR generation of calls to specific builtin functions. Most special cases should be handled using the data driven "primitive ops" system, but certain operations require special handling that has access to the AST/IR directly and can make decisions/optimizations based on it. These special cases can be implemented here. For example, we use specializers to statically emit the length of a fixed length tuple and to emit optimized code for any()/all() calls with generator comprehensions as the argument. See comment below for more documentation. ) annotations)CallableOptional) ARG_NAMEDARG_POS BytesExprCallExprDictExpr Expression GeneratorExprIntExprListExpr MemberExprNameExprRefExprStrExpr TupleExpr)AnyType TypeOfAny) BasicBlockExtendIntegerRaiseStandardErrorRegisterTruncate UnreachableValue) RInstance RPrimitiveRTupleRTypebool_rprimitivec_int_rprimitivedict_rprimitiveint16_rprimitiveint32_rprimitiveint64_rprimitiveint_rprimitiveis_bool_rprimitiveis_dict_rprimitiveis_fixed_width_rtypeis_float_rprimitiveis_int16_rprimitiveis_int32_rprimitiveis_int64_rprimitiveis_int_rprimitiveis_list_rprimitiveis_uint8_rprimitivelist_rprimitiveset_rprimitivestr_rprimitiveuint8_rprimitive) IRBuilder)comprehension_helper*sequence_from_generator_preallocate_helpertranslate_list_comprehensiontranslate_set_comprehension)FormatOpconvert_format_expr_to_strjoin_formatted_stringstokenizer_format_call) dict_items_op dict_keys_opdict_setdefault_spec_init_opdict_values_op)new_list_set_item_op)str_encode_ascii_strictstr_encode_latin1_strictstr_encode_utf8_strict)new_tuple_set_item_opr7z1dict[tuple[str, RType | None], list[Specializer]] specializersNbuilderexprr calleername str | Nonetyp RType | Nonereturn Value | Nonecj|r0||ftvr%t||fD]}||||}||cSdSN)rI)rJrKrLrMrO specializervals X/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/mypyc/irbuild/specialize.py_apply_specializationrXts] s |++'c 2  K+gtV44C  4c0t||||jS)zIInvoke the Specializer callback for a function if one has been registered)rXfullnamerJrKrLs rWapply_function_specializationr]s !$ H HHrYrcH||jn|j}t|||||S)zGInvoke the Specializer callback for a method if one has been registered)r[rMrX)rJrKrLrOrMs rWapply_method_specializationr_s+"k6??v{D $c B BBrYstr$Callable[[Specializer], Specializer]cdfd }|S)zDecorator to register a function as being a specializer. There may exist multiple specializers for one function. When translating method calls, the earlier appended specializer has higher priority. f SpecializerrQchtfg||SrT)rI setdefaultappend)rcrMrOs rWwrapperz$specialize_function..wrappers0s R0077:::rY)rcrdrQrd)rMrOrhs`` rWspecialize_functionrjs. NrYzbuiltins.globalsc^t|jdkr|SdS)Nr)lenargsload_globals_dictr\s rWtranslate_globalsros, 49~~((*** 4rYz builtins.absz builtins.intzbuiltins.floatzbuiltins.complexzmypy_extensions.i64zmypy_extensions.i32zmypy_extensions.i16zmypy_extensions.u8ct|jdkr|jtgkrt |t r|jd}||}|jdd}|dvrd}nd|d}t |trM|j |r3| |}| ||gd|jSdS)zSpecialize calls on native classes that implement the associated dunder. E.g. i64(x) gets specialized to x.__int__() if x is a native instance. r.)i64i32i16u8__int____N)rlrm arg_kindsr isinstancer node_typer[splitrclass_ir has_methodacceptgen_method_callline)rJrKrLargarg_typ shortnamemethodobjs rW$translate_builtins_with_unary_dunderrs 49~~t~'::z&RZ?[?[:il##C((O))#..q1 3 3 3FF')'''F gy ) ) Mg.>.I.I&.Q.Q M..%%C**3D$)LL L 4rYz builtins.lenct|jdkr|jtgkr|jd}||}t |t r6||tt|j St||rd}nd}|||}| ||j SdS)NrqrTF can_borrow) rlrmryrr{rzr rrtypesr1 builtin_lenr)rJrKrLr expr_rtypeborrowrs rW translate_lenrs 49~~t~'::il&&s++ j& ) ) 7 NN3   3z/0011 1!'"3"3C"8"899 ...88C&&sDI66 6 4rYz builtins.listctt|jdkr|jtgksdS|jd}t |t r!|jst |jtsdS|jj}|jj }| |}t|r|dvsdS| |}|dkr"| t|g|jS|dkr"| t |g|jS| t"|g|jS)zSpecialize a common case when list() is called on a dictionary view method call. For example: foo = list(bar.keys()) rqNr)keysvaluesitemsrr)rlrmryrrzr rLrrKrMr{r*rcall_crArrCr@)rJrKrLrbaseattrrtypers rWdict_methods_fast_pathrs#  NNa  DNwi$?$?t )A,C sH % %ch:cjR\;];]t :?D :?D   d # #E u % %$2M*M*Mt ..  C v~~~~lSE49===   ~~nseTY???~~mcUDI>>>rYct|jdkrc|jdtkrMt |jdt r-t ||jd|jjtSdS)zSpecial case for simplest list comprehension. For example: list(f(x) for x in some_list/some_tuple/some_str) 'translate_list_comprehension()' would take care of other cases if this fails. rqrempty_op_llbuilder set_item_opN) rlrmryrrzr r9rJnew_list_op_with_lengthrDr\s rW"translate_list_from_generator_callrsx DI! N1  ( ( ty|] 3 3 ):  IaL&F,     4rYzbuiltins.tuplect|jdkrc|jdtkrMt |jdt r-t ||jd|jjtSdS)zSpecial case for simplest tuple creation from a generator. For example: tuple(f(x) for x in some_list/some_tuple/some_str) 'translate_safe_generator_call()' would take care of other cases if this fails. rqrrN) rlrmryrrzr r9rJnew_tuple_with_lengthrHr\s rW#translate_tuple_from_generator_callrsx DI! N1  ( ( ty|] 3 3 ):  IaL&D-     4rY builtins.setct|jdkrQ|jdtkr;t |jdt rt ||jdSdS)zSpecial case for set creation from a generator. For example: set(f(...) for ... in iterator/nested_generators...) rqrN)rlrmryrrzr r;r\s rW!translate_set_from_generator_callr.s^ DI! N1  ( ( ty|] 3 3 )+7DIaLAAA 4rY builtins.minz builtins.maxc|jttgkr||jd||jd}}t ||}|jdkr|||d|j}n|||d|j}ttt} }}| |||| || || ||j|j|j|| | || || ||j|j|j|| | | |SdS)Nrrqr<>)ryrrrmrr{r[ binary_oprradd_bool_branchactivate_blockassigncoercetypegoto) rJrKrLxyresult comparison true_block false_block next_blocks rWfaster_min_maxr@s ~'7+++~~dil++W^^DIaL-I-I1'++D1122 ?n , , **1adi@@JJ **1adi@@J.8llJLL*,,K  J DDDz***vw~~adiHH$)TTT Z   {+++vw~~adiHH$)TTT Z   z*** 4rYzbuiltins.frozensetz builtins.dictzbuiltins.sortedzcollections.OrderedDictjoinextendupdatec t|jdkr)|jdtkrt |jdt rt |t r|j |j t|jdgfd|jddDz ||j |j|jS||t|jdgfd|jddDzSdS)zuSpecial cases for things that consume iterators where we know we can safely compile a generator into a list. rc:g|]}|Srir.0rrJs rW z1translate_safe_generator_call..x%DDDsw~~c**DDDrYrqNc:g|]}|Srirrs rWrz1translate_safe_generator_call..rrY)rlrmryrrzr rrrrKrMr:r{r arg_namescall_refexpr_with_argsr\s` rWtranslate_safe_generator_callr\sG$ DI N1  ( ( ty|] 3 3 ) fj ) ) **v{++ 1'49Q<HHIDDDDdimDDDE!!$''    111'49Q<HHIDDDDdimDDDE   4rYz builtins.anyct|jdkrZ|jtgkrIt |jdt r)t ||jd|jd|jSdS)Nrqrc|SrTri)rs rWz$translate_any_call..sarY) rlrmryrrzr any_all_helperfalsetruer\s rWtranslate_any_callrsi DI! Nwi ' ' ty|] 3 3 (gty|W]KKQXQ]^^^ 4rYz builtins.allctjdkr]jtgkrLt jdt r,t jdjfdjSdS)Nrqrc<|djS)Nnot)unary_opr)rrJrKs rWrz$translate_all_call..sg&&q%;;rY) rlrmryrrzr rrrr\s`` rWtranslate_all_callrs DI! Nwi ' ' ty|] 3 3 (  IaL L ; ; ; ; ; M     4rYgenr initial_valueCallable[[], Value]modifyCallable[[Value], Value] new_valuerc  tt  |dtt jjjj}tttc d fd }t||j   S)NrQNonec8j}|ddS)Nr)r left_exprrrrr) rrJ exit_blockrrrrretvalrs rWgen_inner_stmtsz'any_all_helper..gen_inner_stmtssVGNN3=99::  J DDDz***vyy{{B/// Z   {+++++rYrQr) rr"rlistzipindices sequences condlistsis_asyncrr8rgoto_and_activate) rJrrrr loop_paramsrrrrrs `` `` @@@@rWrrso & &F NN6==??B///s3; s}clSSTTK*4,, jll'J Z,,,,,,,,,,,,,+III j))) MrYz builtins.sumct|jdvr6|jdtkr t |jdt sdSt|jdkr+|jdtt fvrdS|jd}ntd}|jd|}t|  ||ddd fd }ttjjjj}t'||jS) N)rqrrrqrrQrc j}|ddddS)N+r)rrrr) call_exprrJgen_exprrs rWrz+translate_sum_call..gen_inner_stmtssGNN8#566 vw00CLLbQQQQQrYr)rlrmryrrzr rr r{rrrrrrrrrrr8r) rJrKrL start_expr target_typerrrrs ` @@rWtranslate_sum_callrsn DI&  N1  ( ( ty|] 3 3 )t 49~~ >! Wi$8 8 84Yq\ QZZ y|H##D))K k " "F NN67>>'..*D*DkSUVVXZ[[[RRRRRRRR H h0(2DhFWXXK+ NNN MrYzdataclasses.fieldzattr.ibz attr.attribz attr.FactorycHttj|j|<dS)a,Special case for 'dataclasses.field', 'attr.attrib', and 'attr.Factory' function calls because the results of such calls are type-checked by mypy using the types of the arguments to their respective functions, resulting in attempted coercions by mypyc that throw a runtime error. N)rr from_errorrr\s rW translate_dataclasses_field_callrs ")"677GM$ 4rYz builtins.nextcd|jtgttgfvr t|jdtsdS|jdt |t|jdkr |jdnd}tdfd }ttj j jj}t!||j|r7|jjnTt-t,jd|jt1S)a6Special case for calling next() on a generator expression, an idiom that shows up some in mypy. For example, next(x for x in l if x.id == 12, None) will generate code that searches l for an element where x.id == 12 and produce the first such object, or None if no such element exists. rNrqrQrcjjjdSrT)rrrrr)rJrrrsrWrz,translate_next_call..gen_inner_stmtssF vw~~cm<PQQQ Z     rYr)ryrrzrmr rr{rlrrrrrrrrr8rrrraddrSTOP_ITERATIONrr) rJrKrL default_valrrrrrs ` @@@rWtranslate_next_callrs G9w&8999 ty|] 3 3 :t )A,C g''-- . .F25di..12D2D'..1...$KJ!!!!!!!!! s3; s}clSSTTK+III #v{CM,>??? Z     &'9'H$PTPYZZ[[[ KMM""" :&&& MrYzbuiltins.isinstancect|jdkr|jttgkrt |jdt t frttj |j |jd<| |jd}|\td|D}| |jd|}|j|||jSdS)zSpecial case for builtins.isinstance. Prevent coercions on the thing we are checking the instance of - there is no need to coerce something to a new type before checking what type it is, and the coercion could lead to bugs. rrqrNc3DK|]}|jo|j o|j VdSrT) is_ext_classinherits_pythonallow_interpreted_subclasses)rirs rW z'translate_isinstance..6sNb(:$:b2Cb?brYr)rlrmryrrzrrrrrrflatten_classesallrrJisinstance_helperr)rJrKrLirsrrs rWtranslate_isinstancer%s DI! Nw0 0 0 ty|gy%9 : : 1'.i.B&C&C dil#%%dil33 ?J..1*.EEC?44S#tyII I 4rYrfclt|jdkr|jttgkrt |t rl|jd}t |t r2t|jrdStdt|j }nt |tr2t|jrdStdt|j }nst |tr\t |j trB|j jdkr2t|jrdStdt|j }ndS||j}||jd}|t&|||g|j SdS)aSpecial case for 'dict.setdefault' which would only construct default empty collection when needed. The dict_setdefault_spec_init_op checks whether the dict contains the key and would construct the empty collection only once. For example, this specializer works for the following cases: d.setdefault(key, set()).add(value) d.setdefault(key, []).append(value) d.setdefault(key, {})[inner_key] = inner_val rrqNrr)rlrmryrrzrrrrr#rr r rLrr[rrKrrB)rJrKrLr data_type callee_dictkey_vals rWtranslate_dict_setdefaultr ?s DI! Nw0 0 0 vz * * 1il c8 $ $ 39~~ t#3TY??II X & & 39~~ t#3TY??II sH % % 3:x00  #~5538}} t#3TY??II4nnV[11 ..1..~~ (;*KTY    4rYformatct|trt|jtr|jt t|jkr[|jj}t|}|dS|\}}t|||j |j }|dSt||||j SdSrT)rzrrKrrycountrrlvaluer?r=rmrr>)rJrKrL format_strtokensliterals format_ops substitutionss rWtranslate_str_formatrms 6:&&S v{G , ,S N  ) )S-@-@ @ @[& &z22 >4%*27J SWS\]]  4%gx RRR 4rYct|tr3t|jtr|jjdkr|jt gkrt|jdtr|jdj D]}t|trt|trt|j tr|j j dkrdSt|j jtr|j jjdkrdSt|jdtr|jdjdkrdSdSg}g}|jdj D]}t|tr@|jdkr5| tj| |Wt|tr?| tj| |jdt!||||j}|dSt%|d||jSdS)zSpecial case for f-string, which is translated into str.join() in mypy AST. This specializer optimizes simplest f-strings which don't contain any format operation. rr Nz{:{}}rq)rzrrKrrryrrmrrr rLrMrgr<STRr=rr>)rJrKrLitemrexprsrs rWtranslate_fstringrs, 6:&&&O v{G , ,&O K  # # Nwi ' ' ty|X . . (IaL&  D$(( D(++ !$+z:: dk>NRZ>Z>Z44"4;#3W== AEAQAW[bAbAb44!$)A,88 DIaLQz$)A,'H'Ht 4>Qz$)A,'H'HtH F 4>Q:dilG#D#D >!  ) )~a J..9Q<-"h..1+ ^A ' ) )y|)HH4 4>Q:dilG#D#D >!  ) )~a J..9Q<-"h..1+ ^A ' ) )Yq\'FF4 t~~''R0088bAAH333~~4w~~fk7R7R6SUYU^___ 0 0 0~~5v{8S8S7TVZV_``` K K K~~6 9T9T8UW[W`aaa 4rYct|jdks|jdtkrdS|jd}||}t |r||St|st|rE||}| t|td|j St|rE||}| t|td|j St|st|r6||}||t|j SdS)NrqrTsignedrF)rlrmryrr{r/rr.r-rrr'rr2r0r)rrJrKrLrarg_typerVs rW translate_i64r8s^ 49~~dnQ/7::t )A,C  %%H8$$ @~~c""" X & &@*=h*G*G@nnS!!{{6#'749UUUVVV X & &@nnS!!{{6#'7DIVVVWWW 8 $ $@(:8(D(D@nnS!!~~c#3TY??? 4rYct|jdks|jdtkrdS|jd}||}t |r||St|rD||}|t|t|j St|rE||}|t|td|j St|rE||}|t|td|j St|st!|rK||}t#|t}||t|j SdS)NrqrrTr4F)rlrmryrr{r.rr/rrr&rr-rr2r0r)truncate_literalrr6s rW translate_i32r<s 49~~dnQ/7::t )A,C  %%H8$$@~~c""" X & & @nnS!!{{8C)9 JJJKKK X & & @nnS!!{{6#'749UUUVVV X & &@nnS!!{{6#'7DIVVVWWW 8 $ $@(:8(D(D@nnS!!s$455~~c#3TY??? 4rYc0t|jdks|jdtkrdS|jd}||}t |r||St|st|rD||}| t|t|j St|rE||}| t|td|j St|st!|rK||}t#|t}||t|j SdS)Nrqrr:Fr4)rlrmryrr{r-rr.r/rrr%rr2rr0r)r;rr6s rW translate_i16r>sl 49~~dnQ/7::t )A,C  %%H8$$ @~~c""" X & & @*=h*G*G @nnS!!{{8C)9 JJJKKK X & &@nnS!!{{6#'7DIVVVWWW 8 $ $@(:8(D(D@nnS!!s$455~~c#3TY??? 4rYct|jdks|jdtkrdS|jd}||}t |r||St|st|st|rD||}| t|t|j St|st|rK||}t!|t}||t|j SdS)Nrqrr:)rlrmryrr{r2rr-r.r/rrr6rr0r)r;rr6s rW translate_u8r@(s9 49~~dnQ/7::t )A,C  %%H8$$ @~~c"""H%% @ x ( ( @ x ( ( @ nnS!!{{8C)9 JJJKKK 8 $ $@(:8(D(D@nnS!!s$455~~c#3TY??? 4rYrrrct|ts|S|}d|jdzzdz }||z}|jr||dzdzkr||dzz}t||S)zIf value is an integer literal value, truncate it to given native int rtype. For example, truncate 256 into 0 if rtype is u8. rqr)rzr numeric_valuesize is_signed)rrr max_unsigneds rWr;r;>s eW % %  A%*q.)Q.L LA 1!1a 777 \A  1e  rYcpt|jdks|jdtkrdS|jd}||}t |st |st|r6||}| |t|j SdSNrqr) rlrmryrr{r)r0r+rrr(r)rJrKrLrr7srcs rW translate_intrJNs 49~~dnQ/7::t )A,C  %%H8$$> X & &>  ) )> nnS!!~~c>49=== 4rYz builtins.boolct|jdks|jdtkrdS|jd}||}|j|SrH)rlrmryrrrJ bool_value)rJrKrLrrIs rWtranslate_boolrM^s] 49~~dnQ/7::t )A,C ..  C ? % %c * **rYct|jdks|jdtkrdS|jd}||}t |r||SdSrH)rlrmryrr{r,r)rJrKrLrr7s rWtranslate_floatrOgsp 49~~dnQ/7::t )A,C  %%H8$$#~~c""" 4rYz builtins.ordc*t|jdks|jdtkrdS|jd}t |t t fr9t|jdkr!tt|jSdSrH) rlrmryrrzrrrrord)rJrKrLrs rW translate_ordrRssz 49~~dnQ/7::t )A,C#+,,'SY11D1Ds39~~&&& 4rYrT) rJr7rKr rLrrMrNrOrPrQrR)rJr7rKr rLrrQrR) rJr7rKr rLrrOrPrQrR)rMr`rOrPrQra) rJr7rr rrrrrrrQr)rrrrrQr)x__doc__ __future__rtypingrr mypy.nodesrrrr r r r r rrrrrr mypy.typesrr mypyc.ir.opsrrrrrrrrmypyc.ir.rtypesrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6mypyc.irbuild.builderr7mypyc.irbuild.for_helpersr8r9r:r;"mypyc.irbuild.format_str_tokenizerr<r=r>r?mypyc.primitives.dict_opsr@rArBrCmypyc.primitives.list_opsrDmypyc.primitives.str_opsrErFrGmypyc.primitives.tuple_opsrHrdrI__annotations__rXr]r_rjrorrrrrrrrrrrrrrrr rrr2r8r<r>r@r;rJrMrOrRrirYrWrbs    #"""""%%%%%%%% *)))))))                    6,+++++   ;::::: =<<<<< Xw7%HI CE DDDD`d      IIIIQUCCCCC$("'(()( ^$$^$$%&&'((*++*++*++)**+*,+,+,+)('&%$%$,^$$%$&_%%???&%?<_%%&%0%&&'&0^$$%$"^$$^$$%$%$4%&&)**_%%^$$^$$&''.//V^,,X//X//X~..!!!/.0/0/-,0/('%$%$&%+*'&!H^$$%$^$$   %$  4^$$###%$#L())Y]##^$$   %$$# *) _%%(((&%(V*++,+2\?33***43*ZX~../.&V^,,...-,.bX~..000/.0f*++,+&*++,+.*++,+()**+**     ^$$   %$ _%%+++&%+%&&'&^$$%$rY