X-Ph;UdZddlmZddlmZddlmZmZmZm Z m Z m Z ddl m Z ddlmZddlmZmZmZmZmZmZmZmZmZmZmZmZmZddlmZd Z d e!d <d5dZ"d6dZ#d7d!Z$d8d"Z%d9d#Z&e'e(e)e(e)fZ*d:d&Z+d:d'Z,Gd(d)e e)Z-d;d-Z.Gd.d/e e)Z/d None: self.x = 0 if func(): self.y = 1 else: self.y = 2 self.z = 3 In this example, the attributes 'x' and 'y' are always defined, but 'z' is not. The analysis assumes that we know that there won't be any subclasses. The analysis also works if there is a known, closed set of subclasses. An attribute defined in a base class can only be always defined if it's also always defined in all subclasses. As soon as __init__ contains an op that can 'leak' self to another function, we will stop inferring always defined attributes, since the analysis is mostly intra-procedural and only looks at __init__ methods. The called code could read an uninitialized attribute. Example: class C: def __init__(self) -> None: self.x = self.foo() def foo(self) -> int: ... Now we won't infer 'x' as always defined, since 'foo' might read 'x' before initialization. As an exception to the above limitation, we perform inter-procedural analysis of super().__init__ calls, since these are very common. Our analysis is somewhat optimistic. We assume that nobody calls a method of a partially uninitialized object through gc.get_objects(), in particular. Code like this could potentially cause a segfault with a null pointer dereference. This seems very unlikely to be an issue in practice, however. Accessing an attribute via getattr always checks for undefined attributes and thus works if the object is partially uninitialized. This can be used as a workaround if somebody ever needs to inspect partially uninitialized objects via gc.get_objects(). The analysis runs after IR building as a separate pass. Since we only run this on __init__ methods, this analysis pass will be fairly quick. ) annotations)Final)CFGMAYBE_ANALYSISAnalysisResultBaseAnalysisVisitorget_cfg run_analysis)analyze_self_leaks)ClassIR) Assign AssignMulti BasicBlockBranchCall ControlOpGetAttrRegister RegisterOpReturnSetAttrSetMem Unreachable) RInstanceFrdump_always_defined class_irs list[ClassIR]returnNonect}|D]}t||t}|D]}t||t}|D]}t||dS)akFind always defined attributes all classes of a compilation unit. Also tag attribute initialization ops to not decref the previous value (as this would read a NULL pointer and segfault). Update the _always_initialized_attrs, _sometimes_initialized_attrs and init_self_leak attributes in ClassIR instances. This is the main entry point. N)set%analyze_always_defined_attrs_in_class,update_always_defined_attrs_using_subclassesdetect_undefined_bitmap)rseencls Z/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/mypyc/analysis/attrdefined.pyanalyze_always_defined_attrsr(dsD88-b$7777 55D??4R>>>> 55D**D))))**r&r r% set[ClassIR]c|vrdS|js0js)js"jjrdSjddD]}t|| d}|>j _ j _ dS|jd}t|j}t#|j||}t%|j|j |}t'}jD]}||jt-|j||j z |} t/|j|||| |} fd| D} | _ t0r"t3jt7| t9|j|||_ t;|j|||d} |jD]D} t=| jD]-\} }|j | | frtC|tDsd} n.E| _#dS)N__init__r)initial_undefinedcfgc>h|]}||S) is_deletable).0ar&s r' z8analyze_always_defined_attrs_in_class..s*JJJArq7I7IJaJJJr)FT)$addis_traitinherits_pythonallow_interpreted_subclasses builtin_basechildrenis_serializablemror" get_methodattrs_with_defaultscopy_always_initialized_attrs_sometimes_initialized_attrsarg_regsr blocksr #analyze_maybe_defined_attrs_in_initr!update attributes%analyze_maybe_undefined_attrs_in_initfind_always_defined_attributesrprintnamesorted!find_sometimes_defined_attributesmark_attr_initialization_ops enumerateopsafter isinstancerinit_self_leak)r&r%basemself_regr/dirty maybe_defined all_attrsmaybe_undefinedalways_defined any_dirtybiops` r'r"r"s TzzHHRLLL      *  ? & ;       qrr ::-dD9999 j!!Ay')'='B'B'D'D$*,*@*E*E*G*G'z!}H !(  C qx3 7 7E7 (B2CM%%I**)))); (i":P.PVYO4 (I}ouNKJJJJJJN#1B / bgvn--...&G (M5''B#!8]EJJJI Xqu%%  EAr{1a4  B)?)?  !Br)rDlist[BasicBlock]rVrrYset[str]rXAnalysisResult[str]rZrWAnalysisResult[None]c4|}|D]}t|jD]f\}} t| tr9| j|ur0| j|j||fvr|| jt| trO| j|urF| j|j||fvr0| j|j||fvr|| j|j ||fr3|j||fs"||j ||f|j ||fz z}nnt| trW| D]B} |j ||fs1|j| dfr"||j | df|j | dfz z}Ch|S)zFind attributes that are always initialized in some basic blocks. The analysis results are expected to be up-to-date for the blocks. Return a set of always defined attributes. r) r@rOrPrRrobjattrbeforediscardrrQrtargets) rDrVrYrXrZrWattrsblockr^r_targets r'rIrIs NN  Euy))  EAr"g&& +26X+=+=7o4UAX>>>MM"'*** "g&& +26X+=+=G5eQh???=#7q#AAAMM"'***{5!8$ |E1H-!%+E1H58MeUVh8WWE"i((  jjllF ;uax0U\&!)5L %)/ :_=RSY[\S\=]]! Lr)c|t}|D]}t|jD]\}}|j||fr#|j||fs||j||fz}n]t |t rG|D]2}|j||fs!|j|dfr||j|dfz}3|S)zDFind attributes that are sometimes initialized in some basic blocks.r)r!rOrPrQrgrRrri) rDrVrXrWrjrkr^r_rls r'rMrMseeE G Guy)) G GEAr{5!8$ |E1H-B!M$7q$AAE"i(( G jjllGGF ;uax0GU\&!)5LG % (;FAI(F F Lr)c|D]u}t|jD]^\}}t|trD|j|ur;|j}||j||fvr#|j||fs|_vdS)zTag all SetAttr ops in the basic blocks that initialize attributes. Initialization ops assume that the previous attribute value is the error value, so there's no need to decref or check for definedness. N) rOrPrRrrerfrgrQmark_as_initializer)rDrVrXrWrkr^r_rfs r'rNrNs--uy)) - -EAr"g&& -26X+=+=w}3E1H===ekRWYZRZF[=**,,,  ---r)r_rc|jjjdj}t |t sJ|j}d|jDS)zLCalculate attributes that are always initialized by a super().__init__ call.rcPh|]#}|jD]}|||$Sr1)rGis_always_defined)r3rTr4s r'r5z6attributes_initialized_by_init_call.."s; W W W$$/ W WQT=S=STU=V=V WA W W W Wr))fnsigargstyperRrclass_irr=r_ self_typer&s r'#attributes_initialized_by_init_callrzsI q!&I i + ++++  B W W"& W W WWr)c|jjjdj}t |t sJ|j}t||jzS)zHCalculate attributes that may be initialized by a super().__init__ call.r) rsrtrurvrRrrwrzrBrxs r')attributes_maybe_initialized_by_init_callr|%sI q!&I i + ++++  B .r 2 2R5T TTr)cReZdZdZddZdd Zdd ZddZddZddZ ddZ ddZ dS) AttributeMaybeDefinedVisitorzFind attributes that may have been defined via some code path. Consider initializations in class body and assignments to 'self.x' and calls to base class '__init__'. rVrrrc||_dSNrVselfrVs r'r-z%AttributeMaybeDefinedVisitor.__init__4   r)r_rtuple[set[str], set[str]]c:ttfSrr!rr_s r' visit_branchz)AttributeMaybeDefinedVisitor.visit_branch7uucee|r)rc:ttfSrrrs r' visit_returnz)AttributeMaybeDefinedVisitor.visit_return:rr)rc:ttfSrrrs r'visit_unreachablez.AttributeMaybeDefinedVisitor.visit_unreachable=rr)rcHt|tr$|j|jur|jht fSt|t r9|jjr-|jj dkrt|t fSt t fSNr-) rRrrerVrfr!rrs class_namerKr|rs r'visit_register_opz.AttributeMaybeDefinedVisitor.visit_register_op@s b' " " $rv'>'>G9cee# # b$   HBE$4 Hz9Q9Q'>5527)# # b$   BBE$4 Bz9Q9Q55=bAAA Auucee|r)r c:ttfSrrrs r'rz+AttributeMaybeUndefinedVisitor.visit_assignxrr)rc:ttfSrrrs r'rz1AttributeMaybeUndefinedVisitor.visit_assign_multi{rr)rc:ttfSrrrs r'rz,AttributeMaybeUndefinedVisitor.visit_set_mem~rr)Nrrrrrrrrrr1r)r'rr^rr)rr.cPt||t||dtSr)r rr)rDrVr.r/s r'rHrHs5  3H==!     r)c||vrdS|jdSt}|jD]:}|jD]0}t||||jvr||1;|xj|zc_||dS)zJRemove attributes not defined in all subclasses from always defined attrs.N)r;r!rAr#r6)r&r%removedrfchilds r'r#r#s Tzz {eeG,""[ " "E 8 E E E5::: D!!! "  G+  HHRLLLLLr)c|jrdS||vrdS|||jddD]}t||t |jdkr*|j|jdj|jD];\}}|j r/| |s|j |<|j ddD]g}|jr^|jD]D\}}|j r8| |s#||jvr|j |EhdS)Nr,) r7r6base_mror$len bitmap_attrsextendrGitems error_overlaprrappendr=)r&r%rTnts r'r$r$sx { TzzHHRLLL ABB**D)))) 2;! r{1~:;;; ##%%&&1 ? &2#7#7#:#: & O " "1 % % %qrr .. = .--// . .1?.2+?+?+B+B.qPRP_G_G_O**1--- ..r)N)rrrr)r&r r%r*rr)rDr`rVrrYrarXrbrZrbrWrcrra) rDr`rVrrXrbrWrcrra) rDr`rVrrXrbrWrcrr)r_rrra) rDr`rVrr?rar/rrrb) rDr`rVrr.rar/rrrb)3r __future__rtypingrmypyc.analysis.dataflowrrrrr r mypyc.analysis.selfleaksr mypyc.ir.class_irr mypyc.ir.opsr rrrrrrrrrrrrmypyc.ir.rtypesrr__annotations__r(r"rIrMrNtupler!str GenAndKillrzr|r~rErrHr#r$r1r)r'rs===~#"""""877777%%%%%%&%%%%%#""""****8<"<"<"<"~////d,----&3s8SX% & XXXXUUUU!!!!!#6s#;!!!H    !!!!!%8%=!!!H    "......r)