q-Ph@TddlmZddlZddlmZmZddlmZddlm Z m Z ddl m Z m Z ddlmZddlmZdd lmZdd lmZdd lmZmZmZdd lmZdd lmZmZddl m!Z!ddl"m#Z#e rPddl$Z$ddlm%Z%m&Z&ddl'm(Z(ddl)Z*ddlm+Z+e$j,dkrddl m-Z-nddl.m-Z-ddl/m0Z0ddl1m2Z2ddlm3Z3ddl4m5Z5m6Z6m7Z7hdZ8GddZ9GddZ:dS)) annotationsN) CoroutineSequence)suppress) Parameter signature) TYPE_CHECKINGAny) functions) parse_version) from_arrow)N_INFER_DEFAULT)DuplicateErrorModuleUpgradeRequiredErrorUnsuitableSQLError)ARROW_DRIVER_REGISTRY)ODBCCursorProxySurrealDBCursorProxy)dtype_from_cursor_description) _run_async)IterableIterator) TracebackType)ArrowDriverProperties) )Self TextClause) Selectable DataFrame)ConnectionOrCursorCursor SchemaDict> USEDROPALTERCREATEDELETEINSERTUPDATEUPSERTVACUUMANALYZEREPLACEc"eZdZdZd dZd d Zd S)CloseAfterFrameIterzDAllows cursor close to be deferred until the last batch is returned.framesr cursorr$returnNonec"||_||_dSN) _iter_frames_cursor)selfr3r4s \/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/polars/io/database/_executor.py__init__zCloseAfterFrameIter.__init__=s" Iterator[DataFrame]c#K|jEd{Vt|jdr|jdSdS)Nclose)r9hasattrr:rAr;s r<__iter__zCloseAfterFrameIter.__iter__AsY$$$$$$$$ 4< ) ) ! L    ! !r>N)r3r r4r$r5r6)r5r?)__name__ __module__ __qualname____doc__r=rDr>r<r2r2:sBNN!!!!!!r>r2cVeZdZUdZdZded<dKd ZdLd ZdMdZdNdZ e dOdZ dPdZ e dQdZ dRd$Ze dSd)ZdTd*ZdUd.ZdUd/ZdVd2Ze dWd5Ze dWd6Ze dWd7Ze dWd8ZdXd9ZdYd=ZdZdAZdBdCdDd[dGZddBdBedHd\dJZdBS)]ConnectionExecutorzIAbstraction for querying databases with user-supplied connection objects.Fboolcan_close_cursor connectionr#r5r6c6t|trdn?t|jddd|_|jdkrt|}|||_ d|_ dS)Narrow_odbc_proxy.r surrealdb)client) isinstancertyperFsplitlower driver_namer_normalise_cursorr4result)r;rNs r<r=zConnectionExecutor.__init__Os*o66 F  j!!,223::1=CCEE   { * *-Z@@@J,,Z88  r>rc|Sr8rIrCs r< __enter__zConnectionExecutor.__enter__[s r>exc_typetype[BaseException] | Noneexc_valBaseException | Noneexc_tbTracebackType | Nonec,||jr@ddlm}t |j|r#t |dSdS|jr0t|jdr|j dSdSdS)Nr)AsyncConnectionrA) _is_alchemy_asyncr4sqlalchemy.ext.asynciorerUr_close_async_cursorrMrBrA)r;r^r`rbres r<__exit__zConnectionExecutor.__exit__^s  ! !$+ . . > > > > > >$+77 74335566666 7 7  " wt{G'D'D K           r>strcBdt|jd|jdS)N)rVrErYrCs r<__repr__zConnectionExecutor.__repr__ns'E4::&EE0@EEEEr>dfr"schema_overridesr%c|jfd|Dx}r||}|S)z&Apply schema overrides to a DataFrame.cg|]<\}}|v ||ktj||=SrI)Fcolcast).0rtdtypeexisting_schemas r< z7ConnectionExecutor._apply_overrides..usU   Uo%%%?33G*G*G E#JJOOE " "*G*G*Gr>)schemaitems with_columns)rorp cast_colsrxs @r<_apply_overridesz#ConnectionExecutor._apply_overridesqsb)    .4466    9 , ++B r>cK|jrdt|jdrQddlm}t |5|jd{VddddS#1swxYwYdSdSdS)NrAr)AsyncContextNotStarted)rMrBr4sqlalchemy.ext.asyncio.excrrrA)r;rs r<rhz&ConnectionExecutor._close_async_cursor}s   *WT['%B%B * I I I I I I011 * *k''))))))))) * * * * * * * * * * * * * * * * * * * * * *s A!!A%(A% module_nameminimum_versionc Rt|}tt5d}dD]9}tt ||dx}t rt |}n:|r*|t |krd|d|}t|ddddS#1swxYwYdS)zr[r$ is_alchemyIterable[Sequence[Any]]c|}|r,|s(t|dtttfr|n d|DS)zCFetch row data in a single call, returning the complete result set.rc,g|]}t|SrItuplervrows r<ryz5ConnectionExecutor._fetchall_rows..s---%**---r>)fetchallrUlistrdict)r[rrowss r<_fetchall_rowsz!ConnectionExecutor._fetchall_rowss\   .# .'1$q'D%;N'O'O .DD----- r>c#K ||}|sdS|s(t|dtttfr|Vnd|DVW)zDFetch row data incrementally, yielding over the complete result set.Trc,g|]}t|SrIrrs r<ryz6ConnectionExecutor._fetchmany_rows..s222cuSzz222r>N) fetchmanyrUrrr)r;r[rrrs r<_fetchmany_rowsz"ConnectionExecutor._fetchmany_rowssy 3##J//D 3 3z$q'D%3FGG 3 22T222222 3r>SchemaDict | Noneinfer_schema_length&DataFrame | Iterator[DataFrame] | Nonec ddlm  tjD]\}}t jd|djr|dx}rj||r$|dr|sdjd}t| fd  ||| D} |r| nt| cSn5#t$r( d } t fd | DsYd nd wwxYwd S)z5Return resultset data in Arrow format for frame init.rr!^$rrzCannot set `iter_batches` for z- without also setting a non-zero `batch_size`c3K|]=}t|r|pint|V>dS))rpN)rUr~r )rvbatchr"rpr;s r< z1ConnectionExecutor._from_arrow..su  "&eY77R--e6F6L"NNN'@PQQQ      r>)rr)zdoes not support Apache Arrowz$Apache Arrow format is not supportedc3:K|]}|tvVdSr8)rj)rveerrs r<rz1ConnectionExecutor._from_arrow..s-BBqCHH}BBBBBBr>N) polarsr"rr{rematchrYr ValueErrorrnext Exceptionany) r;rrrprdriverrrrr3arrow_not_supportedr"rs ` ` @@r< _from_arrowzConnectionExecutor._from_arrows %$$$$$ -B-H-J-J D D))8MMMM4+;<<D/0ABBsJ2243CSIII#.)*<=.FP.t?O~~~(oo-      &*%6%6-)5'1&7&&   F&2C66tF||CCC)D D,   # BBBB.ABBBBB       tsB;C C C<C77C<c ddlm |r|sd}t|t|jx}t x}rt |j|_ t|jdrQ|jdkx}r{t|jdrd|jj j D} nxt|jdrd |jj j D} nGd |j}t|t|jd rd |jj D} ng} | | pi d| D  fd|r||j||n||j|gD} |r| nt!|  |r|SS |r|dSdS#|r|wwxYw)z.Return resultset data row-wise for frame init.rr!zFCannot set `iter_batches` without also setting a non-zero `batch_size`r sqlalchemyr4c2g|]}|d|ddfSrrRNrIrvds r<ryz1ConnectionExecutor._from_rows..s5'''./QqT1QRR5M'''r> _metadatacg|]}|dfSr8rI)rvks r<ryz1ConnectionExecutor._from_rows.. s&U&U&UQ4y&U&U&Ur>z0Unable to determine metadata from query result; descriptionc2g|]}|d|ddfSrrIrs r<ryz1ConnectionExecutor._from_rows..s("R"R"RQAaD!ABB%="R"R"Rr>)rrpcg|]\}}|SrIrI)rvnm_s r<ryz1ConnectionExecutor._from_rows..s!>!>!>Q"!>!>!>r>c3<K|]}|pddVdS)Nr)datarzrprorientrI)rvrr"rresult_columnsrps r<rz0ConnectionExecutor._from_rows..s^I!-5)9,?$ r>)rr)rN)rr"rrUr[rrrBrYr4rrkeys_inject_type_overridesrrrrA) r;rrrprroriginal_resultis_asyncr cursor_descr3r"rs `` @@r< _from_rowszConnectionExecutor._from_rowss %$$$$$  "  "X S// !!T["@/)LL L8 2$T[11DK- (t{J//( @"&"2l"BC:%t{H55.''37;3E3Q''' !k::.&U&U$+:O:T&U&U&U `QUQ\``(oo-T[-88%"R"R$+:Q"R"R"RKK"$K#'#>#> +&6&<"$?$$ "?!>+!>!>!>( W,, K'1'1- #11$+*1UUV$".?vv4<<? (%%'''' ( (%%''''' ( (x (%%'''' (s EGG3rlist[tuple[str, Any]]ct}|D]U\}}||vrd|d}t|| ||vrt|j|}||||<||V|S)a Attempt basic dtype inference from a cursor description. Notes ----- This is limited; the `type_code` description attr may contain almost anything, from strings or python types to driver-specific codes, classes, enums, etc. We currently only do the additional inference from string/python type values. (Further refinement will require per-driver module knowledge and lookups). zcolumn z2 appears more than once in the query/result cursor)setrrr4add)r;rrp dupe_checkrdescrrws r<rz)ConnectionExecutor._inject_type_overrides2sUU #  HBZXXXX$S)))!b0@&@&@5dk4HH$+0$R( NN2    r>connr c` ddlm}m}m}t ||||fS#t $rYdSwxYw)z2Check if the given connection is SQLALchemy async.r)re AsyncSessionasync_sessionmakerF)rgrerrrU ImportError)rrerrs r<rfz$ConnectionExecutor._is_alchemy_asyncNsu            d_lDV$WXX X   55 s  --cddlm}t||rdS ddlm}t||S#t $rYdSwxYw)z5Check if the given connection is a SQLAlchemy Engine.r)EngineT) AsyncEngineF)sqlalchemy.enginerrUrgrr)rrrs r<_is_alchemy_enginez%ConnectionExecutor._is_alchemy_engine\sv -,,,,, dF # # 4  : : : : : :dK00 0   55 s 0 >>cft|jddddkS)zCCheck if the given connection is a SQLAlchemy object (of any kind).rQrRrr)rVrFrW)rs r<_is_alchemy_objectz%ConnectionExecutor._is_alchemy_objectjs-Dzz$**32215EEr>cddlm}ddlm}m}t ||||frdS ddlm}t ||S#t$rYdSwxYw)z=Check if the given connection is a SQLAlchemy Session object.r)r)Session sessionmakerT)rF)rgrsqlalchemy.ormrrrUrr)rrrrrs r<_is_alchemy_sessionz&ConnectionExecutor._is_alchemy_sessionos 87777788888888 d\7LA B B 4  A A A A A Ad$677 7   55 s; A A c$|jdkr||r|S|jjdkr2d|_|jS|jjdkr d|_|S||rd|_|S|St|dr+t|jx}r |n|}d|_|St|dr|Sd |d }t|) zCNormalise a connection object such that we have the query executor.rzdatabricks-sql-python databricks duckdb_engineduckdbTr4executezUnrecognised connection type "z""; no 'execute' or 'cursor' method) rYrenginerraw_connectionr4rrMconnectrBcallable TypeError)r;rr4rs r<rZz$ConnectionExecutor._normalise_cursors)  | + +''--  ;%)@@@'3D$;5577>>@@@['?::'/D$K,,T22 ,0D)<<>>)K T8 $ $ !)DK*?&!@!@LVVXXXfF$(D !M T9 % % K]]]]nnr>queryroptionsc8K||j}|r|jn|j}|4d{V}|rt|ds|j}|j|fi|d{V}|cdddd{VS#1d{VswxYwYdS)z5Execute a query using an async SQLAlchemy connection.Nr)rr4beginrBsessionr)r;rr is_sessionr4rr[s r<_sqlalchemy_async_executez,ConnectionExecutor._sqlalchemy_async_executesI--dk:: (2C""$$$        T $'$ ":": $|'4<9999999999F                               s/B  BBstr | TextClause | Selectabledict[str, Any]9tuple[Any, dict[str, Any], str | TextClause | Selectable]cddlm}ddlm}ddlm}d}d}t |j|r6d|vr2d|vr.|}| d|d<d}| |}| |j} | st |trt|jdrl|jj}t ||rt|}t |t r+t#d |Dst%|||<n t |tr ||}|| r|jn |jj}|||fS) z.sA4412 1tUm,,444444r>)rrsqlalchemy.sqlr sqlalchemy.sql.elementsrrUr4copypopgetrfrrBr rjrallrrr) r;rrrr r param_keycursor_executer rs r<_sqlalchemy_setupz$ConnectionExecutor._sqlalchemy_setups +*****''''''666666  t{G , , !''''llnnG ' L 9 9GH  IY''))$+66 68,,  %677 "[8N%,, #E &$'' 3446<44411 3&+6]] " s # # DKKE  !2:S.. @S w--r>NT)rselect_queries_onlydict[str, Any] | Nonerc|rtt|tr_tjdtjdd|}|sdn|dx}t vr|d}t|pi||j r| |\}}n |j j } t|j }n#t$ri}YnwxYwr+td|Dr ||fi} nfd|pD} ||g| R} | | d ur|j n| } |jd kr| j } | |_|S) z-Execute a query and reference the result set.z\w{3,}z/\*(.|[\r\n])*?\*/rz( statements are not valid 'read' queriesc3TK|]#}|jtjtjfvV$dSr8)kindr KEYWORD_ONLYPOSITIONAL_OR_KEYWORDrs r<rz-ConnectionExecutor.execute..sH   Fy-y/NO O      r>c34K|]}r|v|VdSr8rI)rvors r<rz-ConnectionExecutor.execute..s="" "KLPW<< <<<<""r>NTr)rUrjrsearchsubgroup_INVALID_QUERY_TYPESrrr4rrrr rrvaluesrYr[) r;rrrq query_typerrr r[positional_optionss ` r<rzConnectionExecutor.executes  .:eS#9#9 . )RV,A2u%M%MNNA()9bbqwwqzz9 >RRR#MMM(----R  " "4; / / 1-1-C-CE7-S-S *NGUU![0N ~..9FF   FFF  @#  ]]__     @$^E55W55FF""""%+%6w""" $^E?,>???F"(6T>>  x ' ']F  s>C C"!C")rrrprDataFrame | Iterator[DataFrame]c,|jd}t||j}|o|x}rd|_|j|jfD]9}|||||} | &|r dt | |jD} | cS:d|jd|j}t|) z Convert the result set to a DataFrame. Wherever possible we try to return arrow-native data directly; only fall back to initialising with row-level data if no other option. Nz.cannot return a frame before executing a queryF)rrrprc3K|]}|VdSr8rI)rvros r<rz/ConnectionExecutor.to_polars..'s6r>)r4zCurrently no support for z connection ) r[ RuntimeErrorrMrrr2rYr4NotImplementedError) r;rrrprr can_closedefer_cursor_close frame_initframes r< to_polarszConnectionExecutor.to_polarss  ; BCs## #) "."<9 =  *$)D !   O   JJ%)!1$7 E  %"5!#';###E ! X(8 W W W W "#&&&r>)rNr#r5r6)r5r)r^r_r`rarbrcr5r6)r5rj)ror"rpr%r5r")r5r6)rrjrrjr5r6)rrrrrrLr5r)r[r$rrLr5r)r[r$rrrrLr5r) rrrrLrprrrr5r)rrrpr%r5r%)rr r5rL)rr r5r$)rrrr r5r )rrrrr5r)rrrrrrLr5r) rrLrrrprrrr5r,)rErFrGrHrM__annotations__r=r]rirn staticmethodr~rhrrrrrrrrfrrrrZrrrrr5rIr>r<rKrKHswSS#""""         FFFF   \ **** 6 6 6\ 6    2   \  3 3 3 3,,,,\@(@(@(@(D    8   \    \ FFF\F   \ B).).).).^*.$( ------d#!%.2*9 /'/'/'/'/'/'/'/'r>rK); __future__rrcollections.abcrr contextlibrinspectrrtypingr r rr rspolars._utils.variousr polars.convertr polars.datatypesrpolars.exceptionsrrr"polars.io.database._arrow_registryr"polars.io.database._cursor_proxiesrrpolars.io.database._inferencerpolars.io.database._utilsrsysrrtypesrpyarrowpar version_infortyping_extensionsrrsqlalchemy.sql.expressionr r"polars._typingr#r$r%r'r2rKrIr>r<rMs"""""" ////////((((((((%%%%%%%%!!!!!!//////%%%%%%,,,,,, EDDDDDTTTTTTTTGGGGGG000000FJJJ22222222######HHHHHH 7""******222222444444      EEEEEEEEEE    ! ! ! ! ! ! ! !k'k'k'k'k'k'k'k'k'k'r>