Mh\ ddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z m Z m Z ddlZddlZddlmZddlmZddlmZddlmZmZddlmZdd lmZdd lmZdd l m!Z!m"Z"m#Z#dd l$m%Z%dd l&m'Z'ddl(m)Z)defdZ*Gdde!Z+GddeZ,defdZ-defdZ.defdZ/defdZ0defdZ1defdZ2defdZ3defdZ4defd Z5defd!Z6defd"Z7defd#Z8defd$Z9defd%Z:e ee,dfZ;ded&e,d'efd(ZdS)+N)StringIO)CallableListOptionalUnion GeneratorTupleClassVarAny)Buffer) KeyPressEvent)named_commands)AutoSuggestFromHistory Suggestion)Document)History) PromptSession) ProcessorTransformationTransformationInput) get_ipython)generate_tokens) pass_throughdocumentc&|j|jSN)linescursor_position_row)rs g/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/IPython/terminal/shortcuts/auto_suggest.py _get_queryr!s >(6 77cPeZdZUdZdZeeed<d deddfdZ d e de fd Z dS) AppendAutoSuggestionInAnyLinea Append the auto suggestion to lines other than the last (appending to the last line is natively supported by the prompt toolkit). This has a private `_debug` attribute that can be set to True to display debug information as virtual suggestion on the end of any line. You can do so with: >>> from IPython.terminal.shortcuts.auto_suggest import AppendAutoSuggestionInAnyLine >>> AppendAutoSuggestionInAnyLine._debug = True F_debugclass:auto-suggestionstylereturnNc||_dSr)r')selfr's r __init__z&AppendAutoSuggestionInAnyLine.__init__0s  r"tic&jjdz }j|k}fd}jjdkr |dSjj|kr |r |dSjjjkr |dSjj}|jr jjs |dSjjjz }|jj }t|dkr |dStj d krt|dkrStj d krCjjjkrtjd gz Stj St|dkr;jjjkr&tjj|dfgz Stj S|dkr(|d}tjj|fgz S|r&|t|kr-d t||z d }tj|fgSt|} t!t|D]T} || z } dd| D} | rn| dz} U| rtjd| dfgSt|t|z dzjr jdfgngzS|t|kr||}tj|fgSjt|z dz} t| S)a Apply transformation to the line that is currently being edited. This is a variation of the original implementation in prompt toolkit that allows to not only append suggestions to any line, but also to show multi-line suggestions. As transformation are applied on a line-by-line basis; we need to trick a bit, and elide any line that is after the line we are currently editing, until we run out of completions. We cannot shift the existing lines There are multiple cases to handle: The completions ends before the end of the buffer: We can resume showing the normal line, and say that some code may be hidden. The completions ends at the end of the buffer We can just say that some code may be hidden. And separately: The completions ends beyond the end of the buffer We need to both say that some code may be hidden, and that some lines are not shown. rc\tjjjrd|zndfgzS)N  fragments)rr2r'r%)textr*r,s r zDAppendAutoSuggestionInAnyLine.apply_transformation..Ss:Nltz3T3::RT&U%VV   r"z noop:onelineznoop:last line and cursorznoop:before cursorz noop:not eolrznoop: no suggestions)r1)redzD(Cannot show multiline suggestion; requires prompt_toolkit > 3.0.49)r1u… rest of suggestion (z lines) and code hiddenr0c3&K|] }|dV dS)rN).0ls r zEAppendAutoSuggestionInAnyLine.apply_transformation..s&..aQqT......r"u… z line(s) hiddenzshift-last-line)r line_countlinenorbuffer_controlbuffer suggestionis_cursor_at_the_end_of_liner3 splitlineslenprompt_toolkitVERSIONrr2r'rangeget_linejoinstripr%)r*r,last_line_number is_last_linenoopr@delta suggestionsrAn_elidedillelshifts`` r apply_transformationz2AppendAutoSuggestionInAnyLine.apply_transformation3s:;1A5y$44       ; !Q & &4'' ' ; *.> > >< >4344 4 9r{6 6 64,-- -")  ( (P (4'' ' BK;;',7799 {  q 4.// /  !J . .;!##(>(K(K9 ???)"$,#*BLAAAA[!!Q&&9 ???)"$,4:{1~2N1O"O"BL999 9 A::$QJ!BLTZsgr" _llm_prefixerctd|_g|_d|_d|_d|_dSNr)superr+r_r`rcrb_request_number)r* __class__s r r+z(NavigableAutoSuggestFromHistory.__init__sF !&*#"& r"_r(cd|_dSri)r_)r*rms r reset_history_positionz6NavigableAutoSuggestFromHistory.reset_history_positions r"c||jD](}|jj}||j)dSr)_cancel_running_llm_taskr`default_bufferon_text_insertremove_handlerro)r*pt_apptext_insert_events r disconnectz*NavigableAutoSuggestFromHistory.disconnectsZ %%'''* J JF & 5 D   , ,T-H I I I I J Jr"ruc|j||jj|j|jj|jdSr)r`appendrrrs add_handlerroon_cursor_position_changed_dismiss)r*rus r connectz'NavigableAutoSuggestFromHistory.connectsZ ##F+++ ,889TUUU8DDT]SSSSSr"r@rct|}|r7|||j|jD]\}}t |cSdSr)r!rJ_find_next_matchr_historyr)r*r@rr3rArms r get_suggestionz.NavigableAutoSuggestFromHistory.get_suggestionsj(## ::<< .!%!6!6dov~"" . . A"*-----tr"c<|d|_dSr)rqrA)r*r@argskwargss r r|z(NavigableAutoSuggestFromHistory._dismisss" %%''' r"r3rpreviousc#Kd}tt|D]}t|D]l}|dz }|s||kr||r;t |t |kr|t |d|fV|r ||krdSmdS)ac text : str Text content to find a match for, the user cursor is most of the time at the end of this text. skip_lines : float number of items to skip in the search, this is used to indicate how far in the list the user has navigated by pressing up or down. The float type is used as the base value is +inf history : History prompt_toolkit History instance to fetch previous entries from. previous : bool Direction of the search, whether we are looking previous match (True), or next match (False). Yields ------ Tuple with: str: current suggestion. float: will actually yield only ints, which is passed back via skip_lines, which may be a +inf (float) rN)reversedlist get_stringsrC startswithrD)r*r3r_rr line_numberstringlines r _find_matchz+NavigableAutoSuggestFromHistory._find_matchs8 tG$7$7$9$9::;;  F !2!2!4!455  q K*$<$<??4((9SYYT-B-Bs4yy{{+[8888 z 9 9FFF   r"c4||||dS)NFr)rr*r3r_rs r rz0NavigableAutoSuggestFromHistory._find_next_matchs!j'EJJJr"c htt||||dS)NTr)rrrrs r _find_previous_matchz4NavigableAutoSuggestFromHistory._find_previous_match s6 !!$ Gd!KK L L   r"query other_thanc||||j|D]\}}||z|kr ||_dSd|_dSri)rqrr_r*rrrrArs r upz"NavigableAutoSuggestFromHistory.upss %%''''+'<'< 4?G( ( #J z!Z//"-0  DOOOr"c||||j|D]\}}||z|kr ||_dS||td|D]\}}||z|kr ||_dSdS)NInf)rqrr_floatrs r downz$NavigableAutoSuggestFromHistory.down"s %%''''+'@'@ 4?G( (   #J z!Z//"-0 ,0+D+DuU||W,,  ' K:%33&1DOEE4  r"c|j\|jr d|_dS|j}|rd|_|stjddSdSdS)z] Try to cancel the currently running llm_task if exists, and set it to None. Nz@LLM task not cancelled, does your provider support cancellation?)radonecancelwarningswarn)r* cancelleds r rqz8NavigableAutoSuggestFromHistory._cancel_running_llm_task3s > %~""$$ !%--//I &!%  V & %  r"c^|j |jr||_|jS)zLazy-initialized instance of the LLM provider. Do not use in the constructor, as `_init_llm_provider` can trigger slow side-effects. )rcrb)r*s r _llm_providerz-NavigableAutoSuggestFromHistory._llm_providerCs2  & .43J .*.*A*A*C*CD '**r"c2K ddl}n#t$rd}YnwxYwjstjddS|tjdfd}t j||_jd{VdS)z This will ask the current llm provider a suggestion for the current buffer. If there is a currently running llm task, it will cancel it. rN5No LLM provider found, cannot trigger LLM completionsz;LLM Completion requires `jupyter_ai_magics` to be installedcK |d{VdS#t$r-}tjd|d}~wwxYw)z This catches and log any errors, as otherwise this is just lost in the void of the future running task. Nzerror %s)_trigger_llm_core Exceptionrlogerror)r@er*s r error_catcherzCNavigableAutoSuggestFromHistory._trigger_llm..error_catcher`sw  ,,V44444444444    !'' A666 s" A(AA) jupyter_ai_magicsModuleNotFoundErrorrrrrqasyncio create_taskra)r*r@rrs` r _trigger_llmz,NavigableAutoSuggestFromHistory._trigger_llmMs % $ $ $ $ $" % % % $    %!  MQ R R R F  $ MW X X X %%'''     !,]]6-B-BCCns  c K ddlmcm}n#t$rd}YnwxYw|st d|jst d|jjj}| |}tj d||xj dz c_ |j }||||jjz|jjdddd d }|j|23d{V}|j |krdSt'||jrot+|jjdkrt d t1|jjdj|_|jt'||jr7t1|jj|_|j6dS) aF This is the core of the current llm request. Here we build a compatible `InlineCompletionRequest` and ask the llm provider to stream it's response back to us iteratively setting it as the suggestion on the current buffer. Unlike with JupyterAi, as we do not have multiple cells, the cell id is always set to `None`. We set the prefix to the current cell content, but could also insert the rest of the history or even just the non-fail history. In the same way, we do not have cell id. LLM provider may return multiple suggestion stream, but for the time being we only support one. Here we make the assumption that the provider will have stream_inline_completions, I'm not sure it is the case for all providers. rNzjupyter-ai is not installedrz prefix: %srz text/x-pythonTpython)numberprefixsuffixmimestreampathlanguagecell_idzBTerminal IPython cannot deal with multiple LLM suggestions at once)jupyter_ai.completions.models completionsmodelsr ValueErrorrrshellhistory_managerrgrrdebugrkInlineCompletionRequestrtext_before_cursortext_after_cursorstream_inline_completions isinstanceInlineCompletionReplyrDritemsr insertTextrAon_suggestion_setfireInlineCompletionStreamChunkresponse)r*r@ jai_modelshmrrequest_numberrequestreply_and_chunkss r rz1NavigableAutoSuggestFromHistory._trigger_llm_coreosF.  > > > > > > > > > >"   JJJ  <:;; ;! VTUU U ^ ! 1##B''  f555 !-44!FO>>?4 5   '+&8&R&R ' '  0 0 0 0 0 0 0"#~55*J,LMM 0',233a77$\%/$)/2=%%!(--////,j.TUU 0$./?/H/S$T$T!(--///#' $ s  9G)r(N))rVrWrXrYintr[rrrarTaskrr rgr+r rorwr}rrrrr|r\rrrZrr rrrrrrqpropertyrrr __classcell__)rls@r r^r^s OOO-(((( &*Iw|d")))!4'''$J&&&55M8555!!!!!4JJJJ TmTTTTT  (0  *     !!!!''%*'5<'HL' 5e$dD0 1''''RKK%*K5<K 5e$dD0 1KKKK   % '       w 4    "#3T" ++X+    DFfFFFFFFFFr"r^eventcXKd}tj}t|tsdS|jj}t d||jz |jz}t|D]}|j ddd | |jd{VdS)a  Ask the AutoSuggester from history to delegate to ask an LLM for completion This will first make sure that the current buffer have _MIN_LINES (7) available lines to insert the LLM completion Provisional as of 8.32, may change without warnings Nr F) move_cursor fire_event) r auto_suggestrr^current_bufferrmaxr=rrG insert_textr)r _MIN_LINESproviderdoclines_to_insertrms r llm_autosuggestionrsJ}})H h ? @ @   'C!Z#.83;RRSSO ? # #TT ((5U(SSSS    4 5 5555555555r"c4|j}|j}|j|jd}|d}|d}|j}|)|jr"|dkr||jdStj |dS)z,Apply autosuggestion or jump to end of line.Nrrr0) rrr3cursor_positionsplitrJrArnc end_of_line)rr@d after_cursorrend_of_current_linerAs r accept_or_jump_to_endrs  !FA6!+--.L   t $ $E(..**"JZ_;NRT;T;T:?+++++ ur"c|j}|j}|r||jdSt j|dS)zAccept autosuggestionN)rrArr3r forward_char)rr@rAs r acceptrsL  !F"J:?+++++ r"c"|j}d|_dS)zDiscard autosuggestionN)rrA)rr@s r discardrs  !FFr"c|j}|j}|rItjd|j}|t d|DddStj|dS)z#Fill partial autosuggestion by wordz(\S+\s+)c3K|]}||V dSrr9)r:rfs r r<zaccept_word..s' 3 3q 3 3 3 3 3 3 3r"r0N) rrArerr3rnextr forward_word)rr@rAts r accept_wordrsv  !F"J H[*/ 2 24 3 3A 3 3 3R8899999 r"c||j}|j}|r)|jr$||jddSdSdS)z(Fill partial autosuggestion by characterrN)rrAr3r)rbrAs r accept_characterrsU AJ*jo* joa()))))****r"cz|j}|j}|j}|r#||j||_dSdS)z.Accept autosuggestion and keep cursor in placeN)rrrArr3)rr@ old_positionrAs r accept_and_keep_cursorrsP  !F)L"J.:?+++!-..r"cLt|tj|dS)z3Accept autosuggestion and move cursor left in placeN)rr backward_charrs r accept_and_move_cursor_leftr s'5!!!Ur"r@cf|jr)|j||j}||_dSdSr)rrrrA)r@rAs r _update_hintr s? '(77PP &''r"cVtj|t|jdS)z4Resume autosuggestions after deleting last characterN)rbackward_delete_charr rrs r backspace_and_resume_hintr s*E"""%&&&&&r"cVtj|t|jdS)zResume autosuggestionsN)rreplyr rrs r resume_hintingrs,u%&&&&&r"ch|j}||jt|dS)zGo up and update hintcountN)rauto_upargr rrs r up_and_update_hintr#s7)N+++     r"ch|j}||jt|dS)zGo down and update hintrN)r auto_downrr rs r down_and_update_hintr+s7)N59---     r"c|j}|j}|rt|j}||jz}gd}dg}d}t t |jD]}|jtj krt|} n/| |dt|d} | |d| |d} | |rr|dkrTt| t|kr4| t|d|d<| | |dz }|d||<|dkrn|dz }|dr_|d} |dr!t|ddkr|d} | t|d} || dSt!j|dS) z$Fill partial autosuggestion by token)NNNr0rrrN)rrAr!rr3rrreadlinetypetokenizeNEWLINErDindexryrrrr) rrrArr3tokens substringsrQtokenr!tokenized_so_farr to_inserts r accept_tokenr'3s AJ AJ'' '&8&8&8T $Xd^^%<==  EzX---D  58SB-@-@AA   d6E6l + + +)"~ **622 66c"233c&kkAA 0V ?F1I%%&6777FA!!Hq 66EQ !9 $R.Kay -S^^q00(n #CKKMM2I MM) $ $ $ FOEr"rdirection_methodc|j}|sdSt|j}||jz}||||j|||j}||_dS)a We skip most recent history entry (in either direction) if it equals the current autosuggestion because if user cycles when auto-suggestion is shown they most likely want something else than what was suggested (otherwise they would have accepted the suggestion). N)rrr)rAr!rr3rr)r@rr(rArcurrentnew_suggestions r _swap_autosuggestionr,`ss"J  v ' 'Ejo%G5WfnMMMM,,VV_EEN&Fr"ct}|j}t|tsdSt |j||jS)z%Get next autosuggestion from history.Nr@rr()rrrr^r,rrrrrs r swap_autosuggestion_upr0xsN MME!H h ? @ @ #h   r"ct}|j}t|tsdSt |j||jS)z)Get previous autosuggestion from history.Nr.)rrrr^r,rrr/s r swap_autosuggestion_downr2sP MME!H h ? @ @ #!   r")?rrriortypingrrrrrr r r rrEprompt_toolkit.bufferr prompt_toolkit.key_bindingr #prompt_toolkit.key_binding.bindingsrrprompt_toolkit.auto_suggestrrprompt_toolkit.documentrprompt_toolkit.historyrprompt_toolkit.shortcutsr prompt_toolkit.layout.processorsrrrIPython.core.getipythonrIPython.utils.tokenutilrfiltersrr!r$r^rrrrrrrrr r rrrr'Providerr,r0r2r9r"r rAs SSSSSSSSSSSSSSSSSSSS((((((444444DDDDDDJJJJJJJJ,,,,,,******222222 0/////333333!!!!!!88888|6|6|6|6|6I|6|6|6~VVVVV&<VVVr6M6666,     -= }*M****.-....} ''''' ']'''' '-''''!m!!!!! !!!!' ''''T ')H$N O' '-'''''0 -     M      r"