Mh7 TdZddlZddlZddlZddlZddlmZddlZddlm Z m Z m Z m Z m Z mZde eefdefdZde eefdefdZde defd Zde eefde fd Zdedefd Zd-de eefd edefdZejd-de eefddd edefdZej d.de eefded edefdZ d.de eefde ed ede eeffdZ d/de eefdedede ee effdZeedfZejdedefdZejdedefdZejd0dZde deefde efdZeedfZejdedefdZejdedefdZejd0dZde deefde efd ZeZ eZ!eZ"d!e de fd"Z#ej$ed#Z%dd$dd%d&gfd'e eefd(ed)e eeegeffd*ed+e edef d,Z&dS)1aEscaping/unescaping methods for HTML, JSON, URLs, and others. Also includes a few other miscellaneous string manipulation functions that have crept in over time. Many functions in this module have near-equivalents in the standard library (the differences mainly relate to handling of bytes and unicode strings, and were more relevant in Python 2). In new code, the standard library functions are encouraged instead of this module where applicable. See the docstrings on each function for details. N) unicode_type)UnionAnyOptionalDictListCallablevaluereturncDtjt|S)aEscapes a string so it is valid within HTML or XML. Escapes the characters ``<``, ``>``, ``"``, ``'``, and ``&``. When used in attribute values the escaped strings must be enclosed in quotes. Equivalent to `html.escape` except that this function always returns type `str` while `html.escape` returns `bytes` if its input is `bytes`. .. versionchanged:: 3.2 Added the single quote to the list of escaped characters. .. versionchanged:: 6.4 Now simply wraps `html.escape`. This is equivalent to the old behavior except that single quotes are now escaped as ``'`` instead of ``'`` and performance may be different. )htmlescape to_unicoder s N/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/tornado/escape.py xhtml_escaper's( ;z%(( ) ))cDtjt|S)aZUn-escapes an XML-escaped string. Equivalent to `html.unescape` except that this function always returns type `str` while `html.unescape` returns `bytes` if its input is `bytes`. .. versionchanged:: 6.4 Now simply wraps `html.unescape`. This changes behavior for some inputs as required by the HTML 5 specification https://html.spec.whatwg.org/multipage/parsing.html#numeric-character-reference-end-state Some invalid inputs such as surrogates now raise an error, and numeric references to certain ISO-8859-1 characters are now handled correctly. )r unescaperrs rxhtml_unescaper>s =E** + ++rcRtj|ddS)zJSON-encodes the given Python object. Equivalent to `json.dumps` with the additional guarantee that the output will never contain the character sequence ```` tag. zReplace all sequences of whitespace chars with a single space.z [\x00-\x20]+ )resubstriprs rsqueezer$ks" 6/3 . . 4 4 6 66rTplusc`|rtjjntjj}||S)a}Returns a URL-encoded version of the given value. Equivalent to either `urllib.parse.quote_plus` or `urllib.parse.quote` depending on the ``plus`` argument. If ``plus`` is true (the default), spaces will be represented as ``+`` and slashes will be represented as ``%2F``. This is appropriate for query strings. If ``plus`` is false, spaces will be represented as ``%20`` and slashes are left as-is. This is appropriate for the path component of a URL. Note that the default of ``plus=True`` is effectively the reverse of Python's urllib module. .. versionadded:: 3.1 The ``plus`` argument )urllibparse quote_plusquote)r r%r*s r url_escaper+ps+(, CFL # #1CE 5<<rencodingcdSNr r,r%s r url_unescaper1Drutf-8cdSr.r/r0s rr1r1s  Drc |D|r#t|dd}tj|S|rtjjntjj}|t||S)aODecodes the given value from a URL. The argument may be either a byte or unicode string. If encoding is None, the result will be a byte string and this function is equivalent to `urllib.parse.unquote_to_bytes` if ``plus=False``. Otherwise, the result is a unicode string in the specified encoding and this function is equivalent to either `urllib.parse.unquote_plus` or `urllib.parse.unquote` except that this function also accepts `bytes` as input. If ``plus`` is true (the default), plus signs will be interpreted as spaces (literal plus signs must be represented as "%2B"). This is appropriate for query strings and form-encoded values but not for the path component of a URL. Note that this default is the reverse of Python's urllib module. .. versionadded:: 3.1 The ``plus`` argument N+r )r,) to_basestringrr'r(unquote_to_bytes unquote_plusunquote)r r,r%r:s rr1r1s{(  ;!%((00c::E|,,U333/3M&,++9Mw}U++h????rFqskeep_blank_valuesstrict_parsingct|tr|d}tj|||dd}i}|D]\}}d|D||<|S)a/Parses a query string like urlparse.parse_qs, but takes bytes and returns the values as byte strings. Keys still become type str (interpreted as latin1 in python3!) because it's too painful to keep them as byte strings in python3 and in practice they're nearly always ascii anyway. latin1strict)r,errorsc8g|]}|dS)r?)encode.0is r z"parse_qs_bytes..s$444Qahhx((444r) isinstancebytesdecoder'r(parse_qsitems)r;r<r=resultencodedkvs rparse_qs_bytesrQs"e! YYx  \ " " ~#FG 55144!444 NrcdSr.r/rs rutf8rSr2rcdSr.r/rs rrSrSr2rcdSr.r/rs rrSrSr2rct|tr|St|tstdt |z|dS)zConverts a string argument to a byte string. If the argument is already a byte string or None, it is returned unchanged. Otherwise it must be a unicode string and is encoded as utf8. (Expected bytes, unicode, or None; got %rr3)rH _UTF8_TYPESr TypeErrortyperCrs rrSrSsZ %%% e\ * *RBT%[[PQQQ <<  rcdSr.r/rs rrrr2rcdSr.r/rs rrrr2rcdSr.r/rs rrrr2rct|tr|St|tstdt |z|dS)zConverts a string argument to a unicode string. If the argument is already a unicode string or None, it is returned unchanged. Otherwise it must be a byte string and is decoded as utf8. rWr3)rH_TO_UNICODE_TYPESrIrYrZrJrs rrrs[ %*++ eU # #RBT%[[PQQQ <<  robjclt|trd|DSt|trtd|DSt|trt d|DSt|t rt |S|S)zvWalks a simple data structure, converting byte strings to unicode. Supports lists, tuples, and dictionaries. cNi|]"\}}t|t|#Sr/recursive_unicode)rErOrPs r z%recursive_unicode..s0UUUv1!!$$&7&:&:UUUrc34K|]}t|VdSr.rcrDs r z$recursive_unicode..s+66Q%a((666666rc34K|]}t|VdSr.rcrDs rrgz$recursive_unicode..s+77a&q))777777r)rHdictrLlisttuplerIr)r`s rrdrd s #t UUUUUU C  66#666666 C  773777777 C  # rz\b((?:([\w-]+):(/{1,3})|www[.])(?:(?:(?:[^\s&()]|&|")*(?:[^!"#$%&'()*+,.:;<=>?@\[\]^`{|}~\s]))|(?:\((?:[^\s&()]|&|")*\)))+)httphttpstextshorten extra_paramsrequire_protocolpermitted_protocolscr&tsdzdtjdtffd }t t |}t||S)aConverts plain text into HTML with links. For example: ``linkify("Hello http://tornadoweb.org!")`` would return ``Hello http://tornadoweb.org!`` Parameters: * ``shorten``: Long urls will be shortened for display. * ``extra_params``: Extra text to include in the link tag, or a callable taking the link as an argument and returning the extra text e.g. ``linkify(text, extra_params='rel="nofollow" class="external"')``, or:: def extra_params_cb(url): if url.startswith("http://example.com"): return 'class="internal"' else: return 'class="external" rel="nofollow"' linkify(text, extra_params=extra_params_cb) * ``require_protocol``: Only linkify urls which include a protocol. If this is False, urls such as www.facebook.com will also be linkified. * ``permitted_protocols``: List (or set) of protocols which should be linkified, e.g. ``linkify(text, permitted_protocols=["http", "ftp", "mailto"])``. It is very unsafe to include protocols such as ``javascript``. r mr c|d}|d} r|s|S|r| vr|S|d}|sd|z}t r!d |z}n }d} rYt||krE|}|r8t|dzt|dpdz}nd}||dd }t|dkrY|d||dzd z|ddd d dd dz}t||d zkr |d|}||krX|d} | |dz kr |d| }|dz }t|t|kr|}n|d|zz }d|d|d|dS)Nzhttp://r rlr/?.g?&z...z title="%s"z z)groupcallabler#lensplitrfind)ruurlprotohrefparamsmax_len before_clip proto_lenpartsamprqrsrrrps r make_linkzlinkify..make_linkRsDggajj   E J  U"555Jwwqzz $t#D L ! ! "<<--33555FF!F # 3s3xx'))K JJNS1Ar-B-BB   O))#..E5zzA~~   OAhAhrrl((--a066s;;A>?3xx'C-''(7(mk!!iinn1$$dsd)Cu s88s;////%CCmd22F4444&4434444r) rr#typingMatchstr_unicoder_URL_REr")rorprqrrrsrs ```` rlinkifyr+sH2H\222\//111 95V\95c959595959595959595| L&& ' 'D ;;y$ ' ''r)T)r3T)FF)r Nr N)'__doc__r rr! urllib.parser' tornado.utilrrrrrrrr rrIrrrrr$boolr+overloadr1rQrZrXrSr_rr native_strr7rdcompilerrr/rrrsb   %%%%%% ================*c5j)*c****.,%U +,,,,,* 3s 3s 3 3 3 3 uS%Z(S73737777 eCJ'ts&  c5j) T  QV    DH  e  (+ =A     OS@@ e @(0 @GK@ 3:@@@@>TY c5j.2LP #tE{ .dd4jj!   %               !dC&' !HUO ! ! ! !"44::. c c     e          !eD#u,- !(3- ! ! ! !   330 "*J ]  57"&,g%6 f(f( U f( f(XseSj112f( f( c f(  f(f(f(f(f(f(r