MhS) " d Z ddlmZ ddlZddlmZ dZddd d
d Zi Zd Z d
Z
d Z G d de Z
e
d Z e
d Z e
d Zd!dZd ZedfdZd!dZd ZedfdZd Z G d d e Z G d d e ZdS )"a
webencodings
~~~~~~~~~~~~
This is a Python implementation of the `WHATWG Encoding standard
`. See README for details.
:copyright: Copyright 2012 by Simon Sapin
:license: BSD, see LICENSE for details.
)unicode_literalsN )LABELSz0.5.1z
iso-8859-8z mac-cyrillicz mac-romancp874)z iso-8859-8-izx-mac-cyrillic macintoshz windows-874c v | d d S )a9 Transform (only) ASCII letters to lower case: A-Z is mapped to a-z.
:param string: An Unicode string.
:returns: A new Unicode string.
This is used for `ASCII case-insensitive
`_
matching of encoding labels.
The same matching is also used, among other things,
for `CSS keywords `_.
This is different from the :meth:`~py:str.lower` method of Unicode strings
which also affect non-ASCII characters,
sometimes mapping them into the ASCII range:
>>> keyword = u'Bac\N{KELVIN SIGN}ground'
>>> assert keyword.lower() == u'background'
>>> assert ascii_lower(keyword) != keyword.lower()
>>> assert ascii_lower(keyword) == u'bac\N{KELVIN SIGN}ground'
utf8)encodelowerdecode)strings U/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/webencodings/__init__.py ascii_lowerr # s0 . == & & ( ( / / 7 77 c ^ t | d } t j | }|dS t | }|V|dk rddlm} n/t || }t j | }t || }|t |< |S )u<
Look for an encoding by its label.
This is the spec’s `get an encoding
`_ algorithm.
Supported labels are listed there.
:param label: A string.
:returns:
An :class:`Encoding` object, or :obj:`None` for an unknown label.
z
Nzx-user-definedr )
codec_info) r stripr getCACHEx_user_definedr PYTHON_NAMEScodecslookupEncoding)labelnameencodingr python_names r r r = s
K00 1 1E :e D |tyyH # # # 2 2 2 2 2 2 2&**466K {33JD*-- d Or c p t | d r| S t | }|t d| z |S )z
Accept either an encoding object or label.
:param encoding: An :class:`Encoding` object or a label string.
:returns: An :class:`Encoding` object.
:raises: :exc:`~exceptions.LookupError` for an unknown label.
r NzUnknown encoding label: %r)hasattrr LookupError)encoding_or_labelr s r
_get_encodingr# [ sK ,// ! '((H69JJKKK Or c e Zd ZdZd Zd ZdS )r aO Reresents a character encoding such as UTF-8,
that can be used for decoding or encoding.
.. attribute:: name
Canonical name of the encoding
.. attribute:: codec_info
The actual implementation of the encoding,
a stdlib :class:`~codecs.CodecInfo` object.
See :func:`codecs.register`.
c " || _ || _ d S N)r r )selfr r s r __init__zEncoding.__init__| s $r c d| j z S )Nz
)r )r' s r __repr__zEncoding.__repr__ s **r N)__name__
__module__ __qualname____doc__r( r* r r r r m s<
% % %+ + + + +r r zutf-8zutf-16lezutf-16bereplacec t | }t | \ }} |p|}|j | | d |fS )a
Decode a single string.
:param input: A byte string
:param fallback_encoding:
An :class:`Encoding` object or a label string.
The encoding to use if :obj:`input` does note have a BOM.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
:return:
A ``(output, encoding)`` tuple of an Unicode string
and an :obj:`Encoding`.
r )r# _detect_bomr r )inputfallback_encodingerrors bom_encodingr s r r r sS &&788%e,,L%0 0H % %eV 4 4Q 7 AAr c | d rt | dd fS | d rt | dd fS | d rt | dd fS d| fS )zBReturn (bom_encoding, input), with any BOM removed from the input.s Ns s )
startswith_UTF16LE_UTF16BEUTF8)r3 s r r2 r2 s $$ #qrr"" $$ #qrr"" (( U122Y ;r strictc ^ t | j | | d S )a;
Encode a single string.
:param input: An Unicode string.
:param encoding: An :class:`Encoding` object or a label string.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
:return: A byte string.
r )r# r r
)r3 r r5 s r r
r
s* " " - 4 4UF C CA FFr c h t || }t | | }t | }||fS )a
"Pull"-based decoder.
:param input:
An iterable of byte strings.
The input is first consumed just enough to determine the encoding
based on the precense of a BOM,
then consumed on demand when the return value is.
:param fallback_encoding:
An :class:`Encoding` object or a label string.
The encoding to use if :obj:`input` does note have a BOM.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
:returns:
An ``(output, encoding)`` tuple.
:obj:`output` is an iterable of Unicode strings,
:obj:`encoding` is the :obj:`Encoding` that is being used.
)IncrementalDecoder_iter_decode_generatornext)r3 r4 r5 decoder generatorr s r iter_decoderF s9 , !!2F;;G&ug66IIH h r c # . K |j }t | } | D ]'} || }|r|j J |j V |V n(( |dd }|j J |j V |r|V dS | D ]} || }|r|V |dd }|r|V dS dS )zqReturn a generator that first yields the :obj:`Encoding`,
then yields output chukns as Unicode strings.
Nr Tfinal)r iterr )r3 rD r chunckoutputs r rB rB s
^F KKE #///" " " "LLL E 4((( +++ LLL LLL
VCt
$
$
$F
r c L t || j }t | | S )uY
“Pull”-based encoder.
:param input: An iterable of Unicode strings.
:param encoding: An :class:`Encoding` object or a label string.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
:returns: An iterable of byte strings.
)IncrementalEncoderr
_iter_encode_generator)r3 r r5 r
s r iter_encoderP s& &
1
1
8F !% 0 00r c # ` K | D ]} || }|r|V |dd }|r|V d S d S )N TrH r/ )r3 r
rK rL s r rO rO sg LLL
VBd
#
#
#F
r c " e Zd ZdZddZddZdS ) rA uO
“Push”-based decoder.
:param fallback_encoding:
An :class:`Encoding` object or a label string.
The encoding to use if :obj:`input` does note have a BOM.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
r0 c f t | | _ || _ d| _ d | _ d | _ d S )Nr )r# _fallback_encoding_errors_buffer_decoderr )r' r4 r5 s r r( zIncrementalDecoder.__init__ s5 "/0A"B"B
r Fc . | j }| ||| S | j |z }t | \ }}|%t | dk r |s || _ dS | j }|j | j j }|| _ || _ ||| S )zDecode one chunk of the input.
:param input: A byte string.
:param final:
Indicate that no more input is available.
Must be :obj:`True` if this is the last call.
:returns: An Unicode string.
Nr9 rR )
rX rW r2 lenrU r incrementaldecoderrV r r )r' r3 rI rD r s r r zIncrementalDecoder.decode' s - 75%(( ( u$%e,,% 5zzA~~e~ $ r 2%88 FFM
wue$$$r Nr0 )F)r+ r, r- r. r( r r/ r r rA rA sF
% % % % % %r rA c e Zd ZdZedfdZdS )rN u
“Push”-based encoder.
:param encoding: An :class:`Encoding` object or a label string.
:param errors: Type of error handling. See :func:`codecs.register`.
:raises: :exc:`~exceptions.LookupError` for an unknown encoding label.
.. method:: encode(input, final=False)
:param input: An Unicode string.
:param final:
Indicate that no more input is available.
Must be :obj:`True` if this is the last call.
:returns: A byte string.
r> c l t | }|j | j | _ d S r& )r# r incrementalencoderr
)r' r r5 s r r( zIncrementalEncoder.__init__T s. ** )<rd s ( ' ' ' ' '
!$ 8 8 84 < $+ + + + +v + + +0 vg 6* 6* B B B B, G G G G 8 @ !%X
1
1
1
1 0% 0% 0% 0% 0% 0% 0% 0%fL L L L L L L L L Lr