Mh" R d Z ddlZddlZddlZddlmZ ddlmZ ddlm Z m
Z
m Z m Z m
Z
ddlmZ ddlmZ G d d
e Z G d d e Z G d
de Z G d de Z G d de Z G d de Z G d de Z G d de Z G d de Z G d d e Z G d d e Z G d d e Z G d! d"e Z G d# d$e Z G d% d&e Z g d'Z! G d( d)e Z" G d* d+e Z#dS ),a8 Tests for Beautiful Soup's tree traversal methods.
The tree traversal methods are the main advantage of using Beautiful
Soup over just using a parser.
Different parsers will build different Beautiful Soup trees given the
same markup, but all Beautiful Soup trees can be traversed with the
methods tested here.
N)
BeautifulSoup)builder_registry)!AttributeResemblesVariableWarningCDataCommentNavigableStringTag) SoupStrainer )SoupTestc B e Zd ZdZd Zd Zd Zd Zd Zd Z d Z
d Z d
S ) TestFindz&Basic tests of the find() method.
c p | d }| d j dk sJ d S )Nz 1234b2)soupfindstringselfr s S/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/bs4/tests/test_tree.py
test_find_tagzTestFind.test_find_tag" s8 yy;<<yy~~$++++++ c h | d }| d dk sJ d S )Nu Räksmörgås
Räksmörgåsr )r r r s r test_unicode_text_findz TestFind.test_unicode_text_find& s9 yy122yyy00OCCCCCCr c | d }t | d| d j k sJ d S )Nu& here it is
z
here it isr id)r strr textr s r test_unicode_attribute_findz$TestFind.test_unicode_attribute_find* sG yyABB D tyyOy < < AAAAAAAr c ~ | d }dt | k sJ dS )z)Test an optimization that finds all tags.foobar Nr lenfind_allr s r test_find_everythingz TestFind.test_find_everything/ s; yy/00C
((((((((r c | d }dt | d k sJ dS )z;Test an optimization that finds all tags with a given name.z foobarbazr& aNr' r s r test_find_everything_with_namez'TestFind.test_find_everything_with_name4 s? yy9::C
c**++++++++r c 6 | d }d| j k sJ d| d j k sJ d| d j k sJ d S )Nzdivpr r namefind_previous_siblingfind_next_siblingr s r test_find_with_no_argumentsz$TestFind.test_find_with_no_arguments9 s yy-.. ((((( #<<>>CCCCCdii&&88::???????r c 6 | d }d| j k sJ d| d j k sJ d| d j k sJ d S )N"texttext
texttext
r/ r0 r1 r s r +test_find_with_no_arguments_only_finds_tagsz4TestFind.test_find_with_no_arguments_only_finds_tags? s yy=>> ((((( #<<>>CCCCCdii&&88::???????r c | d }d| d j k sJ d | d k sJ d S )Nr7 r0 c | j dk S )Nr0 r2 ts r zETestFind.test_find_with_function_can_only_find_tags..G s !&#+ r c | dk S )Nr" r< s r r> zETestFind.test_find_with_function_can_only_find_tags..H s
1f9 r )r r r2 r s r *test_find_with_function_can_only_find_tagsz3TestFind.test_find_with_function_can_only_find_tagsE s_ yy=>>dii 5 566;;;;;tyy!4!455555555r N) __name__
__module__ __qualname____doc__r r r# r* r- r5 r8 rA r@ r r r r s , , ,D D DB B B
) ) )
, , ,
@ @ @ @ @ @ 6 6 6 6 6r r c 6 e Zd ZdZd Zd Zd Zd Zd Zd Z dS ) TestFindAllz%Basic tests of the find_all() method.c p | d }dt |j k sJ dt | d k sJ dt | d k sJ d S )Nz/texttext
texttext
r& r r0 r/ )r r( bodyr) r find_previous_siblingsfind_next_siblingsr s r /test_find_all_with_no_arguments_only_finds_tagsz;TestFindAll.test_find_all_with_no_arguments_only_finds_tagsM s yyJKKC **,,------C #==??@@@@@@C %((;;==>>>>>>>>r c F | d }| d dgk sJ | ddg ddgk sJ | t j d g dk sJ | d g dk sJ dS ) z'You can search the tree for text nodes.u Foobar»barr Fooz.*)rO rN »TN)r r) recompiler s r test_find_all_text_nodesz$TestFindAll.test_find_all_text_nodesS s yy9::}}E}**ug5555 }}UEN}33u~EEEE}}BJt$4$4}559O9O9OOOOO}}D}))-C-C-CCCCCCCr c | d }| | dd g d | | dd dg | | dd g d | | dd
g d d S ) z7You can limit the number of items returned by find_all.z(12345r, limit)1r 3r rX
)rX r rY 45r Nr assert_selectsr) r s r test_find_all_limitz TestFindAll.test_find_all_limit` s yyCDD DMM#QM 7 7 III DMM#QM 7 7#??? DMM#RM 8 8:S:S:STTT
DMM#QM 7 79R9R9RSSSSSr c | d }| |dd dg | | d dg d S ) Nz!123r, r rV rX foor rY )r r^ r r s r %test_calling_a_tag_is_calling_findallz1TestFindAll.test_calling_a_tag_is_calling_findallj sg yy<== DDA . . .666 DFFeF , ,se44444r c V | d }g }| | t j d 5 }g | | k sJ |\ }|j t k sJ t |j }|dk sJ d d d d S # 1 swxY w Y d S )NTrecordzLIgnoring nested list [[...]] to avoid the possibility of infinite recursion.) r appendwarningscatch_warningsr) filename__file__r! message)r r selfrefwwarningmsgs r Ttest_find_all_with_self_referential_data_structure_does_not_cause_infinite_recursionz`TestFindAll.test_find_all_with_self_referential_data_structure_does_not_cause_infinite_recursiono s yy##w
$D
1
1
1 Q w//////IW#x////go&&Cab b b b b
s AB B"%B"c | d }| d }t |d sJ | d }t |d sJ | d }t |d sJ dS )z%All find_all calls return a ResultSetrd r, sourceTra r N)r r) hasattrr r results r test_find_all_resultsetz#TestFindAll.test_find_all_resultset s yy## s##vx((((( t$$vx((((( e ,,vx(((((((r N)
rB rC rD rE rL rS r_ rb rq rw r@ r r rG rG J sz //? ? ? D D DT T T5 5 5
(
)
)
)
)
)r rG c e Zd Zd ZdS )TestFindAllBasicNamespacesc | d }d| d j k sJ d| ddi j k sJ d S )Nz04r[ z mathml:msqrtr, zsvg:fillredattrs)r r r r2 r s r test_find_by_namespaced_namez7TestFindAllBasicNamespaces.test_find_by_namespaced_name sa yyKLLdii//66666diiz5&9i::???????r N)rB rC rD r~ r@ r r ry ry s( @ @ @ @ @r ry c V e Zd ZdZddZd Zd Zd Zd Zd Z d
Z
d Z d Z d
Z
d ZdS )TestFindAllByNamez&Test ways of finding tags by tag name.returnNc : | d | _ d S )NzFirst tag.
Second tag.
Third Nested tag. tag.r treer s r setup_methodz TestFindAllByName.setup_method s# II J K K r c f | | j d ddg d S Nr,
First tag. Nested tag.r^ r r) r s r test_find_all_by_tag_namez+TestFindAllByName.test_find_all_by_tag_name s3 DI . .s 3 3lM5RSSSSSr c T | | j dd dg | | j dd ddg | | j dt j d ddg d S )Nr, r r Tr tagr^ r r) rQ rR r s r test_find_all_by_name_and_textz0TestFindAllByName.test_find_all_by_name_and_text s I s< 8 8<.
I s4 0 0< 2O
I s2:e+<+< = =
= )
r c n | | j j d dg d S )Nr, r )r^ r cr) r s r !test_find_all_on_non_root_elementz3TestFindAllByName.test_find_all_on_non_root_element s2 DIK 0 0 5 5
GGGGGr c \ | | d ddg d S r )r^ r r s r %test_calling_element_invokes_find_allz7TestFindAllByName.test_calling_element_invokes_find_all s- DIIcNN\=,IJJJJJr c | | j t d ddg d S r )r^ r r) r
r s r test_find_all_by_tag_strainerz/TestFindAllByName.test_find_all_by_tag_strainer sF I |C 0 0 1 1L-3P
r c j | | j ddg g d d S )Nr, r r z Second tag.r r r s r test_find_all_by_tag_namesz,TestFindAllByName.test_find_all_by_tag_names sD I Sz * *,X,X,X
r c l | | j ddd g d d S )NT)r, r r r r s r test_find_all_by_tag_dictz+TestFindAllByName.test_find_all_by_tag_dict sH I T 5 5 6 6 8 8 8
r c | | j t j d g d d S )Nz^[ab]$r r r s r test_find_all_by_tag_rez)TestFindAllByName.test_find_all_by_tag_re sJ I rz( 3 3 4 4 8 8 8
r c d }| d }| | | ddg d S )Nc > | j | d k S Nr )r2 getr s r id_matches_namezRTestFindAllByName.test_find_all_with_tags_matching_method..id_matches_name s 8swwt}}, ,r zMatch 1.
Does not match.
Match 2.zMatch 1.zMatch 2.r] )r r r s r 'test_find_all_with_tags_matching_methodz9TestFindAllByName.test_find_all_with_tags_matching_method sZ - - - yy 6 7 7
DMM/ : :Z12
3
r/ za dza brY rX )r r rQ rR r) r )r r r1r2r3r4s r %test_find_with_multi_valued_attributez7TestFindAllByName.test_find_with_multi_valued_attribute s yy V
YYue
$
$
YYubj 0 0
1
1 uuen55Bbi bi bi bi r r N)rB rC rD rE r r r r r r r r r r r r@ r r r r s 00K K K K
T T T
H H HK K K
V
V
V
r r c n e Zd Zd Zd Zd Zd Zd Zd Zd Z d Z
d Z d
Z d Z
d Zd
Zd Zd Zd ZdS )TestFindAllByAttributec | d }| | d ddg d S )Nz
Matching a.
Non-matching Matching b.a.
firstr z Matching a.z Matching b.r] r r s r test_find_all_by_attribute_namez6TestFindAllByAttribute.test_find_all_by_attribute_name sM yy ! " "
DMMWM 5 5
}7UVVVVVr c d d }d d }| | }|j g| | k sJ |j g| | d k sJ |j gs J | |dg d S )Nu םולשutf8u )titlezsomething else)encoder r, r) decode)r peacedatar s r %test_find_all_by_utf8_attribute_valuezName match.
Class match.
Non-match.
A tag called 'name1'.
name1r; zA tag called 'name1'.r2 r| z Name match.classclass2z Class match.r] r s r test_find_all_by_attribute_dictz6TestFindAllByAttribute.test_find_all_by_attribute_dict s yy
DMMwM 7 7:Q9RSSS DMM0AM B B]OTTT DMM(0CM D D~FVWWWWWr c | d }| | dd dg | | dd dg | | dd dg | | dd dg | | d
ddg | | dd dg | | dd dg d S ) Nz
Class 1.
Class 2.
Class 1.
Class 3 and 4.
r, rX class_zClass 1.r rY zClass 3 and 4.r[ r| r] r s r test_find_all_by_classz-TestFindAllByAttribute.test_find_all_by_class s? yy
DMM#cM : :ZLIII DMM#cM : :=MFound itgaror Found itr, zo b)r r) rQ rR r^ )r r fs r 0test_find_by_class_when_multiple_classes_presentzGTestFindAllByAttribute.test_find_by_class_when_multiple_classes_present s yy>?? MM%
3M 8 8 A
|,,, MM%
3M 8 8 A
|,,,
MM%
5(9(9M : : A
|,,,,,r c ` | d }| | dt j d dg d }| | d| g d }| | d| dg d S )NzFound itr, bar c ( t | dk S NrU r( values r big_attribute_valueznTestFindAllByAttribute.test_find_all_with_non_dictionary_for_attrs_finds_by_class..big_attribute_value3 s u::> !r c ( t | dk S r r r s r small_attribute_valuezpTestFindAllByAttribute.test_find_all_with_non_dictionary_for_attrs_finds_by_class..small_attribute_value8 s u::? "r r r^ r) rQ rR )r r r r s r :test_find_all_with_non_dictionary_for_attrs_finds_by_classzQTestFindAllByAttribute.test_find_all_with_non_dictionary_for_attrs_finds_by_class. s yy677 DMM#rz$/?/? @ @:,OOO " " "
DMM#/B C CRHHH # # #
DMM#/D E E
|TTTTTr c | d }| d \ }}||gs J | dd |gs J | dd |g| dd k sJ |g| dd k sJ g | dd k sJ d S )Nz*r, ra rN zfoo barr zbar foor r) )r r r, a2s r :test_find_all_with_string_for_attrs_finds_multiple_classeszQTestFindAllByAttribute.test_find_all_with_string_for_attrs_finds_multiple_classes= s yyEFF
c""22w11
c511111s--DMM#u----- sdmmC m::::::sdmmC333333T]]3 22222222r c | d }t ddi }| | | dg d S )Nzi
Match.
Non-match.r r r| zMatch.)r r
r^ r) )r r strainers r 'test_find_all_by_attribute_soupstrainerz>TestFindAllByAttribute.test_find_all_by_attribute_soupstrainerI sZ yy : ; ; tWo666 DMM( 3 3hZ@@@@@r c | d }| | dd dg d S )NID present.
No ID present.
ID is empty.r, r zNo ID present.r] r s r $test_find_all_with_missing_attributez;TestFindAllByAttribute.test_find_all_with_missing_attributeQ sN yy 9 : :
DMM#$M 7 7:J9KLLLLLr c | d }| | d ddg d S )Nr Tr z ID present.z ID is empty.r] r s r $test_find_all_with_defined_attributez;TestFindAllByAttribute.test_find_all_with_defined_attributeY sM yy 9 : :
DMMTM 2 2]N4STTTTTr c | d }ddg}| | d | | | d | d S )Nz[Unquoted attribute.
Quoted attribute.zUnquoted attribute.zQuoted attribute.r r rX r] )r r expecteds r $test_find_all_with_numeric_attributez;TestFindAllByAttribute.test_find_all_with_numeric_attributea sw yy ? @ @ *+>? DMMQM / /::: DMMSM 1 18<<<<1
2
3
No ID.)rX rY r[ r rX rY r] r s r (test_find_all_with_list_attribute_valuesz?TestFindAllByAttribute.test_find_all_with_list_attribute_valuesj sv yy - . .
DMM___M = =SzJJJ
DMMRM 0 0"55555r c | d }| | t j d ddg d S )NzOne a.
Two as.
Mixed as and bs.
One b.
No ID.z^a+$r zOne a.zTwo as.r r s r 5test_find_all_with_regular_expression_attribute_valuezLTestFindAllByAttribute.test_find_all_with_regular_expression_attribute_valuev sW yy - . .
DMMRZ-?-?M @ @8YBWXXXXXr c | d }|j }|g| dd k sJ g | dd k sJ d S )Nz foobarfoor, ra r rN r r, r) r r r, s r 'test_find_by_name_and_containing_stringz>TestFindAllByAttribute.test_find_by_name_and_containing_string se yy9:: FsdmmCm666666T]]3u]55555555r c | d }| d | dd k sJ d S )Nz"foofoor, ra r r r s r =test_find_by_name_and_containing_string_when_string_is_buriedzTTestFindAllByAttribute.test_find_by_name_and_containing_string_when_string_is_buried sG yy=>>}}S!!T]]3u]%E%EEEEEEEr c | d }|j }|g| dd k sJ g | dd k sJ d S )Nz"foofoor& ra )r r r rN r r s r ,test_find_by_attribute_and_containing_stringzCTestFindAllByAttribute.test_find_by_attribute_and_containing_string se yy=>> Fsdmmqm777777T]]a]66666666r N)rB rC rD r r r r r r r r r r r r r r r r r@ r r r r s" W W WH H HX X X$I I I( - - -
U
U
U
3
3
3A A AM M MU U U= = =
6
6
6
Y
Y
Y6 6 6F F F7 7 7 7 7r r c e Zd ZdZd ZdS )
TestSmoothzTest Tag.smooth.c R | d }|j }| d | d | t d | t d | d | }t ||d }| d | d | | d |j j u sJ d
t |j k sJ |
d t |j k sJ d |j d
k sJ d|j j k sJ d|j d k sJ d|j d k sJ d S )Nz a
r r z Comment 1z Comment 2dspanrX r abcr 12r r& ) r r/ rg r default_builderr r r r( contentssmooth)r r r/ builderr s r test_smoothzTestSmooth.test_smooth s yy ((h
3
3
7;''(((
7;''(((
3&&((4&)) C C
4 sx&&&&C %%%%%%
C %%%%%%
Q'''' sx&&&&
cl1o----cl1o------r N)rB rC rD rE r r@ r r r r s) &. &. &. &. &.r r c e Zd ZdZd ZdS ) TestIndexzTest Tag.indexc 6 | d }|j }t |j D ] \ }}|| | k sJ !t j t 5 | d d d d d S # 1 swxY w Y d S )Nah
Identical
Not identical
Identical
Identical with child
Also not identical
Identical with child
r )r r/ enumerater indexpytestraises
ValueError)r r r/ ielements r
test_indexzTestIndex.test_index s yy & ' ' h#CL11 + +JAw '*******
]:
&
& JJqMMM s +BBBN)rB rC rD rE r r@ r r r r s) r r c P e Zd ZdZddZd Zd Zd Zd Zd Z d
Z
d Z d Z d
Z
dS )TestParentOperationsz;Test navigation and searching through an element's parents.r Nc \ | d | _ | j j | _ d S )Na<
)r r r startr s r r z!TestParentOperations.setup_method s- II + , , Y[
r c | j j d dk sJ | j j j d dk sJ | j j j j d dk sJ d S )Nr bottommiddletop)r
parentr s r test_parentz TestParentOperations.test_parent sb z &(2222z '-9999z '.t4======r c N | j j d }|j | j k sJ d S )Nr )r r r )r top_tags r %test_parent_of_top_tag_is_soup_objectz:TestParentOperations.test_parent_of_top_tag_is_soup_object s, )$Q'~******r c & d | j j u sJ d S N)r r r s r test_soup_object_has_no_parentz3TestParentOperations.test_soup_object_has_no_parent s ty'''''''r c
| | j d g d | | j dd dg | j d g k sJ d S )Nulr r r r r r
)assert_selects_idsr
find_parentsr s r test_find_parentsz&TestParentOperations.test_find_parents s J # #D ) )+F+F+F
7 7 7 J JXJWWWz&&'&22b888888r c | j dd d dk sJ | j d J d S )Nr r r r r
)r
find_parentr s r test_find_parentz%TestParentOperations.test_find_parent sR z%%du%55d;uDDDDz%%%1199999r c ` | j d }|j j dk sJ d S )N
Start herer r )r r r r2 r r" s r test_parent_of_text_elementz0TestParentOperations.test_parent_of_text_element s3 y~~\~22{ 3&&&&&&r c ~ | j d }| d d dk sJ d S )Nr$ r r r r )r r r! r% s r test_text_element_find_parentz2TestParentOperations.test_text_element_find_parent sA y~~\~22 %%d+x777777r c F d | j j D }|g dk sJ d S )Nc 4 g | ]}|d|j v
|d S r r| .0r s r
z>TestParentOperations.test_parent_generator.. 8
!dfl&:&:
4L&:&:&:r r )r
parents)r r/ s r test_parent_generatorz*TestParentOperations.test_parent_generator sE
*,
555555555r c F d | j j D }|g dk sJ d S )Nc 4 g | ]}|d|j v
|d S r r| r+ s r r- zGTestParentOperations.test_self_and_parent_generator.. r. r )r
r r r )r
self_and_parents)r resultss r test_self_and_parent_generatorz3TestParentOperations.test_self_and_parent_generator sE
*5
>>>>>>>>>r r )rB rC rD rE r r r r r r" r& r( r0 r5 r@ r r r r s EE! ! ! !> > >
+ + +( ( (9 9 9: : : ' ' '8 8 86 6 6? ? ? ? ?r r c e Zd ZddZdS )
ProximityTestr Nc : | d | _ d S )NzOneTwoThreer r s r r zProximityTest.setup_method s! II
P
r r rB rC rD r r@ r r r7 r7 s(
r r7 c J e Zd Zd fd Zd Zd Zd Zd Zd Zd Z d
Z
xZ S ) TestNextOperationsr Nc x t t | | j j | _ d S r )superr; r r r r
r __class__s r r z TestNextOperations.setup_method s/
$''44666Y[
r c d | j j dk sJ | j j j d dk sJ d S )NOner r )r
next_elementr s r test_nextz TestNextOperations.test_next s< z&%////z&3D9S@@@@@@r c N | j d }|j J d S NThreer )r r rB )r lasts r test_next_of_last_item_is_nonez1TestNextOperations.test_next_of_last_item_is_none$ s, y~~W~-- (((((r c " | j j J d S r )r rB r s r test_next_of_root_is_nonez,TestNextOperations.test_next_of_root_is_none( s y%-----r c | | j d ddg | j d | | j d dg d S )Nr TworF rU r )r^ r
find_all_nextr s r test_find_all_nextz%TestNextOperations.test_find_all_next, sw DJ 4 4S 9 9E7;KLLL
A &&& DJ 4 4 4 : :WIFFFFFr c | j d d dk sJ | j d dk sJ d S )Nr r r rF r )r
find_nextr s r test_find_nextz!TestNextOperations.test_find_next1 sR z##C((.#5555z##7#33w>>>>>>r c | j d }| d j dk sJ | | d ddg d S )NrA r r rL rF )r r rP r r^ rM r% s r test_find_next_for_text_elementz2TestNextOperations.test_find_next_for_text_element5 sf y~~U~++~~c"")U2222 D . .s 3 3eW5EFFFFFr c | j d }d |j D }|\ }}|d dk sJ |dk sJ d |j D }|dd |k sJ |d |k sJ d S )
NrL r c g | ]}|S r@ r@ r, nodes r r- z;TestNextOperations.test_next_generators..< s ;;;td;;;r r rY rF c g | ]}|S r@ r@ rV s r r- z;TestNextOperations.test_next_generators..B s EEEtEEEr r r )r r
next_elementsself_and_next_elements)r r
successorsr r successors2s r test_next_generatorsz'TestNextOperations.test_next_generators: s e,,;;u':;;;
"
X4yC 7""""EE(DEEE 122*,,,,1~&&&&&&r r ) rB rC rD r rC rH rJ rN rQ rS r]
__classcell__r? s @r r; r; s ! ! ! ! ! !A A A) ) ). . .G G G
? ? ?G G G
'
'
'
'
'
'
'r r; c J e Zd Zd fd Zd Zd Zd Zd Zd Zd Z d
Z
xZ S ) TestPreviousOperationsr Nc t t | | j d | _ d S rE )r= ra r r r endr> s r r z#TestPreviousOperations.setup_methodH s;
$d++88:::9>>>11r c d | j j d dk sJ | j j j dk sJ d S )Nr rY rL )rc previous_elementr s r
test_previousz$TestPreviousOperations.test_previousL s< x(.#5555x(9UBBBBBBr c L | j d }|j J d S )Nhtml)r r re )r r s r #test_previous_of_first_item_is_nonez:TestPreviousOperations.test_previous_of_first_item_is_noneP s* v&&%-----r c " | j j J d S r )r re r s r test_previous_of_root_is_nonez4TestPreviousOperations.test_previous_of_root_is_noneT s y)11111r c | | j d g d | | j d dg d S )Nr rF rL rA r r rA )r^ rc find_all_previousr s r test_find_all_previousz-TestPreviousOperations.test_find_all_previousX sb
DH 6 6s ; ;=T=T=TUUU DH 6 6! 6 <