MhXdZddlmZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z mZdd lmZdd lmZdd lmZmZmZdd lmZdd lmZmZiZeZgdZdZdZ d5dZ!d6dZ"d7dZ#dZ$dZ%dZ&dZ'GddeZ(dZ) d6dddd8d'Z*d9d*Z+d+Z,ddddddeefd:d0Z-d;d2Z.dzNotebook format validators.) annotationsN)deepcopy)Path)dedent)AnyOptional) import_item)generate_corpus_id)ValidationError_validator_for_nameget_current_validator) get_version)DuplicateCellIdMissingIDFieldWarning)r get_validatorisvalidNotebookValidationErrorbetter_validation_error normalizevalidate iter_validatect|tr7|D]!\}}|dkrdnt|}|||<"n>  >  T>>  >  T>> sGBA A;/ B;A??BA?B B1 B40B11B44CcN|sdSddd|DzS)z (from jsonschema._utils.format_as_index, copied to avoid relying on private API) Construct a single string containing indexing operations for the indices. For example, [1, 2, "foo"] -> [1][2]["foo"] r6z[%s]z][c34K|]}t|VdSN)repr).0indexs r% z#_format_as_index..s(??ed5kk??????r&)join)indicess r%_format_as_indexres7 r DII??w????? ??r&@ct|trdt|dtD}t|dtrdt |dzg|d<t|dtrdt |dzg|d<t |tkrdt |tz z|d<|St|tr`d |dtD}t |tkr-|d t |tz z|St|tr.|dt}t |tkr|dz }|S|S) zTruncate objects for use in validation tracebacks Cell and output lists are squashed, as are long strings, lists, and dicts. c4i|]\}}|t|S _truncate_obj)r`kr=s r% z!_truncate_obj..s&ZZZ$!Q!]1--ZZZr&Ncellsz...%i cells...outputsz...%i outputs...z%i keys truncatedz...c,g|]}t|Srjrk)r`items r% z!_truncate_obj..s LLL$---LLLr&z...%i items truncated...) rrrr _ITEM_LIMITgetlenr-rG _STR_LIMIT)r!truncated_dicttruncated_list truncated_strs r%rlrls #t ZZ$syy{{:K:KL[L:YZZZ n((114 8 8 M'7#c'l:K:K'K&LN7 # n((33T : : S);c#i.>Q>Q)Q(RN9 % s88k ! !$73s88k;Q$RN5 !#tLL#l{l:KLLL s88k ! !  ! !"<C;@V"W X X X#sKZK( s88j U "M Jr&c*eZdZdZddZdZdZeZdS)rzcSchema ValidationError with truncated representation to avoid massive verbose tracebacks. Ncl||_t|jd||_|jj|_dS)zInitialize the error class.rZN)originalr7rZmessage)selfr}rZs r%__init__z NotebookValidationError.__init__s.  4=%55}, r&c,t|j|S)z Get an attribute from the error.)r7r})rr"s r% __getattr__z#NotebookValidationError.__getattr__st}c***r&c Z|j}t|j}d|jdd|j|jpdtt|j ddddt|j ztj |d gS) zbCustom str for validation errors avoids dumping full schema and notebook to logs  r6zFailed validating {!r} in {}{}:notebookNzOn instance%s:N)width)r}rlinstancercr~format validatorrZrerrelative_schema_path relative_pathpprintpformat)rerrorrs r% __unicode__z#NotebookValidationError.__unicode__s   00yy 188OH* $T%*D%E%Ecrc%JKK  #3E4G#H#HHxr222    r&r^)__name__ __module__ __qualname____doc__rrr__str__rjr&r%rrsQ ---- +++   .GGGr&rc>t|js|S|jd}d}|drt|jt r0d|jvr|jddz}nd|jvr |jd}|r t |j|||nn#t$rV}|j |j|j|_t|||}|j ||_ |cYd}~Sd}~wt$rYnwxYwt||S)zGet better ValidationError on oneOf failures oneOf errors aren't informative. if it's a cell type or output_type error, try validating directly based on the type for a better error message rNOf cell_type_cell output_typer3)rvrMendswithrrrrr rextendrrZ Exceptionr)rr4r5r"rZ sub_errorbetters r%rrsf u ! !  B C C ||D end + + 4en,,n[1G;%.00n]3   N#"/  #   #**9+BCCC*/*= '0G]SS:%!$FJ      #5# . ..s%B!! D +A C<6D < D  D r<strip_invalid_metadatanbdictrr4 Optional[int]r5r<boolrreturntuple[int, Any]c~t|}t|\}}||}||}t|||d||S)a Normalise a notebook prior to validation. This tries to implement a couple of normalisation steps to standardise notebooks and make validation easier. You should in general not rely on this function and make sure the notebooks that reach nbformat are already in a normal form. If not you likely have a bug, and may have security issues. Parameters ---------- nbdict : dict notebook document version : int version_minor : int relax_add_props : bool Whether to allow extra property in the Json schema validating the notebook. strip_invalid_metadata : bool Whether to strip metadata that does not exist in the Json schema when validating the notebook. Returns ------- changes : int number of changes in the notebooks notebook : dict deep-copy of the original object with relevant changes. NTr)rr _normalize)rr4r5r<rnbdict_versionnbdict_version_minors r%rrscNf  F+6v+>+>(N( ,  '5    r&intrScd}||fdkr|dD]:}d|vr4tjdtd|rt|d<|dz };t }|dD]{}d|vr|d} | |vrS|r.Js,(((F (((r&z#/definitions/r)rrvrrr r error_treepoprurangerr.racontextrrM)rr4r5r<rrrrNrr"number_of_cellscell_idxintended_cell_typeschemas_by_indexcell_type_definition_name schema_indexrrel_patherror_for_intended_schemais_top_level_metadata_keys r%rrsw0- I IFG 4<<1!'+     'V7VV]VVVC!#&& &&&v..))&11  # #!*-  z"&&sD1111  j !&**Wa"8"899O!/22 - - j1(;BBB)/)B;)O&((#-g#6x#@#G#P#WX_#`((($1[AS0Z0Z0Z-04DDD'7'='=>W'X'X %/%8%B%I'%R%Z--E',':H8=8I!8LP\8\5 #H  2 Px{j7P6 9-=V- &w 9* E I I(ST+W[ \ \ \ '1  Nr&c #K|n||}nd}t||t|\}}|r6 t||||dd|zi}n`#t$r} | VYd} ~ dSd} ~ wwxYw|rt |||| t||||}n#t$r} | VYd} ~ dSd} ~ wwxYw|D]} t | ||VdS)atChecks whether the given notebook dict-like object conforms to the relevant notebook format schema. Returns a generator of all ValidationErrors if not valid. Notes ----- To fix: For security reasons, this function should *never* mutate its `nbdict` argument, and should *never* try to validate a mutated or modified version of its notebook. Nz5iter_validate() missing 1 required argument: 'nbdict'r+z#/definitions/%s)rrrr rr) rrZr4r5r<rYrrNrers r%rr^s]*  Enn!,V!4!4   +c12 FF   GGG FFFFF  " V $VWm_ U U U   -QQFF   GGG FFFFF EE%eWmDDDDDDEEs/A A%A  A%=B B)B$$B))NNFNrC)NNN) rrr4rr5rr<rrrrr)rrr4rr5rrSrr<rrrrr)rrrZrr4rr5rr<rrYrrSrrrrr) rrr4rr5rr<rrrrr) rrr4rr5rr<rrr)NNNNFNF)1r __future__rrKrrTcopyrpathlibrtextwraprtypingrr_importsr corpus.wordsr json_compatr r rreaderrrrr9objectr__all__rr/rr:rrertrwrlrrrrrrrrrrjr&r%rs!!#"""""  !!!!!!,,,,,,TTTTTTTTTT<<<<<<<<  fhh        )%)%)%)%X"!!!!. @ @ @  8'''''o'''T&/&/&/V"#'4 "#( 444444nBBBBJ   "!#'!&1#.cccccL*FFFFT    <E<E<E<E<E<Er&