LMh8 ,ddlZddlZddlmZmZmZddlmZddlm Z m Z ddl m Z ddl mZmZddlmZddlmZejeZgd Ze jd e jd e jd iZe jhd e jddhe jhdiZd'dddedeedeedefdZ d(dedededeee eefddf dZ!ddddddde dedededeeded ee d!edefd"Z"dddd#de dedededeededefd$Z#de d%eddfd&Z$dS))N)AnyOptionalUnion)registry)KaggleDatasetAdapterPolarsFrameType)create_dataset_or_version)normalize_patternsupload_files_and_directories)parse_dataset_handle)EXTRA_CONSOLE_BLOCK)z.git/z*/.git/z.cache/z .huggingface/z hf-datasetszpandas-datasetszpolars-datasets> hf_kwargs sql_query pandas_kwargsrr>r polars_kwargspolars_frame_typeFforce_downloadhandlepathrreturnct|}td|ditt j|||\}}|S)aADownload dataset files Args: handle: (string) the dataset handle path: (string) Optional path to a file within a dataset force_download: (bool) Optional flag to force download a dataset, even if it's cached Returns: A string requesting the path to the requested dataset files. zDownloading Dataset:  ...)extrar)r loggerinfoto_urlr rdataset_resolver)rrrh_s R/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/kagglehub/datasets.pydataset_downloadr" sb V$$A KK8 888@WCV@WKXXX'4OOOGD! Klocal_dataset_dir version_notesignore_patternsc<t|}td|d|rd}t |t |dtt|}t|||dS)aUpload dataset files. Args: handle: (string) the dataset handle. local_dataset_dir: (string) path to a file in a local directory. version_notes: (string) Optional to write dataset versions. ignore_patterns (str or list[str], optional): Additional ignore patterns to DEFAULT_IGNORE_PATTERNS. Files matching any of the patterns are not uploaded. Patterns are standard wildcards that can be matched by https://docs.python.org/3/library/fnmatch.html. Use a pattern ending with "/" to ignore the whole dir, e.g., ".git/" is equivalent to ".git/*". zUploading Dataset rz1The dataset handle should not include the versiondataset)default additional) item_typer'N) r rrr is_versioned ValueErrorr r DEFAULT_IGNORE_PATTERNSr )rr%r&r'ris_versioned_exceptiontokenss r!dataset_uploadr2/s& V$$A KK5QXXZZ555666~~1!T/000 )*3JWfgggF a77777r#rrrrradapterrrrct||||||||n tj} |tjur#ddl}|j|||||S|tjur"ddl }|j ||||S|tj ur#ddl }|j|||||S|d} t!| #t"$r't$|} d| d | d } t#| dwxYw) aLoad a Kaggle Dataset into a python object based on the selected adapter Args: adapter: (KaggleDatasetAdapter) The adapter used to load the dataset handle: (string) The dataset handle path: (string) Path to a file within the dataset pandas_kwargs: (dict) Optional set of kwargs to pass to the pandas `read_*` method while constructing the DataFrame(s) sql_query: (string) Argument to be used for SQLite files. Required when reading a SQLite file. See pandas documentation for details: https://pandas.pydata.org/docs/reference/api/pandas.read_sql_query.html hf_kwargs: (dict) Optional set of kwargs to pass to Dataset.from_pandas() while constructing the Dataset polars_frame_type: (PolarsFrameType) Optional control for which Frame to return: LazyFrame or DataFrame. The default is PolarsFrameType.LAZY_FRAME. polars_kwargs: (dict) Optional set of kwargs to pass to the polars `read_*` method while constructing the DataFrame(s) Returns: A python object based on the selected adapter: - 'pandas': A DataFrame (or dict[int | str, DataFrame] for Excel-like files with multiple sheets) - 'hugging_face': A Huggingface Dataset (via pandas) - 'polars': A LazyFrame or DataFrame (or dict[int | str, LazyFrame] / dict[int | str, DataFrame] for Excel-like files with multiple sheets) r3Nrrrr)rr)rrrz is not yet implementedz*The 'dataset_load' function requires the 'z3' extras. Install them with 'pip install kagglehub[z]')validate_dataset_load_argsr LAZY_FRAMEr HUGGING_FACEkagglehub.hf_datasets hf_datasetsload_hf_datasetPANDASkagglehub.pandas_datasetspandas_datasetsload_pandas_datasetPOLARSkagglehub.polars_datasetspolars_datasetsload_polars_datasetNotImplementedError ImportError.DATASET_LOAD_ADAPTER_OPTIONAL_DEPENDENCIES_MAP) r4rrrrrrr kagglehubnot_implemented_error_messageadapter_optional_dependencyimport_warning_messages r! dataset_loadrLQsJ#+# .?-J))P_Pj!< *7 7 7 ( ( ( ((88+## 9 ,3 3 3 , , , ,,@@MYA ,3 3 3 , , , ,,@@0AQ^jsA 07,O,O,O )%&CDD D <<<&TU\&]# X9T X X8S X X X  011t;r6cdtjdtdt||||||S)NzCload_dataset is deprecated and will be removed in a future version.) stacklevelr6)warningswarnDeprecationWarningrL)r4rrrrrs r! load_datasetrSsE MMOano ]V_kt u u uur#kwargsc "t|}g}|D] \}}||vr|||!t|dkrdSd|}t |d|ddS)Nrz, z are invalid for z and will be ignored)_DATASET_LOAD_VALID_KWARGS_MAPitemsappendlenjoinrwarning)r4rT valid_kwargsinvalid_kwargs_listkeyvalueinvalid_kwargss r!r7r7s2':L%'llnn,, U l " "u'8  & &s + + + 1$$YY233N NNnTTwTTTUUUUUr#)N)r$N)%loggingrPtypingrrrrHrkagglehub.datasets_enumsrrkagglehub.datasets_helpersr kagglehub.gcs_uploadr r kagglehub.handler kagglehub.loggerr getLogger__name__rr/r9r=rArGrVstrboolr"listr2rLrSr7r#r!rns6''''''''''JJJJJJJJ@@@@@@QQQQQQQQ111111000000  8 $ $KJJ%}!2!22.%'R'R'R/;!?!T!T!T" bg   S  QYZ^Q_ lo    $7; 88 888eDIsN34 8  8888P#37O<O<O< !O< O<  O<  O<}O<O< 0O<O< O<O<O<O