0PhVddlZddlmZmZddlmZddlZddlmZm Z m Z m Z m Z ddl mZmZmZddlmZmZmZmZddlmZmZmZmZmZdd lmZdd lmZm Z m!Z!d gZ"Gd d e e eZ#dS) N)IntegralReal)warn) BaseEstimatorClassifierMixinMetaEstimatorMixin _fit_contextclone)Bunchget_tags safe_mask) HasMethodsHiddenInterval StrOptions)MetadataRouter MethodMapping_raise_for_params_routing_enabledprocess_routing) available_if)_estimator_hascheck_is_fitted validate_dataSelfTrainingClassifierc veZdZUdZdedggedgeedhgeedddged d hgee d ddgee d dddgd gdZ e e d< d#dZ dZeddZeeddZeeddZeeddZeeddZeedd Zd!Zfd"ZxZS)$raSelf-training classifier. This :term:`metaestimator` allows a given supervised classifier to function as a semi-supervised classifier, allowing it to learn from unlabeled data. It does this by iteratively predicting pseudo-labels for the unlabeled data and adding them to the training set. The classifier will continue iterating until either max_iter is reached, or no pseudo-labels were added to the training set in the previous iteration. Read more in the :ref:`User Guide `. Parameters ---------- estimator : estimator object An estimator object implementing `fit` and `predict_proba`. Invoking the `fit` method will fit a clone of the passed estimator, which will be stored in the `estimator_` attribute. .. versionadded:: 1.6 `estimator` was added to replace `base_estimator`. base_estimator : estimator object An estimator object implementing `fit` and `predict_proba`. Invoking the `fit` method will fit a clone of the passed estimator, which will be stored in the `estimator_` attribute. .. deprecated:: 1.6 `base_estimator` was deprecated in 1.6 and will be removed in 1.8. Use `estimator` instead. threshold : float, default=0.75 The decision threshold for use with `criterion='threshold'`. Should be in [0, 1). When using the `'threshold'` criterion, a :ref:`well calibrated classifier ` should be used. criterion : {'threshold', 'k_best'}, default='threshold' The selection criterion used to select which labels to add to the training set. If `'threshold'`, pseudo-labels with prediction probabilities above `threshold` are added to the dataset. If `'k_best'`, the `k_best` pseudo-labels with highest prediction probabilities are added to the dataset. When using the 'threshold' criterion, a :ref:`well calibrated classifier ` should be used. k_best : int, default=10 The amount of samples to add in each iteration. Only used when `criterion='k_best'`. max_iter : int or None, default=10 Maximum number of iterations allowed. Should be greater than or equal to 0. If it is `None`, the classifier will continue to predict labels until no new pseudo-labels are added, or all unlabeled samples have been labeled. verbose : bool, default=False Enable verbose output. Attributes ---------- estimator_ : estimator object The fitted estimator. classes_ : ndarray or list of ndarray of shape (n_classes,) Class labels for each output. (Taken from the trained `estimator_`). transduction_ : ndarray of shape (n_samples,) The labels used for the final fit of the classifier, including pseudo-labels added during fit. labeled_iter_ : ndarray of shape (n_samples,) The iteration in which each sample was labeled. When a sample has iteration 0, the sample was already labeled in the original dataset. When a sample has iteration -1, the sample was not labeled in any iteration. n_features_in_ : int Number of features seen during :term:`fit`. .. versionadded:: 0.24 feature_names_in_ : ndarray of shape (`n_features_in_`,) Names of features seen during :term:`fit`. Defined only when `X` has feature names that are all strings. .. versionadded:: 1.0 n_iter_ : int The number of rounds of self-training, that is the number of times the base estimator is fitted on relabeled variants of the training set. termination_condition_ : {'max_iter', 'no_change', 'all_labeled'} The reason that fitting was stopped. - `'max_iter'`: `n_iter_` reached `max_iter`. - `'no_change'`: no new labels were predicted. - `'all_labeled'`: all unlabeled samples were labeled before `max_iter` was reached. See Also -------- LabelPropagation : Label propagation classifier. LabelSpreading : Label spreading model for semi-supervised learning. References ---------- :doi:`David Yarowsky. 1995. Unsupervised word sense disambiguation rivaling supervised methods. In Proceedings of the 33rd annual meeting on Association for Computational Linguistics (ACL '95). Association for Computational Linguistics, Stroudsburg, PA, USA, 189-196. <10.3115/981658.981684>` Examples -------- >>> import numpy as np >>> from sklearn import datasets >>> from sklearn.semi_supervised import SelfTrainingClassifier >>> from sklearn.svm import SVC >>> rng = np.random.RandomState(42) >>> iris = datasets.load_iris() >>> random_unlabeled_points = rng.rand(iris.target.shape[0]) < 0.3 >>> iris.target[random_unlabeled_points] = -1 >>> svc = SVC(probability=True, gamma="auto") >>> self_training_model = SelfTrainingClassifier(svc) >>> self_training_model.fit(iris.data, iris.target) SelfTrainingClassifier(...) Nfit deprecatedgg?left)closed thresholdk_bestrverbose) estimatorbase_estimatorr" criterionr#max_iterr%_parameter_constraints? Fch||_||_||_||_||_||_||_dSN)r&r"r(r#r)r%r')selfr&r'r"r(r#r)r%s f/var/www/html/test/jupyter/venv/lib/python3.11/site-packages/sklearn/semi_supervised/_self_training.py__init__zSelfTrainingClassifier.__init__s>#""    -c*|j5|jdkr*t|j}tdtnV|j|jdkrt d|j|jdkrt dt|j}|S)zGet the estimator. Returns ------- estimator_ : estimator object The cloned estimator object. Nrzg`base_estimator` has been deprecated in 1.6 and will be removed in 1.8. Please use `estimator` instead.zFYou must pass an estimator to SelfTrainingClassifier. Use `estimator`.zLYou must pass only one estimator to SelfTrainingClassifier. Use `estimator`.)r&r'r r FutureWarning ValueError)r/ estimator_s r0_get_estimatorz%SelfTrainingClassifier._get_estimators > !d&9\&I&It233J ?     ^ #(;|(K(K$ ^ 'D,?<,O,O$  t~..Jr2)prefer_skip_nested_validationc t||d||_t|||gdd\}}|jjdvrt d|dk}tj|rtj dt|j d krE|j |jd tj|z krtj d tt!rt#|dfi|}nt%t%i  }tj||_tj|d|_d |j|<d |_tj|s |j|j|jkr|xjdz c_|jj|t5|||j|fi|jj|j|t5||}|jjtj|d}tj|d}|j dkr ||j k} nktC|j |jd } | |jd krtj"|tF} ntj$| | d| } tj%|d | } || |j| <d|| <|j|j| <| jd d krd|_&nZ|j'r&tQd|jd| jd dtj|s|j|j|jk|j|jkrd|_&tj|rd|_&|jj|t5|||j|fi|jj|jj|_|S)av Fit self-training classifier using `X`, `y` as training data. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. y : {array-like, sparse matrix} of shape (n_samples,) Array representing the labels. Unlabeled samples should have the label -1. **params : dict Parameters to pass to the underlying estimators. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- self : object Fitted estimator. r)csrcsclildokF) accept_sparseensure_all_finite)USz~y has dtype string. If you wish to predict on string targets, use dtype object, and use -1 as the label for unlabeled samples.zy contains no unlabeled samplesr#rzsk_best is larger than the amount of unlabeled samples. All unlabeled samples will be labeled in the first iteration)rr&Nr$)axisr")dtypeT no_changezEnd of iteration z, added z new labels.r) all_labeled))rr7r6rrEkindr5npallwarningsr UserWarningr(r#shapesumrrr copy transduction_ full_like labeled_iter_n_iter_r)rrr& predict_probaclasses_argmaxmaxr"min ones_likebool argpartitionnonzerotermination_condition_r%print) r/Xyparams has_label routed_paramsprobpred max_probaselected n_to_select selected_fulls r0rzSelfTrainingClassifier.fitsC@ &$...--//  666#    1 7<: % %7  G 6)   J M;[ I I I >X % % K!'!*rvi'8'88 8 8 M*        ;+D%BB6BBMM!EbMMM:::MWQZZ\!R00()9% &##+  M !T\DM%A%A LLA LL DO )Ay))*"9-   )-   ?009Q 3K3K1LMMD?+BId,C,C,CDDt!,,,I~,,$t~5!$+yq/ABB )/!"444!|ITBBBHH " z;GG  UHJ z2215h?M15XD } -'+Im $04 D } -"1%**.9+| C CC+1!4CCCQ&##+  M !T\DM%A%AX <4= ( (*4D ' 6)   8*7D ' i9%% &  y )  %)   0  r2predictc t|t||dtrt|dfi|}nt t i}t ||ddd}|jj|fi|jjS)aPredict the classes of `X`. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. **params : dict of str -> object Parameters to pass to the underlying estimator's ``predict`` method. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- y : ndarray of shape (n_samples,) Array with predicted labels. rj)rjrCTFr>r?reset) rrrrr rr6rjr&r/r_rarcs r0rjzSelfTrainingClassifier.predictss0 &$ 222    ?+D)FFvFFMM!E",=,=,=>>>M   #    't&qLLM,C,KLLLr2rTc t|t||dtrt|dfi|}nt t i}t ||ddd}|jj|fi|jjS)a%Predict probability for each possible outcome. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. **params : dict of str -> object Parameters to pass to the underlying estimator's ``predict_proba`` method. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- y : ndarray of shape (n_samples, n_features) Array with prediction probabilities. rT)rTrCTFrl) rrrrr rr6rTr&rns r0rTz$SelfTrainingClassifier.predict_probas2 &$888    E+D/LLVLLMM!E,C,C,CDDDM   #    -t,QXX-2I2WXXXr2decision_functionc t|t||dtrt|dfi|}nt t i}t ||ddd}|jj|fi|jjS)a4Call decision function of the `estimator`. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. **params : dict of str -> object Parameters to pass to the underlying estimator's ``decision_function`` method. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- y : ndarray of shape (n_samples, n_features) Result of the decision function of the `estimator`. rp)rprCTFrl) rrrrr rr6rpr&rns r0rpz(SelfTrainingClassifier.decision_function2 &$(;<<<    I+D2EPPPPMM!EB,G,G,GHHHM   #    1t0   (:   r2predict_log_probac t|t||dtrt|dfi|}nt t i}t ||ddd}|jj|fi|jjS)a1Predict log probability for each possible outcome. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. **params : dict of str -> object Parameters to pass to the underlying estimator's ``predict_log_proba`` method. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- y : ndarray of shape (n_samples, n_features) Array with log prediction probabilities. rs)rsrCTFrl) rrrrr rr6rsr&rns r0rsz(SelfTrainingClassifier.predict_log_probarrr2scorec t|t||dtrt|dfi|}nt t i}t ||ddd}|jj||fi|jjS)aBCall score on the `estimator`. Parameters ---------- X : {array-like, sparse matrix} of shape (n_samples, n_features) Array representing the data. y : array-like of shape (n_samples,) Array representing the labels. **params : dict of str -> object Parameters to pass to the underlying estimator's ``score`` method. .. versionadded:: 1.6 Only available if `enable_metadata_routing=True`, which can be set by using ``sklearn.set_config(enable_metadata_routing=True)``. See :ref:`Metadata Routing User Guide ` for more details. Returns ------- score : float Result of calling score on the `estimator`. ru)rurCTFrl) rrrrr rr6rur&)r/r_r`rarcs r0ruzSelfTrainingClassifier.score"s6 &$000    =+D'DDVDDMM!EOOO<<` on how the routing mechanism works. .. versionadded:: 1.6 Returns ------- routing : MetadataRouter A :class:`~sklearn.utils.metadata_routing.MetadataRouter` encapsulating routing information. )ownerr)calleecallerrurjrTrprs)r&method_mapping)r __class____name__addr&r)r/routers r0get_metadata_routingz+SelfTrainingClassifier.get_metadata_routingOs dn&=>>> nE%00GE22Ii88OODD/8KLL/8KLLGG44   r2ct}|j(t|jjj|j_|Sr.)super__sklearn_tags__r&r input_tagssparse)r/tagsr|s r0rz'SelfTrainingClassifier.__sklearn_tags__ms?ww'')) > %%-dn%=%=%H%ODO " r2)Nrr+r"r,r,F)r} __module__ __qualname____doc__rrrrrrr*dict__annotations__r1r7r rrrrjrTrprsrurr __classcell__)r|s@r0rr s~~HJJw//0 Jw   F::|n-- . . htS#f===> j+x!899:8Haf===>Xh4???F;$$D&#----(   D\&+EE EN\..++,,'M'M-,'MR\..1122(Y(Y32(YT\..!45566* * 76* X\..!45566* * 76* X\..))***L*L+**LX<r2)$rKnumbersrrrnumpyrIbaserrr r r utilsr r rutils._param_validationrrrrutils.metadata_routingrrrrrutils.metaestimatorsrutils.validationrrr__all__rr2r0rs""""""""/.........NNNNNNNNNNNN0/////MMMMMMMMMM # $ R R R R R _.@-R R R R R r2