Index

_

__eq__() (nannyml.performance_calculation.metrics.base.Metric method) (nannyml.performance_estimation.confidence_based.metrics.Metric method) (nannyml.performance_estimation.direct_loss_estimation.metrics.Metric method)

__len__() (nannyml.chunk.Chunk method) __new__() (nannyml.performance_estimation.confidence_based.cbpe.CBPE static method) __repr__() (nannyml.chunk.Chunk method)

A

AbstractCalculator (class in nannyml.base) AbstractCalculatorResult (class in nannyml.base) AbstractEstimator (class in nannyml.base) AbstractEstimatorResult (class in nannyml.base) accuracy_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) accuracy_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification)

Alert ALERT_COLUMN_SUFFIX (nannyml.drift.ranking.AlertCountRanking attribute) AlertCountRanking (class in nannyml.drift.ranking) analysis_data (nannyml.config.InputConfig attribute) auroc_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) auroc_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification)

B

BinaryClassificationAccuracy (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics) BinaryClassificationAUROC (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics) BinaryClassificationF1 (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics) BinaryClassificationPrecision (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics)

BinaryClassificationRecall (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics) BinaryClassificationSpecificity (class in nannyml.performance_calculation.metrics.binary_classification) (class in nannyml.performance_estimation.confidence_based.metrics) BLUE_SKY_CRAYOLA (nannyml.plots.colors.Colors attribute) Butterfly dataset by() (nannyml.drift.ranking.Ranker class method)

C

calculate() (nannyml.base.AbstractCalculator method) (nannyml.performance_calculation.metrics.base.Metric method) calculator_name (nannyml.performance_calculation.result.Result property) CalculatorException CalculatorNotFittedException calibrate() (nannyml.calibration.Calibrator method) (nannyml.calibration.IsotonicCalibrator method) (nannyml.calibration.NoopCalibrator method) Calibrator (class in nannyml.calibration) CalibratorFactory (class in nannyml.calibration) CBPE (class in nannyml.performance_estimation.confidence_based.cbpe) (Confidence-Based Performance Estimation) Chi Squared test Child model Chunk (class in nannyml.chunk) chunk_count (nannyml.config.ChunkerConfig attribute) chunk_period (nannyml.config.ChunkerConfig attribute) chunk_size (nannyml.config.ChunkerConfig attribute) Chunker (class in nannyml.chunk)

chunker (nannyml.config.Config attribute) ChunkerConfig (class in nannyml.config) ChunkerException ChunkerFactory (class in nannyml.chunk) Colors (class in nannyml.plots.colors) column_mapping (nannyml.config.Config attribute) ColumnMapping (class in nannyml.config) Concept Drift Confidence Band Confidence Score Config (class in nannyml.config) CountBasedChunker (class in nannyml.chunk) Covariate Shift create() (nannyml.calibration.CalibratorFactory class method) (nannyml.performance_calculation.metrics.base.MetricFactory class method) (nannyml.performance_estimation.confidence_based.metrics.MetricFactory class method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MetricFactory class method) credentials (nannyml.config.InputDataConfig attribute) (nannyml.config.OutputConfig attribute)

D

Data Chunk Data Drift Data Period

DataReconstructionDriftCalculator (class in nannyml.drift.model_inputs.multivariate.data_reconstruction.calculator) DEFAULT_CHUNK_COUNT (nannyml.chunk.DefaultChunker attribute) DefaultChunker (class in nannyml.chunk) DLE (class in nannyml.performance_estimation.direct_loss_estimation.dle)

E

Error estimate() (nannyml.base.AbstractEstimator method) (nannyml.performance_estimation.confidence_based.metrics.Metric method) (nannyml.performance_estimation.direct_loss_estimation.metrics.Metric method) estimate_f1() (in module nannyml.performance_estimation.confidence_based.metrics) estimate_precision() (in module nannyml.performance_estimation.confidence_based.metrics)

estimate_recall() (in module nannyml.performance_estimation.confidence_based.metrics) estimate_roc_auc() (in module nannyml.performance_estimation.confidence_based.metrics) estimate_specificity() (in module nannyml.performance_estimation.confidence_based.metrics) Estimated Performance estimator_name (nannyml.performance_estimation.confidence_based.results.Result property) (nannyml.performance_estimation.direct_loss_estimation.result.Result property)

F

f1_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) f1_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) Feature features (nannyml.config.ColumnMapping attribute) FileReader (class in nannyml.io.file_reader) FileWriter (class in nannyml.io.file_writer)

fit() (nannyml.base.AbstractCalculator method) (nannyml.base.AbstractEstimator method) (nannyml.calibration.Calibrator method) (nannyml.calibration.IsotonicCalibrator method) (nannyml.calibration.NoopCalibrator method) (nannyml.performance_calculation.metrics.base.Metric method) (nannyml.performance_estimation.confidence_based.metrics.Metric method) (nannyml.performance_estimation.direct_loss_estimation.metrics.Metric method) format (nannyml.config.OutputConfig attribute)

G

get_chunker() (nannyml.chunk.ChunkerFactory class method) get_config_path() (in module nannyml.config) get_filepath_str() (in module nannyml.io.base) get_protocol_and_path() (in module nannyml.io.base)

GRAY (nannyml.plots.colors.Colors attribute) GRAY_DARK (nannyml.plots.colors.Colors attribute) GREEN_SEA (nannyml.plots.colors.Colors attribute) Ground truth

I

Identifier ignore_errors (nannyml.config.Config attribute) Imputation INDIGO_PERSIAN (nannyml.plots.colors.Colors attribute) input (nannyml.config.Config attribute)

InputConfig (class in nannyml.config) InputDataConfig (class in nannyml.config) InvalidArgumentsException InvalidReferenceDataException IOException IsotonicCalibrator (class in nannyml.calibration)

J

join_column (nannyml.config.TargetDataConfig attribute)

K

Kolmogorov-Smirnov test

L

Latent space LIGHT_GRAY (nannyml.plots.colors.Colors attribute) load() (nannyml.config.Config class method) load_csv_file_to_df() (in module nannyml.datasets.datasets) load_modified_california_housing_dataset() (in module nannyml.datasets.datasets)

load_synthetic_binary_classification_dataset() (in module nannyml.datasets.datasets) load_synthetic_car_loan_dataset() (in module nannyml.datasets.datasets) load_synthetic_car_price_dataset() (in module nannyml.datasets.datasets) load_synthetic_multiclass_classification_dataset() (in module nannyml.datasets.datasets) Loss Loss Function

M

MAE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) mae_sampling_error() (in module nannyml.sampling_error.regression) mae_sampling_error_components() (in module nannyml.sampling_error.regression) MAPE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) mape_sampling_error() (in module nannyml.sampling_error.regression) mape_sampling_error_components() (in module nannyml.sampling_error.regression) Metric (class in nannyml.performance_calculation.metrics.base) (class in nannyml.performance_estimation.confidence_based.metrics) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) MetricFactory (class in nannyml.performance_calculation.metrics.base) (class in nannyml.performance_estimation.confidence_based.metrics) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) MissingMetadataException Model inputs Model outputs Model predictions module nannyml nannyml.base nannyml.calibration nannyml.chunk nannyml.cli nannyml.cli.cli nannyml.cli.run nannyml.config nannyml.datasets nannyml.datasets.data nannyml.datasets.datasets nannyml.drift nannyml.drift.model_inputs nannyml.drift.model_inputs.multivariate nannyml.drift.model_inputs.multivariate.data_reconstruction nannyml.drift.model_inputs.multivariate.data_reconstruction.calculator nannyml.drift.model_inputs.multivariate.data_reconstruction.results nannyml.drift.model_inputs.univariate nannyml.drift.model_inputs.univariate.statistical nannyml.drift.model_inputs.univariate.statistical.calculator nannyml.drift.model_inputs.univariate.statistical.results nannyml.drift.model_outputs nannyml.drift.model_outputs.univariate nannyml.drift.model_outputs.univariate.statistical nannyml.drift.model_outputs.univariate.statistical.calculator nannyml.drift.model_outputs.univariate.statistical.results nannyml.drift.ranking nannyml.drift.target nannyml.drift.target.target_distribution nannyml.drift.target.target_distribution.calculator nannyml.drift.target.target_distribution.result nannyml.exceptions nannyml.io nannyml.io.base nannyml.io.file_reader nannyml.io.file_writer nannyml.performance_calculation nannyml.performance_calculation.calculator nannyml.performance_calculation.metrics nannyml.performance_calculation.metrics.base nannyml.performance_calculation.metrics.binary_classification nannyml.performance_calculation.metrics.multiclass_classification nannyml.performance_calculation.metrics.regression nannyml.performance_calculation.result nannyml.performance_estimation nannyml.performance_estimation.confidence_based nannyml.performance_estimation.confidence_based.cbpe nannyml.performance_estimation.confidence_based.metrics nannyml.performance_estimation.confidence_based.results nannyml.performance_estimation.direct_loss_estimation nannyml.performance_estimation.direct_loss_estimation.dle nannyml.performance_estimation.direct_loss_estimation.metrics nannyml.performance_estimation.direct_loss_estimation.result nannyml.plots nannyml.plots.colors nannyml.runner nannyml.sampling_error nannyml.sampling_error.binary_classification nannyml.sampling_error.multiclass_classification nannyml.sampling_error.regression

MSE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) mse_sampling_error() (in module nannyml.sampling_error.regression) mse_sampling_error_components() (in module nannyml.sampling_error.regression) MSLE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) msle_sampling_error() (in module nannyml.sampling_error.regression) msle_sampling_error_components() (in module nannyml.sampling_error.regression) MulticlassClassificationAccuracy (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) MulticlassClassificationAUROC (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) MulticlassClassificationF1 (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) MulticlassClassificationPrecision (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) MulticlassClassificationRecall (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) MulticlassClassificationSpecificity (class in nannyml.performance_calculation.metrics.multiclass_classification) (class in nannyml.performance_estimation.confidence_based.metrics) Multivariate Drift Detection

N

Nanny model nannyml module nannyml.base module nannyml.calibration module nannyml.chunk module nannyml.cli module nannyml.cli.cli module nannyml.cli.run module nannyml.config module nannyml.datasets module nannyml.datasets.data module nannyml.datasets.datasets module nannyml.drift module nannyml.drift.model_inputs module nannyml.drift.model_inputs.multivariate module nannyml.drift.model_inputs.multivariate.data_reconstruction module nannyml.drift.model_inputs.multivariate.data_reconstruction.calculator module nannyml.drift.model_inputs.multivariate.data_reconstruction.results module nannyml.drift.model_inputs.univariate module nannyml.drift.model_inputs.univariate.statistical module nannyml.drift.model_inputs.univariate.statistical.calculator module nannyml.drift.model_inputs.univariate.statistical.results module nannyml.drift.model_outputs module nannyml.drift.model_outputs.univariate module nannyml.drift.model_outputs.univariate.statistical module nannyml.drift.model_outputs.univariate.statistical.calculator module nannyml.drift.model_outputs.univariate.statistical.results module nannyml.drift.ranking module nannyml.drift.target module nannyml.drift.target.target_distribution module nannyml.drift.target.target_distribution.calculator module nannyml.drift.target.target_distribution.result module

nannyml.exceptions module nannyml.io module nannyml.io.base module nannyml.io.file_reader module nannyml.io.file_writer module nannyml.performance_calculation module nannyml.performance_calculation.calculator module nannyml.performance_calculation.metrics module nannyml.performance_calculation.metrics.base module nannyml.performance_calculation.metrics.binary_classification module nannyml.performance_calculation.metrics.multiclass_classification module nannyml.performance_calculation.metrics.regression module nannyml.performance_calculation.result module nannyml.performance_estimation module nannyml.performance_estimation.confidence_based module nannyml.performance_estimation.confidence_based.cbpe module nannyml.performance_estimation.confidence_based.metrics module nannyml.performance_estimation.confidence_based.results module nannyml.performance_estimation.direct_loss_estimation module nannyml.performance_estimation.direct_loss_estimation.dle module nannyml.performance_estimation.direct_loss_estimation.metrics module nannyml.performance_estimation.direct_loss_estimation.result module nannyml.plots module nannyml.plots.colors module nannyml.runner module nannyml.sampling_error module nannyml.sampling_error.binary_classification module nannyml.sampling_error.multiclass_classification module nannyml.sampling_error.regression module needs_calibration() (in module nannyml.calibration) NoopCalibrator (class in nannyml.calibration) NotFittedException

O

output (nannyml.config.Config attribute)

OutputConfig (class in nannyml.config)

P

Partition Column path (nannyml.config.InputDataConfig attribute) (nannyml.config.OutputConfig attribute) PCA Performance Estimation PerformanceCalculator (class in nannyml.performance_calculation.calculator) PeriodBasedChunker (class in nannyml.chunk) plot() (nannyml.base.AbstractCalculatorResult method) (nannyml.base.AbstractEstimatorResult method) (nannyml.drift.model_inputs.multivariate.data_reconstruction.results.Result method) (nannyml.drift.model_inputs.univariate.statistical.results.Result method) (nannyml.drift.model_outputs.univariate.statistical.results.Result method) (nannyml.drift.target.target_distribution.result.Result method) (nannyml.performance_calculation.result.Result method) (nannyml.performance_estimation.confidence_based.results.Result method) (nannyml.performance_estimation.direct_loss_estimation.result.Result method)

precision_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) precision_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) Predicted labels Predicted probabilities Predicted scores Predictions problem_type (nannyml.config.Config attribute)

R

rank() (nannyml.drift.ranking.AlertCountRanking method) (nannyml.drift.ranking.Ranking method) Ranker (class in nannyml.drift.ranking) Ranking (class in nannyml.drift.ranking) read() (nannyml.io.base.Reader method) read_args (nannyml.config.InputDataConfig attribute) Reader (class in nannyml.io.base) ReaderException Realized Performance realized_performance() (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationAccuracy method) (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationAUROC method) (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationF1 method) (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationPrecision method) (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationRecall method) (nannyml.performance_estimation.confidence_based.metrics.BinaryClassificationSpecificity method) (nannyml.performance_estimation.confidence_based.metrics.Metric method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationAccuracy method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationAUROC method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationF1 method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationPrecision method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationRecall method) (nannyml.performance_estimation.confidence_based.metrics.MulticlassClassificationSpecificity method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MAE method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MAPE method) (nannyml.performance_estimation.direct_loss_estimation.metrics.Metric method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MSE method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MSLE method) (nannyml.performance_estimation.direct_loss_estimation.metrics.RMSE method) (nannyml.performance_estimation.direct_loss_estimation.metrics.RMSLE method) recall_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification)

recall_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) Reconstruction Error RED_IMPERIAL (nannyml.plots.colors.Colors attribute) reference_data (nannyml.config.InputConfig attribute) register() (nannyml.drift.ranking.Ranker class method) (nannyml.performance_calculation.metrics.base.MetricFactory class method) (nannyml.performance_estimation.confidence_based.metrics.MetricFactory class method) (nannyml.performance_estimation.direct_loss_estimation.metrics.MetricFactory class method) register_calibrator() (nannyml.calibration.CalibratorFactory class method) registry (nannyml.drift.ranking.Ranker attribute) (nannyml.performance_calculation.metrics.base.MetricFactory attribute) (nannyml.performance_estimation.confidence_based.metrics.MetricFactory attribute) (nannyml.performance_estimation.direct_loss_estimation.metrics.MetricFactory attribute) RegressionMetric (class in nannyml.performance_calculation.metrics.regression) Residual Result (class in nannyml.drift.model_inputs.multivariate.data_reconstruction.results) (class in nannyml.drift.model_inputs.univariate.statistical.results) (class in nannyml.drift.model_outputs.univariate.statistical.results) (class in nannyml.drift.target.target_distribution.result) (class in nannyml.performance_calculation.result) (class in nannyml.performance_estimation.confidence_based.results) (class in nannyml.performance_estimation.direct_loss_estimation.result) RMSE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) rmse_sampling_error() (in module nannyml.sampling_error.regression) rmse_sampling_error_components() (in module nannyml.sampling_error.regression) RMSLE (class in nannyml.performance_calculation.metrics.regression) (class in nannyml.performance_estimation.direct_loss_estimation.metrics) rmsle_sampling_error() (in module nannyml.sampling_error.regression) rmsle_sampling_error_components() (in module nannyml.sampling_error.regression) run() (in module nannyml.runner)

S

SAFFRON (nannyml.plots.colors.Colors attribute) Sampling Error sampling_error() (in module nannyml.drift.model_inputs.multivariate.data_reconstruction.calculator) (nannyml.performance_calculation.metrics.base.Metric method) (nannyml.performance_estimation.confidence_based.metrics.Metric method) (nannyml.performance_estimation.direct_loss_estimation.metrics.Metric method) SizeBasedChunker (class in nannyml.chunk)

specificity_sampling_error() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) specificity_sampling_error_components() (in module nannyml.sampling_error.binary_classification) (in module nannyml.sampling_error.multiclass_classification) split() (nannyml.chunk.Chunker method) Standard Error StatisticalOutputDriftCalculator (class in nannyml.drift.model_outputs.univariate.statistical.calculator)

T

Target target_data (nannyml.config.InputConfig attribute) TargetDataConfig (class in nannyml.config)

TargetDistributionCalculator (class in nannyml.drift.target.target_distribution.calculator) Timestamp timestamp (nannyml.config.ColumnMapping attribute)

U

Univariate Drift Detection

UnivariateStatisticalDriftCalculator (class in nannyml.drift.model_inputs.univariate.statistical.calculator)

W

write() (nannyml.io.base.Writer method) write_args (nannyml.config.OutputConfig attribute)

Writer (class in nannyml.io.base) WriterException

Y

y_pred (nannyml.config.ColumnMapping attribute)

y_pred_proba (nannyml.config.ColumnMapping attribute) y_true (nannyml.config.ColumnMapping attribute)