nannyml.drift.multivariate.data_reconstruction package

Submodules

Module contents

Package containing the Data Reconstruction Drift Calculator implementation.

The data reconstruction error drift detection method is used to detect multivariate drift, i.e. it works on a subset or all features of a model.

It will perform a dimensionality reduction, currently only using Principal Component Analysis (PCA). In doing so, the dimensionality reducer learns about the internal structure of the data. When new, unseen data arrives, applying the inverse transformation with the reducer renders a reconstruction according to the original reference data set.

By evaluating the euclidian distance between the unseen data and its reconstruction using the reducer, i.e. the reconstruction error, we get a notion of how the unseen data differs or drifts from the reference data set.

For more information, check out the tutorial or the deep dive.