A Deep Learning Approach to State Estimation and Bad Data Detection

Other Titles


A deep neural network is a deep learning algorithm that uses artificial neural networks with multiple layers. The goal of a deep neural network is to learn a function from observation samples. In many real-world problems, this function is unknown and there is a need to learn it from the input-output samples. This idea may apply to various interesting problems that require a deep learning approach. I studied three learning problems motivated by the applications in power systems, The first problem considered is the problem of state estimation for unobservable distribution systems. A deep learning approach to Bayesian state estimation is proposed for real-time applications. The proposed technique consists of distribution learning for stochastic power injection, a Monte Carlo technique for the training of a deep neural network for state estimation, and a Bayesian bad data detection and filtering algorithm. Simulations illustrate the accuracy of Bayesian state estimation for unobservable systems and demonstrate the benefit of employing a deep neural network. Comparing with pseudo-measurement techniques, direct Bayesian state estimation via deep learning neural network outperforms existing benchmarks. The second problem considered is to detect anomalies under unknown probability distributions. Whereas the probability distribution of the anomaly-free data is unknown, anomaly-free training samples are assumed to be available. For anomaly data, neither the underlying probability distribution is known nor anomaly data samples are available. A deep learning approach coupled with a statistical test based on coincidence is proposed where an inverse generative adversary network is trained to transform data to the classical uniform vs. nonuniform hypothesis testing problem. The proposed approach is particularly effective to detect persistent anomalies whose distributions have an overlapping domain with that of the anomaly-free distribution. The third problem considered is the detection of bad-data sequences in power system. The bad-data model is nonparametric that includes arbitrary natural and adversarial data anomalies. No historical samples of data anomaly are assumed. The probability distribution of data in anomaly-free system operations is also non-parametric, unknown, but with historical training samples. A uniformity test is proposed based on a generative adversarial network (GAN) that extracts independent components of the measurement sequence via independent component analysis (ICA). Referred to as ICA-GAN, the developed approach to bad-data sequence detection can be applied at the individual sensor level or jointly at the system level. Numerical results demonstrate significant improvement over the state-of-the-art solutions for a variety of bad-data cases using PMU measurements from the EPFL smart grid testbed and that from the synthetic North Texas grid.

Journal / Series

Volume & Issue


89 pages


Date Issued




Anomaly Detection; Bad Data Detection; Deep Learning; Generative Adversary Networks; ICA-GAN; State Estimation


Effective Date

Expiration Date




Union Local


Number of Workers

Committee Chair

Tong, Lang

Committee Co-Chair

Committee Member

Bitar, Eilyan
Sabuncu, Mert

Degree Discipline

Electrical and Computer Engineering

Degree Name

Ph. D., Electrical and Computer Engineering

Degree Level

Doctor of Philosophy

Related Version

Related DOI

Related To

Related Part

Based on Related Item

Has Other Format(s)

Part of Related Item

Related To

Related Publication(s)

Link(s) to Related Publication(s)


Link(s) to Reference(s)

Previously Published As

Government Document




Other Identifiers


Rights URI


dissertation or thesis

Accessibility Feature

Accessibility Hazard

Accessibility Summary

Link(s) to Catalog Record