Pith. sign in

REVIEW 4 major objections 4 minor 151 references

Exploiting sparse structures and synergy designs to advance situational awareness of electrical power grid

T0 review · 4 major / 4 minor · reviewed 2026-08-11 · deepseek-v4-flash

Pith's one-line read Sparse threat indicators in an equivalent-circuit grid model turn blackout simulation and state estimation into tools that pinpoint dominant failure and error sources and suggest corrective actions, scaling to 80,000-bus systems.

desk verdict Solid engineering thesis with a genuinely useful circuit-based estimator and LODF graph distance, but the flagship blackout-localization claim rests on an admitted heuristic that is not validated against ground truth at scale. read the letter →

arxiv 2412.15105 v1 pith:XA4QPHY2 submitted 2024-12-19 eess.SP cs.AI

classification eess.SPcs.AI
keywords powergridsituationalawarenesscircuit-basedsimulationstateestimationsparseoptimizationtopologyerrordetectionphysics-MLsynergyblackoutsourcelocalizationfalsedatainjection
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The thesis's central claim is that two weaknesses of power-grid situational-awareness tools—simulators that diverge during blackouts and estimators that are fooled by bad data—can be fixed with the same device: sparse 'threat indicators' placed in an equivalent-circuit model of the grid. When a blackout makes the power-flow equations unsolvable, the method recovers a sparse set of bus-level current injections that restore balance, giving operators a short list of where the failure originates and what correction would fix it. When measurements mix random bad data with wrong switch statuses, the same sparse-indicator idea yields a robust estimator that flags only the erroneous meters and switches while keeping voltage estimates accurate. The thesis validates this on an 80,000-bus model of the US Eastern Interconnection for simulation and on more than 25,000-bus systems for estimation, and it reports substantially faster runtime than standard LP solvers. A reader should care because the method promises to convert a diverging, non-actionable simulation—or a confidently wrong state estimate—into an immediately actionable diagnosis.

What carries the argument

The load-bearing object is the threat indicator: an independent current source inserted into the circuit model whose nonzero value marks a deficiency at a bus, in simulation, or an error at a meter or switch, in estimation. The equivalent-circuit formulation makes every network constraint an affine Kirchhoff-current-law equation, so the estimation problem becomes a convex equality-constrained quadratic program or linear program. Sparsity is enforced by two mechanisms: a bus-wise sparsity enforcer that assigns high thresholds to low-ranked buses and low thresholds to high-ranked buses, based on a dense solution, and a weighted least-absolute-value objective that promotes sparse error indicators. An iterative shrinkage schedule extends the simulator to large systems, and a hypothesis test on switch currents and voltages confirms suspected topology errors. The ML side of the synergy exploits temporal sparsity through a bias-variance weighted historical-data scheme and spatial sparsity through per-node and per-edge local networks.

What would settle it

Take a synthetic blackout with a known cause, such as a single tripped generator at bus B, and run the robust simulator with a k-sparse goal of k=1. If the algorithm returns a different bus as the dominant infeasibility source, and injecting the recommended compensation at that returned bus fails to make the network balance equations feasible, the central localization claim fails. The thesis itself notes that the largest dense-solution indicators need not point to the true dominant sources, so this experiment directly tests the load-bearing assumption.

Watch

Extended reading notes

Core claim

The paper's central discovery is that sparse optimization applied to an equivalent-circuit formulation gives both simulation and estimation an intrinsic robustness that standard tools lack. In simulation, infeasibility is represented by current sources at buses, and minimizing a weighted quadratic objective with a bus-wise sparsity enforcer yields sparse compensation terms that identify dominant blackout sources and corrective injections. In estimation, all measurement devices—conventional SCADA meters, synchrophasors, and switch-status sensors—are converted into linear circuit models, and a weighted least-absolute-value objective over error indicators yields sparse detection of bad data and wrong switch statuses, with a hypothesis test to verify switch alarms. The author then shows that lightweight ML models exploiting temporal and spatial sparsity generalize across dynamic graphs and scale to 60,000-node systems, and that connecting these ML predictions to the physics-based tools—as warm starts and priors—further accelerates simulation under MadIoT attacks and hardens estimation against false-data-injection attacks. The author notes in Section 4.2.4 that the ranking of 'major' buses from a dense solution is likely but not guaranteed to point at the true sources.

Load-bearing premise

The bus-wise sparsity enforcer assumes that the buses with the largest infeasibility indicators in a dense solution really are the dominant sources of a blackout; the thesis acknowledges in Section 4.2.4 that this ranking is not always correct.

Editorial extensions

If this is right

  • Blackout simulation on large grids no longer needs to diverge: operators get a sparse set of buses where injecting power would restore feasibility.
  • Mixed random bad data and topology errors can be identified and separated in one estimation pass on systems with more than 25,000 buses, without the iterative re-runs of residual-based bad-data detection.
  • Because the circuit formulation is device-level, the same simulation and estimation pipeline applies to both transmission and distribution networks, including three-phase distribution systems.
  • Lightweight sparsity-exploiting ML generalizes across topology changes and scales to 60,000-node systems with millisecond per-sensor anomaly detection.
  • Interconnecting physics-based tools with ML predictions, as warm starts and priors, yields more than 3x faster simulation under MadIoT attacks and near-linearly scaling robustness against false-data-injection attacks.
  • The detectability limits discussed for node-breaker models imply that some wrong switch statuses are fundamentally indistinguishable from the data, so operators can know when a switch alarm should be trusted.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same sparse-threat-indicator template could transfer to other network infrastructures, such as natural gas, water, or transportation networks, that admit circuit-like conservation laws and where failures and corrupt measurements are sparse.
  • The iterative shrinkage schedule in Algorithm 3 resembles a homotopy or continuation method; a convergence proof that the sequence of threshold updates reaches the intended sparse set would turn the ranking heuristic into a certified procedure.
  • The undetectability results of Section 4.3.7 imply an identifiability limit for any switch-status estimator on node-breaker models, so adding temporal consistency checks or PMU redundancy at redundant switches is a natural testable extension.
  • The bias-variance temporal weighting in DynWatch suggests that any physics-based or learned graph distance could replace the LODF-based distance; a natural test is whether the method still detects anomalies on non-grid dynamic graphs with known ground-truth changes.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The thesis develops a unified circuit-based (equivalent-circuit) framework for steady-state power system simulation and estimation, and combines it with sparse-optimization threat indicators, lightweight machine-learning models (DynWatch, Gridwarm), and physics-ML synergy designs. The main claims are that sparse threat indicators pinpoint dominant sources of random blackouts and data errors while suggesting corrective actions, that the resulting tools scale to the 80k-bus Eastern Interconnection and to >25k-bus systems faster than standard solvers, and that the synergy designs further accelerate simulation under MadIoT attacks and improve estimation robustness against false data injection. The manuscript also presents theorems bounding the statistical error of the DynWatch anomaly detector and a closed-form convex estimator for circuit-based generalized state estimation.

Significance. If the central claims hold, the work would be a substantial advance in practical situational awareness tools for power grids: the circuit-based estimator is convex with a closed-form solution, the sparse simulation/estimation formulations are demonstrated on very large systems, and the ML components are designed for scalability and physical interpretability. The thesis has concrete strengths: DynWatch ships public code and data, the experiments use independent test cases (CyPRES, MATPOWER/PEGASE, ACTIVSg25k, Texas CP-2000), and several large-scale demonstrations (80k-bus Eastern Interconnection, >24k-node generalized state estimation) go well beyond typical power-system evaluations. However, two load-bearing elements need attention before the headline claims can be accepted: the DynWatch error-bound proof in Section 5.2.5 contains an algebraic error, and the sparse source-localization claim in Chapter 4 is validated without ground-truth failure locations on large systems, despite an admitted ranking heuristic. These issues are local and fixable, but they directly affect the 'pinpoint dominant sources' and 'error bound' claims.

major comments (4)
  1. [§5.2.5] The proof of Theorem 5.2.1 contains an algebraic error in the bias^2 term. Equation (5.35) rewrites E[(∑_t w_t μ_t − μ_{T+1})^2] as E[(∑_t w_t |μ_t − μ_{T+1}|)^2], which is not an identity unless all mean shifts have the same sign; and even in that case (∑_t w_t a_t)^2 is not equal to ∑_t w_t a_t^2 or ∑_t w_t c d*_t as assumed in Eq. (5.36). Consequently, the claimed upper bound (1 + max_t w_t)σ^2 + c max_t d*_t does not follow from the derivation. The bound may be repairable (e.g., by applying Jensen/Cauchy-Schwarz to the un-squared bias), but as written the theorem is unproven.
  2. [Table 4.2] The flagship claim that robust actionable simulation 'pinpoint[s] dominant blackout sources on the 80k-bus Eastern Interconnection grid' is not validated against ground truth. The bus-wise sparsity enforcer (Algorithms 1-3) selects the sparse support by ranking buses according to the dense L2 infeasibility indicators, and Section 4.2.4 explicitly states that the largest indicators are 'not always' the true dominant sources. In Table 4.2 the injected stress is a global load-factor increase, for which there is no independent definition of a 'dominant bus'; the reported dominant buses are simply the method's own output. To establish the pinpointing claim, the authors should run controlled experiments with known local contingencies (e.g., a specific line outage or a local load surge at a known bus) on large cases and report whether the true failure set is recovered in the top-k selected buses.
  3. [§4.3.4] The robustness and identification claims for the WLAV-based estimator depend on empirically tuned hyperparameters: switch weights (0.001 and 0.01), bad-data detection thresholds (|n| > 0.1 and |n_sw| > 0.05), and hypothesis-test thresholds (τ_I = 0.01, τ_V = 0.01). The thesis states these are 'empirically learned from synthetic data' but does not report how sensitive the detection/localization rates are to these values. For a safety-critical application, a sensitivity analysis over a plausible range of thresholds and weights, with corresponding false-alarm and missed-detection rates, is needed to support the claim that the method reliably identifies a mixture of random bad data and topology errors.
  4. [Definition 5.2.1] Definition 5.2.1 calls d*_t the 'optimal graph distance' and assumes |μ_t − μ_{T+1}| = c·d*_t for a single constant c, i.e., that the graph distance is proportional to the mean shift of each sensor's data. This is an ad-hoc assumption, not a definition: the LODF-based graph distance of Section 5.2.1 is a structural measure of power-flow redistribution and has no established linear relationship to the mean shift of any particular sensor's measurements. The assumption is load-bearing for Theorem 5.2.1, so it should be stated as an assumption with empirical justification, or the theorem should be re-derived under weaker conditions.
minor comments (4)
  1. [Abstract] The abstract claims 'significantly faster speed than standard solvers' for the estimation methods, but Section 3.6 deliberately compares only numbers of iterations rather than wall-clock time (because of the MATLAB/Python implementation asymmetry). While Section 4.3.6 does provide work-time comparisons against CVXOPT and SciPy, the abstract's speed claim should be qualified to reflect which experiments actually measure runtime.
  2. [§4.2.4] Algorithm 3's outer loop 'while not sparse enough' has no explicit termination condition, stopping criterion, or guarantee of convergence; the loop also includes an 'optional adjustments' step that is not specified. Please state a concrete termination rule (e.g., a maximum iteration count or a target sparsity level) so the algorithm is reproducible.
  3. [Chapters 4-5] The symbol n is overloaded: it denotes infeasibility/compensation terms in Chapter 4, measurement noise/error terms in the estimation models, and switch flows in the node-breaker models. A consolidated notation table or explicit redefinition at each chapter would improve readability.
  4. [Table 4.2] For the large-system results in Table 4.2, please report the runtime, number of outer iterations of Algorithm 3, and the final values of the sparse indicators, so that the reader can assess the cost and sparsity trade-off of the method.

Circularity Check

2 steps flagged · score 6.0 of 10

The sparse simulator's 'dominant blackout source' is the top-k dense-infeasibility set fed into the optimizer as the only permissible support, so the pinpointing claim reduces by construction; alarm thresholds in the robust estimator are also tuned on the evaluation data.

  1. fitted input called prediction [Section 4.2.3, Algorithm 1; Section 4.2.4, Algorithms 2-3]
    "For buses in the ‘major’ group, i.e. with high infeasibility quantities ( ||ni|| >> 0), we assume that they are very likely the dominant sources of failure and assign a low value cL. This encourages non-zero ni on those locations. For buses in the minor group, we assign a higher threshold cH such that we can force their ni values to zero or near zero values."

    The support of the sparse solution is fixed before solving: Algorithm 1 sorts the dense L2 indicators from Problem 2.2.2, labels the top k as 'major', and gives exactly those buses the low penalty cL while forcing all others toward zero with cH. Algorithm 2 then solves Problem 4.2.1 using these penalties, so any returned nonzero n is confined to the preselected major set. Thus the reported 'pinpoint dominant blackout source' is the same top-k ranking used as input. In the Case 14 experiment, bus 14 has the largest dense indicator (0.109 vs ~0.09) and is the only bus allowed to be nonzero, so the 1-sparse location at bus 14 in Table 4.1 is by construction.

  2. fitted input called prediction [Section 4.3.6, Eq. (4.18) and accompanying text]
    "These bad data identification thresholds are empirically learned from our synthetic data, specifically by observing the data and finding a threshold value that effectively separates bad data points from normal ones, and they work well in our experiments."

    The alarm rules used to report localization of data errors — |n| > 0.1 for RTU/PMU errors, |n| > 0.05 for switch errors, plus τI = τV = 0.01 in Table 4.3 — are selected by inspecting the same synthetic dataset on which the evaluation is performed. Consequently, the reported successful identification of the injected bad data and topology-error locations is partly a fitted outcome: the thresholds were chosen to separate the injected anomalies from normal data in that dataset. The sparse WLAV residual vector itself is method-derived, but the quantitative 'identify data errors' claim, as operationalized by these thresholds, includes this tuned component.

full rationale

The thesis contains substantial independent content: the circuit-based state estimator is derived self-contained with a closed-form solution, the WLAV robust estimator is compared against a WLS baseline on CyPRES cases with injected ground-truth errors, and DynWatch/Gridwarm are evaluated on synthetic anomaly data with known labels. Self-citations to prior circuit-formulation work are not load-bearing in the sense of forbidding alternatives; they point to earlier published formulations that the thesis re-derives. However, the flagship simulation claim of 'pinpointing dominant blackout sources' is partially circular by construction. The bus-wise sparsity enforcer does not discover a sparse support from the physics; it first ranks buses by the dense infeasibility solution, preselects the top k as 'major', assigns them low penalties, and then solves an optimization in which all non-selected buses are heavily penalized toward zero. The returned nonzero set is therefore the preselected set, so the 'prediction' of where to build generation or take corrective action is an input to the algorithm rather than an independently validated output. The paper explicitly acknowledges the ranking assumption is 'not always true' and the large-scale demonstrations lack local ground truth, which reinforces that the dominant-source localization claim is not yet independently established. The detection-threshold tuning in the robust estimator is a second, smaller fitted-input issue. Overall, the central simulator claim partially reduces to its own preselection mechanism, while the other pillars of the thesis remain methodologically independent; this warrants a score of 6 rather than higher.

Assumptions & free parameters 6 free parameters · 6 assumptions · 0 invented entities

The central claims rest on standard power-flow physics plus several ad hoc assumptions: sparsity of errors, the ranking of dense infeasibility, and the optimal graph distance calibration. These are not all validated with independent evidence.

free parameters (6)
  • cH and cL (bus-wise sparsity enforcer thresholds) = cH=10, cL=0.1
    Default values in Algorithm 3; chosen by heuristic to balance sparsity and convergence, not derived from data.
  • shrinkage rate r = 0.75
    Controls how quickly the k-sparse goal shrinks; set by default.
  • switch weights w in WLAV estimator = 0.001 (8-substation), 0.01 (300-substation, CP-2000)
    Tuned by hyperparameter search to minimize misclassification (Section 4.3.5).
  • bad-data detection thresholds = 0.1 (n_pmu, n_rtu), 0.05 (n_sw), tau_I=0.01, tau_V=0.01
    Empirically learned from synthetic data (Section 4.3.6, Table 4.3).
  • DynWatch distance scaling factor = 0.005
    Empirically chosen to balance bias and variance in temporal weighting (Section 5.2.2).
  • closed switch reactance x_sw = 0.0001 p.u.
    Model parameter for closed switch low-impedance branch (Eq. 3.16).
assumptions (6)
  • domain assumption Power balance equations / Kirchhoff's laws describe steady-state grid behavior
    Foundation of simulation and estimation models; standard in power engineering.
  • domain assumption Bad data and topology errors are sparsely distributed
    Justifies WLAV objective; if errors are dense, estimator degrades (admitted in Section 4.3.6).
  • ad hoc to paper The largest entries of the dense L2 infeasibility solution indicate dominant failure locations
    Assumption behind bus-wise sparsity enforcer (Section 4.2.3); the thesis notes this is not always true.
  • domain assumption Temporal independence and identical distribution conditioned on topology (Assumptions 5.2.1, 5.2.2)
    Used for DynWatch statistical error analysis.
  • ad hoc to paper Optimal graph distance d*_t is proportional to the mean shift (Definition 5.2.1)
    Defines away the core difficulty of calibrating graph distance to distribution shift; makes the error bound contingent on this proportionality.
  • domain assumption PMU installed on every generation bus and RTU on other injection buses
    Meter placement assumption in experiments (Section 4.3.6), not always realistic.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Exploiting sparse structures and synergy designs to advance situational awareness of electrical power grid." pith.science (2026). https://pith.science/paper/XA4QPHY2

@misc{pith2026241215105,
  author       = {Pith},
  title        = {Pith review of: Exploiting sparse structures and synergy designs to advance situational awareness of electrical power grid},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XA4QPHY2}},
  note         = {Machine review of arXiv:2412.15105}
}
read the original abstract

The growing threats of uncertainties, anomalies, and cyberattacks on power grids are driving a critical need to advance situational awareness which allows system operators to form a complete and accurate picture of the present and future state. Simulation and estimation are foundational tools in this process. However, existing tools lack the robustness and efficiency required to achieve the level of situational awareness needed for the ever-evolving threat landscape. Industry-standard (steady-state) simulators are not robust to blackouts, often leading to non-converging or non-actionable results. Estimation tools lack robustness to anomalous data, returning erroneous system states. Efficiency is the other major concern as nonlinearities and scalability issues make large systems slow to converge. This thesis addresses robustness and efficiency gaps through a dual-fold contribution. We first address the inherent limitations in the existing physics-based and data-driven worlds; and then transcend the boundaries of conventional algorithmic design in the direction of a new paradigm -- Physics-ML Synergy -- which integrates the strengths of the two worlds. Our approaches are built on circuit formulation which provides a unified framework that applies to both transmission and distribution. Sparse optimization acts as the key enabler to make these tools intrinsically robust and immune to random threats, pinpointing dominant sources of (random) blackouts and data errors. Further, we explore sparsity-exploiting optimizations to develop lightweight ML models whose prediction and detection capabilities are a complement to physics-based tools; and whose lightweight designs advance generalization and scalability. Finally, Physics-ML Synergy brings robustness and efficiency further against targeted cyberthreats, by interconnecting our physics-based tools with lightweight ML.

Figures

Figures reproduced from arXiv: 2412.15105 by the authors.

Figure 2.1
Figure 2.1. Network topology processor converts node-breaker (NB) model to bus-branch (BB) model, and [PITH_FULL_IMAGE:figures/full_fig_p028_2_1.png] view at source ↗
Figure 3.1
Figure 3.1. Circuit-based viewpoint for simulation and estimation on power system. [PITH_FULL_IMAGE:figures/full_fig_p037_3_1.png] view at source ↗
Figure 3.2
Figure 3.2. Suppose the power injection at a load bus is measured by an RTU device (in purple); the [PITH_FULL_IMAGE:figures/full_fig_p040_3_2.png] view at source ↗
Figures from the paper (42 more)
Figure 3.3
Figure 3.3. Figure 3.3: Linear RTU model: measurements are mapped to sensitivities. [PITH_FULL_IMAGE:figures/full_fig_p041_3_3.png]
Figure 3.4
Figure 3.4. Figure 3.4: Connecting RTU model to the load bus: the load is now described by its "pseudo" measure [PITH_FULL_IMAGE:figures/full_fig_p042_3_4.png]
Figure 3.5
Figure 3.5. Figure 3.5: Linear PMU model: measurements have a linear nature under circuit-based formulation. [PITH_FULL_IMAGE:figures/full_fig_p043_3_5.png]
Figure 3.6
Figure 3.6. Figure 3.6: Linear model for line flow meters: implemented as control circuits coupled with the main [PITH_FULL_IMAGE:figures/full_fig_p044_3_6.png]
Figure 3.7
Figure 3.7. Figure 3.7: Open switch model: nsw close to zero if the status is correct; nsw compensates the current flow on the branch if the status is wrong. Model Definition 5 (Linear closed switch model) [PITH_FULL_IMAGE:figures/full_fig_p045_3_7.png]
Figure 3.8
Figure 3.8. Figure 3.8: Closed switch model: nsw close to zero if the status is correct; nsw will offset the current flow on the branch if the status is wrong. xsw is in p.u. 3.2.5 Other grid devices Physical devices such as transformers, lines and shunts are linear and their derivations an…
Figure 3.9
Figure 3.9. Figure 3.9: Equivalently representing a power system steady-state operating point with an aggregated [PITH_FULL_IMAGE:figures/full_fig_p046_3_9.png]
Figure 4.1
Figure 4.1. Figure 4.1: Toy examples: sparse optimization adding robustness to simulation and estimation. Sparse [PITH_FULL_IMAGE:figures/full_fig_p055_4_1.png]
Figure 4.2
Figure 4.2. Figure 4.2: Sparse indicators pinpoint dominant sources of failure and focused corrective actions at key [PITH_FULL_IMAGE:figures/full_fig_p056_4_2.png]
Figure 4.3
Figure 4.3. Figure 4.3: Relationship between n ∗ and c: a blocking effect. This reveals a simple mechanism through which the threshold c encourages a sparse solution by confining most n entries to near zero value. Whenever threshold c is added, the blocking effect reduces the number of non-…
Figure 4.4
Figure 4.4. Figure 4.4: High c value causes steep convergence region on the complementary slackness curve. Left: upper bound curve µ¯ R i (n R i − t R i ) = −ϵ, right: lower bound curve µ R i (−n R i − t R i ) = −ϵ. When n R i > 0, we have µ¯ R i → c, µ R i → 0. (n R i , t R i , µ¯ R i ) co…
Figure 4.5
Figure 4.5. Figure 4.5: Identifying data errors on Case 118 4.3.1 Assuming a possibly wrong topology To consider the possibly wrong switching statuses which contribute to topology errors, we need node￾breaker models of the power grid which contain nodes, switches, and branches. However, a n…
Figure 4.6
Figure 4.6. Figure 4.6: Extending a bus-branch model with pseudo nodes and switches. [PITH_FULL_IMAGE:figures/full_fig_p065_4_6.png]
Figure 4.7
Figure 4.7. Figure 4.7: CyPRES 8 substation network. (The case is modified by opening the switch (7,8)) [PITH_FULL_IMAGE:figures/full_fig_p070_4_7.png]
Figure 4.8
Figure 4.8. Figure 4.8: Robustness of WLAV (left) vs WLS (right): WLAV better identifies data errors and obtains [PITH_FULL_IMAGE:figures/full_fig_p073_4_8.png]
Figure 4.9
Figure 4.9. Figure 4.9: Robustness on different sized networks: The top row shows the number of inaccurate bus [PITH_FULL_IMAGE:figures/full_fig_p074_4_9.png]
Figure 4.10
Figure 4.10. Figure 4.10: Speed and scalability: generalized state estimation (considering topology errors). We compare [PITH_FULL_IMAGE:figures/full_fig_p076_4_10.png]
Figure 4.11
Figure 4.11. Figure 4.11: Detectability issues: three examples where the robust circuit-based generalized state estimator [PITH_FULL_IMAGE:figures/full_fig_p076_4_11.png]
Figure 5.1
Figure 5.1. Figure 5.1: Temporally sparse weights pinpoint the relevant historical data: a sparse recommendation. [PITH_FULL_IMAGE:figures/full_fig_p079_5_1.png]
Figure 5.2
Figure 5.2. Figure 5.2: Toy example of DynWatch: different distributions are caused by topology changes. Consider the simple power grid shown in [PITH_FULL_IMAGE:figures/full_fig_p080_5_2.png]
Figure 5.3
Figure 5.3. Figure 5.3: Transition state of two graphs: the union of two graphs. [PITH_FULL_IMAGE:figures/full_fig_p082_5_3.png]
Figure 5.4
Figure 5.4. Figure 5.4: wt − dt relationship. Algorithm 6: Computing Temporal Weights wt Input: distance dt , with t = 1, 2, · · · , N Output: weights wt , with t = 1, 2, · · · , N 1 Compute the unique λ ∗ that satisfies: ∑ t∈{1,2,...N} max{λ ∗ − dt , 0} = 1 2 Get weights wt : wt = max{λ ∗ …
Figure 5.5
Figure 5.5. Figure 5.5: Simple motivating example: DynWatch-Local. The two graphs are very different within the yellow localized region. However, sensor 2 is far away from the yellow region and thus experiences no changes. In the previous section, we computed a single distance value D(Gi , …
Figure 5.6
Figure 5.6. Figure 5.6: Local graph distance: the adjacent lines connected to each sensor [PITH_FULL_IMAGE:figures/full_fig_p087_5_6.png]
Figure 5.7
Figure 5.7. Figure 5.7: Synthetic data generation for evaluating D [PITH_FULL_IMAGE:figures/full_fig_p093_5_7.png]
Figure 5.8
Figure 5.8. Figure 5.8: Performance of DynWatch: AUC and F-measure. 5.2.7 Q2. Scalability In this subsection, we seek to analyze the scalability of our DynWatch and DynWatch-Local. In reality, PJM, the largest ISO in the U.S., runs ACSE on a 28k bus model, performed every 1 min [5], thus an…
Figure 5.9
Figure 5.9. Figure 5.9: DynWatch scales linearly with the number of edges, when detecting all 1200 time ticks. The red lines are best-fit regression lines. of less than 1.7ms per time tick per sensor. The ACTIVSg25k (realistic power system case with 25K buses) has 32k+ branches, and thus ru…
Figure 5.10
Figure 5.10. Figure 5.10: Change of line status, total load and generation on for a real-world load dataset. [PITH_FULL_IMAGE:figures/full_fig_p097_5_10.png]
Figure 5.11
Figure 5.11. Figure 5.11: Result of F-measure on case2383wp, with 40 sensors installed: the proposed LODF-based [PITH_FULL_IMAGE:figures/full_fig_p098_5_11.png]
Figure 5.12
Figure 5.12. Figure 5.12: A power grid can be naturally represented as a graphical model. Each node represents the [PITH_FULL_IMAGE:figures/full_fig_p099_5_12.png]
Figure 5.13
Figure 5.13. Figure 5.13: Local lightweight NNs: each node has a NN-node and each edge has a NN-edge, to map the input features to the post-disturbance system characteristics. Meanwhile, to effectively learn the mapping, we must answer the following question: how to select the input features…
Figure 5.14
Figure 5.14. Figure 5.14: Training of Gridwarm: forward pass and back-propagation. Local lightweight NNs combine [PITH_FULL_IMAGE:figures/full_fig_p105_5_14.png]
Figure 6.1
Figure 6.1. Figure 6.1: We advocate for a Physics-ML synergy: physics-based and data-driven models are intercon [PITH_FULL_IMAGE:figures/full_fig_p109_6_1.png]
Figure 6.2
Figure 6.2. Figure 6.2: The proliferation of IoT devices has raised concerns about IoT-induced cyber attacks, where [PITH_FULL_IMAGE:figures/full_fig_p111_6_2.png]
Figure 6.3
Figure 6.3. Figure 6.3: Physical interpretation: This figure visualizes the values in matrices and vectors (the more [PITH_FULL_IMAGE:figures/full_fig_p113_6_3.png]
Figure 6.4
Figure 6.4. Figure 6.4: Result on test data: power flow simulation takes fewer iterations to converge with the proposed [PITH_FULL_IMAGE:figures/full_fig_p114_6_4.png]
Figure 6.5
Figure 6.5. Figure 6.5: A Bayesian Network depicts the spatiotemporal interactions of variables in the electrical power [PITH_FULL_IMAGE:figures/full_fig_p117_6_5.png]
Figure 6.6
Figure 6.6. Figure 6.6: Physics-ML Synergy creates an interconnection: prior knowledge from ML comes in the [PITH_FULL_IMAGE:figures/full_fig_p124_6_6.png]
Figure 6.7
Figure 6.7. Figure 6.7: Case30: accuracy of estimation accuracy quantified by root mean squared error (RMSE). [PITH_FULL_IMAGE:figures/full_fig_p128_6_7.png]
Figure 6.8
Figure 6.8. Figure 6.8: ML-augmented ckt-GSE identifies types and locations of mixed anomalies. [PITH_FULL_IMAGE:figures/full_fig_p130_6_8.png]
Figure 6.8
Figure 6.8. Figure 6.8: Robustness: ML-augmented ckt-GSE advances ckt-GSE in robustness against modern false [PITH_FULL_IMAGE:figures/full_fig_p131_6_8.png]
Figure 6.9
Figure 6.9. Figure 6.9: Speed and scalability: worktime of the 3 essential procedures in the synergy design, as system [PITH_FULL_IMAGE:figures/full_fig_p132_6_9.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

151 extracted references · 76 canonical work pages

  1. [1]

    Activsg2000: 2000-bus synthetic grid on footprint of texas. 98

  2. [2]

    https://matpower.org/docs/ref/matpower5.0/case2383wp.html

    Description of case2383wp. https://matpower.org/docs/ref/matpower5.0/case2383wp.html. 114

  3. [3]

    Ieee 118-bus system. 98

  4. [4]

    https://labs.ece.uw.edu/pstca/pf30/pg_tca30bus.htm

    Ieee power systems test case archive. https://labs.ece.uw.edu/pstca/pf30/pg_tca30bus.htm. 113

  5. [5]

    https://www.pjm.com/~/media/documents/manuals/m12

    Pjm manual 12: Balancing operations. https://www.pjm.com/~/media/documents/manuals/m12. ashx. 2020. 81

  6. [6]

    A bur, A., and Celik, M. K. Least absolute value state estimation with equality and inequality constraints. IEEE Transactions on Power Systems 8, 2 (1993), 680–686. 2

  7. [7]

    C., Zhao, Y., and Philip, S

    A ggarwal, C. C., Zhao, Y., and Philip, S. Y. Outlier detection in graph streams. In Data Engineering (ICDE), 2011 IEEE 27th International Conference on (2011), IEEE, pp. 399–409. 21

  8. [8]

    A iroldi, E. M. Advances in network tomography . Carnegie Mellon University. Center for Automated Learning and Discovery, 2003. 121

Show all 151 references
  1. [9]

    The continuation power flow: a tool for steady state voltage stability analysis

    A jjarapu, V .,and Christy, C. The continuation power flow: a tool for steady state voltage stability analysis. IEEE transactions on Power Systems 7 , 1 (1992), 416–423. 2, 10

  2. [10]

    Event detection in time series of mobile communication graphs

    A koglu, L., and Faloutsos, C. Event detection in time series of mobile communication graphs. In Army science conference (2010), pp. 77–79. 3, 21

  3. [11]

    Oddball: Spotting anomalies in weighted graphs

    A koglu, L., McGlohon, M., and Faloutsos, C. Oddball: Spotting anomalies in weighted graphs. In P AKDD(2010), Springer, pp. 410–421. 3, 21, 80

  4. [12]

    Generalized state estimation

    A lsac, O., Vempati, N., Stott, B., and Monticelli, A. Generalized state estimation. IEEE Transac- tions on power systems 13, 3 (1998), 1069–1075. 2, 17 123 BIBLIOGRAPHY 124

  5. [13]

    Computational complexity in power systems

    A lvarado, F. Computational complexity in power systems. IEEE Transactions on Power Apparatus and Systems 95, 4 (1976), 1028–1037. 65

  6. [14]

    A ppasani, B., and Mohanta, D. K. A review on synchrophasor communication system: commu- nication technologies, standards and applications. Protection and control of modern power systems 3 , 1 (2018), 1–17. 12

  7. [15]

    E., and Koutra, D

    A raujo, M., Papadimitriou, S., G ünnemann, S., Faloutsos, C., Basu, P ., Swami, A., Papalexakis, E. E., and Koutra, D. Com2: fast automatic discovery of temporal (‘comet’) communities. In P AKDD(2014), Springer, pp. 271–283. 3, 21, 80

  8. [16]

    B aiocco, A., F oglietta, C., and Wolthusen, S. D. Delay and jitter attacks on hierarchical state estimation. In 2015 IEEE International Conference on Smart Grid Communications (SmartGridComm) (2015), IEEE, pp. 485–490. 8

  9. [17]

    B enabid, R., B oudour, M., and Abido, M. A. Optimal location and setting of svc and tcsc devices using non-dominated sorting particle swarm optimization. Electric Power Systems Research 79 , 12 (2009), 1668–1677. 41, 42

  10. [18]

    M., K riegel, H.-P ., Ng, R

    B reunig, M. M., K riegel, H.-P ., Ng, R. T., and Sander, J. Lof: identifying density-based local outliers. In ACM sigmod record (2000), vol. 29, ACM, pp. 93–104. 3, 20, 80

  11. [19]

    C ase, D. U. Analysis of the cyber attack on the ukrainian power grid. Electricity Information Sharing and Analysis Center (E-ISAC) 388 (2016). 1, 7, 102

  12. [20]

    J., P runeda, R

    C astillo, E., C onejo, A. J., P runeda, R. E., and Solares, C. Observability analysis in state es- timation: A unified numerical approach. IEEE Transactions on Power Systems 21 , 2 (2006), 877–886. 78

  13. [21]

    Optimal placement of phasor measurement units for power system observability

    C hakrabarti, S., and Kyriakides, E. Optimal placement of phasor measurement units for power system observability. IEEE Transactions on power systems 23, 3 (2008), 1433–1440. 78

  14. [22]

    Placement of pmus to enable bad data detection in state estimation

    C hen, J., and Abur, A. Placement of pmus to enable bad data detection in state estimation. IEEE Transactions on Power Systems 21, 4 (2006), 1608–1615. 2, 53

  15. [23]

    C hen, Z., Hendrix, W., and Samatova, N. F. Community-based anomaly detection in evolutionary networks. Journal of Intelligent Information Systems 39 , 1 (2012), 59–85. 3, 21, 80

  16. [24]

    Markov random fields in statistics

    C lifford, P . Markov random fields in statistics. Disorder in physical systems: A volume in honour of John M. Hammersley (1990), 19–32. 86 BIBLIOGRAPHY 125

  17. [25]

    Markov fields on finite graphs and lattices

    C lifford, P .,and Hammersley, J. Markov fields on finite graphs and lattices. 86

  18. [26]

    Risk assessment in energy trading

    D ahlgren, R., L iu, C.-C., and Lawarree, J. Risk assessment in energy trading. IEEE Transactions on Power Systems 18, 2 (2003), 503–511. 1

  19. [27]

    D antzig, G. B. Linear programming and extensions, vol. 48. Princeton university press, 1998. 2, 16, 52

  20. [28]

    C., A sada, E

    de Almeida, M. C., A sada, E. N., and Garcia, A. V . Power system observability analysis based on gram matrix and minimum norm solution. IEEE Transactions on Power Systems 23 , 4 (2008), 1611–1618. 78

  21. [29]

    Structure learning in power distribution networks

    D eka, D., Backhaus, S., and Chertkov, M. Structure learning in power distribution networks. IEEE Transactions on Control of Network Systems 5, 3 (2017), 1061–1074. 121

  22. [30]

    Warm-starting ac optimal power flow with graph neural networks

    D iehl, F. Warm-starting ac optimal power flow with graph neural networks. In 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) (2019), pp. 1–6. 18

  23. [31]

    Robust state estimation using node-breaker substation models and phasor measurements

    D onmez, B., S cioletti, G., and Abur, A. Robust state estimation using node-breaker substation models and phasor measurements. In 2019 IEEE Milan PowerTech (2019), IEEE, pp. 1–6. 2, 17, 18, 53

  24. [32]

    Graph neural solver for power systems

    D onon, B., Donnot, B., Guyon, I., and Marot, A. Graph neural solver for power systems. In 2019 International Joint Conference on Neural Networks (IJCNN) (2019), pp. 1–8. 3, 18, 19, 20

  25. [33]

    L., Rolnick, D., and Kolter, J

    D onti, P . L., Rolnick, D., and Kolter, J. Z. Dc3: A learning method for optimization with hard constraints. arXiv preprint arXiv:2104.12225 (2021). 3, 18, 19

  26. [34]

    NeuroMANCER: Neural Modules with Adaptive Nonlinear Constraints and Efficient Regularizations

    D rgona, J., T uor, A., K och, J., S hapiro, M., and Vrabie, D. NeuroMANCER: Neural Modules with Adaptive Nonlinear Constraints and Efficient Regularizations. 3, 19

  27. [35]

    Distributed generation: challenges and possible solutions

    D riesen, J., and Belmans, R. Distributed generation: challenges and possible solutions. In 2006 IEEE power engineering society general meeting (2006), IEEE, pp. 8–pp. 1

  28. [36]

    T., Hackworth, C

    D urso, F. T., Hackworth, C. A., T ruitt, T. R., C rutchfield, J., N ikolic, D., and Manning, C. A. Situation awareness as a predictor of performance for en route air traffic controllers. Air Traffic Control Quarterly 6, 1 (1998), 1–20. 1, 6

  29. [37]

    M., Nezamabadi-pour, H., Song, Y

    F arsangi, M. M., Nezamabadi-pour, H., Song, Y. H.,and Lee, K. Y. Placement of svcs and selection of stabilizing signals in power systems. IEEE Transactions on Power Systems 22 , 3 (2007), 1061–1071. 41, 42 BIBLIOGRAPHY 126

  30. [39]

    Contingency ranking with respect to overloads in very large power systems taking into account uncertainty, preventive, and corrective actions

    F liscounakis, S., P anciatici, P ., Capitanescu, F., and Wehenkel, L. Contingency ranking with respect to overloads in very large power systems taking into account uncertainty, preventive, and corrective actions. IEEE Transactions on Power Systems 28, 4 (2013), 4909–4917. 114

  31. [40]

    Lav based robust state estimation for systems measured by pmus

    G öl, M., and Abur, A. Lav based robust state estimation for systems measured by pmus. IEEE Transactions on Smart Grid 5, 4 (2014), 1808–1814. 2, 15, 16

  32. [41]

    Hamiltonian neural networks

    G reydanus, S., D zamba, M., and Yosinski, J. Hamiltonian neural networks. Advances in Neural Information Processing Systems 32 (2019). 3, 18

  33. [42]

    G uideline, N. R. PMU placement and installation. NERC, Atlanta, GA, USA 2016 (2016). 56

  34. [43]

    H amilton, J. D. Time series analysis, vol. 2. Princeton university press Princeton, 1994. 80

  35. [44]

    H ampel, F. R. Robust statistics: A brief introduction and overview. In Research report/Seminar für Statistik, Eidgenössische Technische Hochschule (ETH) (2001), vol. 94, Seminar für Statistik, Eidgenös- sische Technische Hochschule. 71

  36. [45]

    C., Kohlas, J., and Fiechter, A

    H andschin, E., Schweppe, F. C., Kohlas, J., and Fiechter, A. Bad data analysis for power system state estimation. IEEE Transactions on Power Apparatus and Systems 94, 2 (1975), 329–337. 2, 15

  37. [46]

    Statistical learning with sparsity: the lasso and generalizations

    H astie, T., T ibshirani, R., and Wainwright, M. Statistical learning with sparsity: the lasso and generalizations. Chapman and Hall/CRC, 2015. 4, 40, 42, 43

  38. [47]

    A., P andey, A., J ereminov, M., P ileggi, L., and Faloutsos, C

    H ooi, B., E swaran, D., S ong, H. A., P andey, A., J ereminov, M., P ileggi, L., and Faloutsos, C. Gridwatch: Sensor placement and anomaly detection in the electrical grid. In ECML-PKDD (2018), Springer, pp. 71–86. 3, 21, 71, 78, 80

  39. [48]

    Physics-guided deep neural networks for power flow analysis

    H u, X., Hu, H., Verma, S., and Zhang, Z.-L. Physics-guided deep neural networks for power flow analysis. IEEE Transactions on Power Systems 36, 3 (2020), 2082–2092. 3, 18, 19, 20

  40. [49]

    A., and Baldick, R

    H uang, B., C ardenas, A. A., and Baldick, R. Not everything is dark and gloomy: Power grid protections against iot demand attacks. In 28th {USENIX} Security Symposium ( {USENIX} Security

  41. [50]

    1115–1132

    (2019), pp. 1115–1132. 8

  42. [51]

    H uber, P . J. Robust regression: asymptotics, conjectures and monte carlo. The annals of statistics (1973), 799–821. 4, 40 BIBLIOGRAPHY 127

  43. [52]

    H uber, P . J. Robust estimation of a location parameter. In Breakthroughs in statistics: Methodology and distribution. Springer, 1992, pp. 492–518. 4, 40

  44. [53]

    D., G yamfi, S., Tanyi, E., and Effah-Donyina, E

    I weh, C. D., G yamfi, S., Tanyi, E., and Effah-Donyina, E. Distributed generation and renewable energy integration into the grid: Prerequisites, push factors, practical options, issues and merits. Energies 14, 17 (2021), 5375. 1

  45. [54]

    M., Pandey, A., Wagner, M

    J ereminov, M., Bromberg, D. M., Pandey, A., Wagner, M. R., and Pileggi, L. Evaluating feasibility within power flow. IEEE Transactions on Smart Grid 11, 4 (2020), 3522–3534. 10, 11, 22, 48, 49

  46. [55]

    Equivalent circuit formulation for solving ac optimal power flow

    J ereminov, M., P andey, A., and Pileggi, L. Equivalent circuit formulation for solving ac optimal power flow. IEEE Transactions on Power Systems 34, 3 (2018), 2354–2365. 3, 22, 23

  47. [56]

    Anomaly detection in real-valued multidi- mensional time series

    J ones, M., N ikovski, D., I mamura, M., and Hirata, T. Anomaly detection in real-valued multidi- mensional time series. In International Conference on Bigdata/Socialcom/Cybersecurity. Stanford Univer- sity, ASE (2014), Citeseer. 3, 20

  48. [57]

    Ac power flow data in matpower and qcqp format: itesla, rte snapshots, and pegase

    J osz, C., F liscounakis, S., M aeght, J., and Panciatici, P . Ac power flow data in matpower and qcqp format: itesla, rte snapshots, and pegase. arXiv preprint arXiv:1603.01533 (2016). 114

  49. [58]

    An equivalent circuit formulation for power system state estimation including pmus

    J ovicic, A., J ereminov, M., P ileggi, L., and Hug, G. An equivalent circuit formulation for power system state estimation including pmus. In 2018 North American Power Symposium (NAPS) (2018), IEEE, pp. 1–6. 3, 16, 22, 25, 26

  50. [59]

    A linear formulation for power system state estimation including RTU and PMU measurements

    J ovicic, A., J ereminov, M., P ileggi, L., and Hug, G. A linear formulation for power system state estimation including RTU and PMU measurements. In 2019 IEEE PES Innovative Smart Grid Tech- nologies Europe (ISGT-Europe) (2019), IEEE, pp. 1–5. 3

  51. [60]

    Enhanced modelling framework for equivalent circuit-based power system state estimation

    J ovicic, A., Jereminov, M., Pileggi, L., and Hug, G. Enhanced modelling framework for equivalent circuit-based power system state estimation. IEEE Transactions on Power Systems 35 , 5 (2020), 3790–

  52. [61]

    Finding the most unusual time series subsequence: algorithms and applications

    K eogh, E., Lin, J., Lee, S.-H., and Van Herle, H. Finding the most unusual time series subsequence: algorithms and applications. Knowledge and Information Systems 11, 1 (2007), 1–27. 3, 20

  53. [62]

    An interior-point method for large-scale l1- regularized least squares

    K im, S.-J., K oh, K., B oyd, S., and Gorinevsky, D. An interior-point method for large-scale l1- regularized least squares. IEEE Journal of Selected Topics in Signal Processing 1 , 4 (2007), 606–617. 44 BIBLIOGRAPHY 128

  54. [63]

    An interior-point method for large-scale l1-regularized logistic regression

    K oh, K., K im, S.-J., and Boyd, S. An interior-point method for large-scale l1-regularized logistic regression. Journal of Machine learning research 8, Jul (2007), 1519–1555. 52

  55. [64]

    Probabilistic graphical models: Principles and techniques, 2009

    K oller, D. Probabilistic graphical models: Principles and techniques, 2009. 86

  56. [65]

    W., and Vidyasagar, M

    K otiuga, W. W., and Vidyasagar, M. Bad data rejection properties of weughted least absolute value techniques applied to static state estimation. IEEE Transactions on Power Apparatus and Systems, 4 (1982), 844–853. 15

  57. [66]

    A summary of the recent extreme weather events and their impacts on electricity

    K üfeo˘glu, S., P rittinen, S., and Lehtonen, M. A summary of the recent extreme weather events and their impacts on electricity. Int. Rev. Electr. Eng 9, 4 (2014), 821–828. 1

  58. [67]

    State estimation in electric power systems leveraging graph neural networks

    K undacina, O., C osovic, M., and Vukobratovic, D. State estimation in electric power systems leveraging graph neural networks. arXiv preprint arXiv:2201.04056 (2022). 18, 19, 20

  59. [68]

    M., A ssante, M., and Conway, T

    L ee, R. M., A ssante, M., and Conway, T. Crashoverride: Analysis of the threat to electric grid operations. Dragos Inc., March (2017). 1, 7, 102

  60. [69]

    Power grid behavioral patterns and risks of generalization in applied machine learning

    L i, S., D rgona, J., A bhyankar, S., and Pileggi, L. Power grid behavioral patterns and risks of generalization in applied machine learning. In Companion Proceedings of the 14th ACM International Conference on Future Energy Systems (2023), pp. 106–114. 97

  61. [70]

    R., P ileggi, L., and Vrabie, D

    L i, S., D rgona, J., T uor, A. R., P ileggi, L., and Vrabie, D. L. Homotopy learning of parametric solutions to constrained optimization problems. 19

  62. [71]

    A lasso-inspired approach for localizing power system infeasibility

    L i, S., P andey, A., A garwal, A., J ereminov, M., and Pileggi, L. A lasso-inspired approach for localizing power system infeasibility. In 2020 IEEE Power & Energy Society General Meeting (PESGM) (2020), IEEE, pp. 1–5. 4

  63. [72]

    Dynamic graph-based anomaly detection in the electrical grid

    L i, S., Pandey, A., Hooi, B., Faloutsos, C., and Pileggi, L. Dynamic graph-based anomaly detection in the electrical grid. IEEE Transactions on Power Systems 37, 5 (2021), 3408–3422. 115

  64. [73]

    A circuit-theoretic approach to state estimation

    L i, S., Pandey, A., Kar, S., and Pileggi, L. A circuit-theoretic approach to state estimation. In 2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe) (2020), IEEE, pp. 1126–1130. 3

  65. [74]

    A circuit-theoretic approach to state estimation

    L i, S., Pandey, A., Kar, S., and Pileggi, L. A circuit-theoretic approach to state estimation. In 2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe) (2020), IEEE, pp. 1126–1130. 16, 25

  66. [75]

    A convex method of generalized state estimation using circuit- theoretic node-breaker model

    L i, S., Pandey, A., and Pileggi, L. A convex method of generalized state estimation using circuit- theoretic node-breaker model. arXiv preprint arXiv:2109.14742 (2021). 4, 25, 37, 115 BIBLIOGRAPHY 129

  67. [76]

    A wlav-based robust hybrid state estimation using circuit- theoretic approach

    L i, S., P andey, A., and Pileggi, L. A wlav-based robust hybrid state estimation using circuit- theoretic approach. In IEEE PES General Meeting, (PESGM) Washington DC (2021), IEEE. 4, 25, 37

  68. [77]

    Towards practical physics-informed ml design and evaluation for power grid

    L i, S., P andey, A., and Pileggi, L. Towards practical physics-informed ml design and evaluation for power grid. arXiv preprint arXiv:2205.03673 (2022). 3, 19

  69. [78]

    Contingency analysis with warm starter using probabilistic graphical model

    L i, S., P andey, A., and Pileggi, L. Contingency analysis with warm starter using probabilistic graphical model. Electric Power Systems Research 234 (2024), 110737. 4, 84, 97

  70. [79]

    W., and Podmore, R

    L i, X., B alasubramanian, P ., Sahraei-Ardakani, M., A bdi-Khorsand, M., H edman, K. W., and Podmore, R. Real-time contingency analysis with corrective transmission switching-part i: method- ology. arXiv preprint arXiv:1604.05570 (2016). 101

  71. [80]

    R., and Dong, Z

    L iang, G., Zhao, J., Luo, F., Weller, S. R., and Dong, Z. Y. A review of false data injection attacks against modern power systems. IEEE Transactions on Smart Grid 8, 4 (2016), 1630–1638. 1, 64, 82, 102

  72. [81]

    Robust state estimation against measurement and network parameter errors

    L in, Y., and Abur, A. Robust state estimation against measurement and network parameter errors. IEEE Transactions on power systems 33, 5 (2018), 4751–4759. 2, 15, 16

  73. [82]

    L ipton, Z. C. The mythos of model interpretability: In machine learning, the concept of inter- pretability is both important and slippery. Queue 16, 3 (2018), 31–57. 19

  74. [83]

    T., Ting, K

    L iu, F. T., Ting, K. M., and Zhou, Z.-H. Isolation forest. In ICDM (2008), IEEE, pp. 413–422. 3, 20, 80

  75. [84]

    L iu, Y., Ning, P .,and Reiter, M. K. False data injection attacks against state estimation in electric power grids. ACM Transactions on Information and System Security (TISSEC) 14, 1 (2011), 1–33. 1, 102

  76. [85]

    M., C oelho, E

    L ourenço, E. M., C oelho, E. P .,and Pal, B. C. Topology error and bad data processing in gener- alized state estimation. IEEE Transactions on Power Systems 30, 6 (2014), 3190–3200. 2, 17

  77. [86]

    Deep lagrangian networks: Using physics as model prior for deep learning

    L utter, M., Ritter, C., and Peters, J. Deep lagrangian networks: Using physics as model prior for deep learning. arXiv preprint arXiv:1907.04490 (2019). 3, 18

  78. [87]

    M ajumdar, A., H all, G., and Ahmadi, A. A. A survey of recent scalability improvements for semidefinite programming with applications in machine learning, control, and robotics. arXiv preprint arXiv:1908.05209 (2019). 2, 18 BIBLIOGRAPHY 130

  79. [88]

    M andala, M., and Gupta, C. P . Congestion management by optimal placement of facts device. In 2010 Joint International Conference on Power Electronics, Drives and Energy Systems & 2010 Power India (2010), IEEE. 41, 42

  80. [89]

    M ili, L., Phaniraj, V .,and Rousseeuw, P . J. Least median of squares estimation in power systems. IEEE Transactions on Power Systems 6, 2 (1991), 511–523. 15

  81. [90]

    J.,and Khardenvis, M

    M ishra, V . J.,and Khardenvis, M. D. Contingency analysis of power system. In2012 IEEE Students’ Conference on Electrical, Electronics and Computer Science (2012), IEEE, pp. 1–4. 101

  82. [91]

    E., F aloutsos, C., and Singh, A

    M ongiovi, M., B ogdanov, P ., Ranca, R., P apalexakis, E. E., F aloutsos, C., and Singh, A. K. Netspot: Spotting significant anomalous regions on dynamic networks. In SDM (2013), SIAM, pp. 28–36. 3, 21, 80

  83. [92]

    "State estimation in electric power systems: a generalized approach

    M onticelli, A. Generalized topology processing, Chapter 6.2 of Book ""State estimation in electric power systems: a generalized approach" . Springer Science & Business Media, 2012. 2, 17

  84. [93]

    State estimation in electric power systems: a generalized approach

    M onticelli, A. State estimation in electric power systems: a generalized approach . Springer Science & Business Media, 2012. 13

  85. [94]

    Reliable bad data processing for real-time state estimation

    M onticelli, A., and Garcia, A. Reliable bad data processing for real-time state estimation. IEEE Transactions on Power Apparatus and Systems, 5 (1983), 1126–1139. 15

  86. [95]

    M urphy, K. P . Undirected graphical models (markov random fields). Machine Learning: A Probabilis- tic Perspective; MIT Press: Cambridge, MA, USA (2012), 661–705. 86, 87, 88

  87. [96]

    Reliability guideline: Pmu placement and installation, 2016

    NERC. Reliability guideline: Pmu placement and installation, 2016. 12

  88. [97]

    K., and McFadden, D

    N ewey, W. K., and McFadden, D. Large sample estimation and hypothesis testing. Handbook of econometrics 4 (1994), 2111–2245. 37

  89. [98]

    Big data synchrophasor analysis

    of electricity, O. Big data synchrophasor analysis. 12

  90. [99]

    On the feasibility of load-changing attacks in power systems during the covid-19 pandemic

    O spina, J., Liu, X., Konstantinou, C., and Dvorkin, Y. On the feasibility of load-changing attacks in power systems during the covid-19 pandemic. IEEE Access 9 (2020), 2545–2563. 8

  91. [100]

    O verbye, T. J. A power flow measure for unsolvable cases. IEEE Transactions on Power Systems 9 , 3 (1994), 1359–1365. 2, 10, 11 BIBLIOGRAPHY 131

  92. [101]

    Optimal power flow using graph neural networks

    O werko, D., G ama, F., and Ribeiro, A. Optimal power flow using graph neural networks. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2020), pp. 5930–5934. 18, 19, 20

  93. [102]

    Deepopf: Deep neural network for dc optimal power flow

    P an, X., Zhao, T., and Chen, M. Deepopf: Deep neural network for dc optimal power flow. In 2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (2019), IEEE, pp. 1–6. 18, 19

  94. [103]

    Robust convergence of power flow using tx stepping method with equivalent circuit formulation

    P andey, A., Huang, X., Jereminov, M., and Pileggi, L. Robust convergence of power flow using tx stepping method with equivalent circuit formulation. In 2018 Power Systems Computation Conference (PSCC) (2018), IEEE. 48

  95. [104]

    R., B romberg, D

    P andey, A., J ereminov, M., W agner, M. R., B romberg, D. M., H ug, G., and Pileggi, L. Robust power flow and three-phase power flow analyses. IEEE Transactions on Power Systems 34 , 1 (2018), 616–626. 2, 3, 10, 11, 22, 23, 24, 100

  96. [105]

    R., B romberg, D

    P andey, A., J ereminov, M., W agner, M. R., B romberg, D. M., H ug, G., and Pileggi, L. Robust power flow and three-phase power flow analyses. IEEE Transactions on Power Systems 34 , 1 (2018), 616–626. 2, 3, 31

  97. [106]

    Combined transmission and distribution state-estimation for future electric grids

    P andey, A., L i, S., and Pileggi, L. Combined transmission and distribution state-estimation for future electric grids. In Power Systems Operation with 100% Renewable Energy Sources . Elsevier, 2024, pp. 299–315. 4, 22, 25, 37

  98. [107]

    Influence of extreme weather and climate change on the resilience of power systems: Impacts and possible mitigation strategies

    P anteli, M., and Mancarella, P . Influence of extreme weather and climate change on the resilience of power systems: Impacts and possible mitigation strategies. Electric Power Systems Research 127 (2015), 259–270. 1

  99. [108]

    On estimation of a probability density function and mode

    P arzen, E. On estimation of a probability density function and mode. The annals of mathematical statistics 33, 3 (1962), 1065–1076. 80

  100. [109]

    Scikit-learn: Machine learning in Python

    P edregosa, F., Varoquaux, G., G ramfort, A., M ichel, V ., Thirion, B., G risel, O., B londel, M., Prettenhofer, P ., Weiss, R., D ubourg, V ., Vanderplas, J., Passos, A., C ournapeau, D., B rucher, M., P errot, M., and Duchesnay, E. Scikit-learn: Machine learning in Python. ...

  101. [110]

    Electronic Circuit & System Simulation Methods (SRE)

    P illage, L. Electronic Circuit & System Simulation Methods (SRE) . McGraw-Hill, Inc., 1998. 23, 31 BIBLIOGRAPHY 132

  102. [111]

    C., Costa, A

    P ires, R. C., Costa, A. S., and Mili, L. Iteratively reweighted least-squares state estimation through givens rotations. IEEE Transactions on Power Systems 14, 4 (1999), 1499–1507. 15

  103. [112]

    Balancing operations

    PJM. Balancing operations. revision: 47, 2022. 14

  104. [113]

    Pjm manual 01: Control center and data exchange requirements

    PJM. Pjm manual 01: Control center and data exchange requirements. revision: 46, 2022. 11, 12

  105. [114]

    S.,and Taylor, C

    P ourbeik, P ., Kundur, P . S.,and Taylor, C. W. The anatomy of a power grid blackout-root causes and dynamics of recent major blackouts. IEEE Power and Energy Magazine 4, 5 (2006), 22–29. 10

  106. [115]

    A topology processor that tracks network modifications

    P rais, M., and Bose, A. A topology processor that tracks network modifications. IEEE Transactions on Power Systems 3, 3 (1988), 992–998. 13, 14

  107. [116]

    Efficient algorithms for mining outliers from large data sets

    R amaswamy, S., Rastogi, R., and Shim, K. Efficient algorithms for mining outliers from large data sets. In ACM Sigmod Record (2000), vol. 29, ACM, pp. 427–438. 3, 20

  108. [117]

    R anshous, S., H arenberg, S., S harma, K., and Samatova, N. F. A scalable approach for outlier detection in edge streams using sketch-based approximations. In SDM (2016), SIAM, pp. 189–197. 3, 21

  109. [118]

    J., K e, X., Huang, Q., and Makatov, Y

    R en, H., Hou, Z. J., K e, X., Huang, Q., and Makatov, Y. Analysis of weather and climate extremes impact on power system outage. In 2021 IEEE Power & Energy Society General Meeting (PESGM) (2021), IEEE, pp. 01–05. 1

  110. [119]

    C., and Wildes, J

    S chweppe, F. C., and Wildes, J. Power system static-state estimation, part i: Exact model. IEEE Transactions on Power Apparatus and systems, 1 (1970), 120–125. 1, 2, 12, 14, 55

  111. [120]

    Timecrunch: Interpretable dynamic graph summarization

    S hah, N., K outra, D., Z ou, T., G allagher, B., and Faloutsos, C. Timecrunch: Interpretable dynamic graph summarization. In KDD (2015), ACM, pp. 1055–1064. 80

  112. [121]

    K., Ghosh, A., and Varma, R

    S harma, N. K., Ghosh, A., and Varma, R. K. A novel placement strategy for facts controllers. IEEE Transactions on Power Delivery 18, 3 (2003), 982–987. 41, 42

  113. [122]

    Detection of abnormal change in a time series of graphs

    S houbridge, P ., Kraetzl, M., Wallis, W., and Bunke, H. Detection of abnormal change in a time series of graphs. Journal of Interconnection Networks 3, 01n02 (2002), 85–101. 83

  114. [123]

    Shedding light on inconsistencies in grid cybersecurity: Disconnects and recommendations

    S inger, B., Pandey, A., L i, S., B auer, L., M iller, C., P ileggi, L., and Sekar, V . Shedding light on inconsistencies in grid cybersecurity: Disconnects and recommendations. In 2023 IEEE Symposium on Security and Privacy (SP) (2022), IEEE Computer Society, pp. 554–571. 1, ...

  115. [124]

    L., and Liu, W

    S ingh, H., A lvarado, F. L., and Liu, W. . E. Constrained lav state estimation using penalty func- tions. IEEE Transactions on Power Systems 12, 1 (1997), 383–388. 16

  116. [125]

    Measurement of power systems voltage and flicker levels for power quality analysis: a static lav state estimation based algorithm

    S oliman, S., and El-Hawary, M. Measurement of power systems voltage and flicker levels for power quality analysis: a static lav state estimation based algorithm. International journal of electrical power & energy systems 22, 6 (2000), 447–450. 15

  117. [126]

    S oltan, S., Mittal, P .,and Poor, H. V . Blackiot: Iot botnet of high wattage devices can disrupt the power grid. In 27th USENIX Security Symposium (USENIX Security 18) (2018), pp. 15–32. 8, 64, 96, 102

  118. [127]

    A., H ooi, B., J ereminov, M., P andey, A., P ileggi, L., and Faloutsos, C

    S ong, H. A., H ooi, B., J ereminov, M., P andey, A., P ileggi, L., and Faloutsos, C. Powercast: Mining and forecasting power grid sequences. In ECML-PKDD (2017), Springer, pp. 606–621. 80

  119. [128]

    M., T onkoski, R., S hirazi, M., W ies, R., and Cicilio, P

    S ubedi, S., R auniyar, M., I shaq, S., H ansen, T. M., T onkoski, R., S hirazi, M., W ies, R., and Cicilio, P . Review of methods to accelerate electromagnetic transient simulation of power systems. IEEE Access 9 (2021), 89714–89731. 1

  120. [129]

    Sparsity and smoothness via the fused lasso

    T ibshirani, R., Saunders, M., Rosset, S., Zhu, J., and Knight, K. Sparsity and smoothness via the fused lasso. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67, 1 (2005), 91–108. 4, 42, 43

  121. [130]

    F.,and Hart, C

    T inney, W. F.,and Hart, C. E. Power flow solution by newton’s method. IEEE Transactions on Power Apparatus and systems, 11 (1967), 1449–1460. 1, 2, 9

  122. [131]

    T uinenga, P . W. SPICE: a guide to circuit simulation and analysis using PSpice , vol. 2. Prentice Hall,

  123. [132]

    The cvxopt linear and quadratic cone program solvers

    Vandenberghe, L. The cvxopt linear and quadratic cone program solvers. Online: http://cvxopt. org/documentation/coneprog. pdf (2010). 53

  124. [133]

    E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P ., Weckesser, W., Bright, J., et al

    V irtanen, P ., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P ., Weckesser, W., Bright, J., et al. Scipy 1.0: fundamental algorithms for scientific computing in python. Nature methods 17, 3 (2020), 261–272. 53

  125. [134]

    A review of power system transient stability analysis and assessment

    W ang, H., and Li, Z. A review of power system transient stability analysis and assessment. In 2019 Prognostics and System Health Management Conference (PHM-Qingdao) (2019), IEEE, pp. 1–6. 1 BIBLIOGRAPHY 134

  126. [135]

    D., Li, Q., and Negi, R

    W eng, Y., Ili´c, M. D., Li, Q., and Negi, R. Convexification of bad data and topology error detection and identification problems in ac electric power systems. IET Generation, Transmission & Distribution 9, 16 (2015), 2760–2767. 2, 16, 17, 18, 53

  127. [136]

    J., W ollenberg, B

    W ood, A. J., W ollenberg, B. F., and Sheblé, G. B. Power generation, operation, and control . John Wiley & Sons, 2013. 67

  128. [137]

    Optimal sensor placement for fault detection

    W orden, K., and Burrows, A. Optimal sensor placement for fault detection. Engineering structures 23, 8 (2001), 885–901. 121

  129. [138]

    F., and Liu, W.-H

    W u, F. F., and Liu, W.-H. Detection of topology errors by state estimation (power systems). IEEE Transactions on Power Systems 4, 1 (1989), 176–183. 2, 17, 55

  130. [139]

    Neural network based state estimation of dynamical systems

    Y adaiah, N., and Sowmya, G. Neural network based state estimation of dynamical systems. In The 2006 IEEE international joint conference on neural network proceedings (2006), IEEE, pp. 1042–1049. 18

  131. [140]

    B., and Sun, J

    Y ang, Q., Sadeghi, A., Wang, G., Giannakis, G. B., and Sun, J. Gauss-newton unrolled neural net- works and data-driven priors for regularized psse with robustness. arXiv preprint arXiv:2003.01667 (2020). 3, 18, 19, 20

  132. [141]

    Fast calculation of probabilistic power flow: A model-based deep learning approach

    Y ang, Y., Y ang, Z., Y u, J., Z hang, B., Z hang, Y., and Yu, H. Fast calculation of probabilistic power flow: A model-based deep learning approach. IEEE Transactions on Smart Grid 11 , 3 (2019), 2235–2244. 3, 18, 19, 20

  133. [142]

    Grouped convolutional neural networks for multivariate time series

    Y i, S., J u, J., Y oon, M.-K., and Choi, J. Grouped convolutional neural networks for multivariate time series. arXiv preprint arXiv:1703.09938 (2017). 3, 20

  134. [143]

    Learning-based real-time event identification using rich real pmu data

    Y uan, Y., G uo, Y., D ehghanpour, K., W ang, Z., and Wang, Y. Learning-based real-time event identification using rich real pmu data. IEEE Transactions on Power Systems 36 , 6 (2021), 5044–5055. 3, 21

  135. [144]

    Learning latent interactions for event identification via graph neural networks and pmu data

    Y uan, Y., Wang, Z., and Wang, Y. Learning latent interactions for event identification via graph neural networks and pmu data. arXiv preprint arXiv:2010.01616 (2020). 3, 21

  136. [145]

    Z hang, L., Wang, G., and Giannakis, G. B. Real-time power system state estimation via deep un- rolled neural networks. In 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP) (2018), pp. 907–911. 3, 18, 20 BIBLIOGRAPHY 135

  137. [146]

    Z hang, L., W ang, G., and Giannakis, G. B. Real-time power system state estimation and fore- casting via deep unrolled neural networks. IEEE Transactions on Signal Processing 67 , 15 (2019), 4069–4077. 3, 18, 20

  138. [147]

    K., Qi, J., et al

    Z hao, J., Gómez-Expósito, A., Netto, M., Mili, L., Abur, A., Terzija, V ., Kamwa, I., Pal, B., Singh, A. K., Qi, J., et al. Power system dynamic state estimation: Motivations, definitions, methodologies, and future work. IEEE Transactions on Power Systems 34, 4 (2019), 3188–3198. 1

  139. [148]

    A generalized false data injection attacks against power system nonlinear state estimator and countermeasures

    Z hao, J., M ili, L., and Wang, M. A generalized false data injection attacks against power system nonlinear state estimator and countermeasures. IEEE Transactions on Power Systems 33 , 5 (2018), 4868–4877. 1, 2, 8, 64, 102

  140. [149]

    A generalized false data injection attacks against power system nonlinear state estimator and countermeasures

    Z hao, J., M ili, L., and Wang, M. A generalized false data injection attacks against power system nonlinear state estimator and countermeasures. IEEE Transactions on Power Systems 33 , 5 (2018), 4868–4877. 8

  141. [150]

    S., Gómez-Expósito, A., Wang, S., Kamwa, I., Akhlaghi, S., Mili, L., T erzija, V ., Meliopoulos, A

    Z hao, J., Netto, M., Huang, Z., Yu, S. S., Gómez-Expósito, A., Wang, S., Kamwa, I., Akhlaghi, S., Mili, L., T erzija, V ., Meliopoulos, A. P . S., Pal, B., S ingh, A. K., A bur, A., B i, T., and Rouhani, A. Roles of dynamic state estimation in power system modeling, monitorin...

  142. [151]

    D., Murillo-Sánchez, C

    Z immerman, R. D., Murillo-Sánchez, C. E., and Thomas, R. J. Matpower: Steady-state operations, planning, and analysis tools for power systems research and education. IEEE Transactions on power systems 26, 1 (2010), 12–19. 38

  143. [152]

    D., Murillo-Sánchez, C

    Z immerman, R. D., Murillo-Sánchez, C. E., and Thomas, R. J. Matpower: Steady-state operations, planning, and analysis tools for power systems research and education. IEEE Transactions on power systems 26, 1 (2011), 12–19. 78, 80

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.