Welcome to PENSA at Princeton University
PENSA is the home of the SAP Initiative for Energy Systems Research at Princeton University. Our goal is to bring advanced analytical thinking to the development of new energy technologies, the rigorous study of energy policy, and the efficient management of energy resources.
Warren Powell gave a tutorial presentation to FERC on stochastic optimization, with an update on our research on the stochastic unit commitment problem. Recent research has formalized industry practice as a "robust cost function approximation" which involves optimizing a parametric modification of the cost function. For a tutorial on stochastic optimization and the stochastic unit commitment problem, click here.
Erick Chen, Shuyang Li and Ryan McNellis, undergraduate interns the summer of 2014, present their summer research, covering approximate dynamic programming to model economic behavior, optimizing energy storage using reinforcement learning, and the modeling of wind and solar energy for the PJM grid. Other summer research included monotone ADP for bidding battery storage, and the comparison of stochastic dual decomposition (Benders cuts) against separable, piecewise linear value functions for grid level battery storage.
Understanding uncertainty in the context of uncertainty. Variability of solar is a big issue, but so its the challenge of forecasting it. The problem is that decisions are often made in advance. Gas turbines (on the PJM grid) are planned once every 30 minutes. Steam is planned a day in advance. And energy investments are planned years in advance.
(Click here to download the full pdf).
We are starting to get some very close comparisons between the LMPs (locational marginal prices) produced by SMART-ISO, and those observed in history. Following a major rewrite to model PJM's IT-SCED unit commitment process, we obtained a surprisingly close match in the difficult peak month of July (right). For more on calibration, click here.
Getting a match on the behavior of LMPs means that we had to reasonably match PJM's behavior of day-ahead and real-time planning, with a realistic economic dispatch model (where the LMPs are calculated), with an accurate model of the grid.
Princeton hosted a research team from University Sao Paulo and Unicamp in September, 2013, to compare differences in the energy systems of the two countries, compare research agendas, and look for opportunities for future collaboration. The differences are significant - Brazil derives almost 90 percent of its electricity from hydroelectric power. However, dry periods can periodically limit the use of hydro, recently forcing Brazil to generate a significant amount of power from oil, raising their interest in other types of renewable generatioin.
Ph.D. student Daniel Salas developed an approximate dynamic programming algorithm, SMART-Storage, for optimizing grid level storage. This first plot shows the grid without storage, with the orange and red rectangles indicating the lines with the highest congestion. The simulation is testing significant levels of off-shore wind.
Click here for movie (100 meg!)
In this second simulation, he can use storage near the off-shore wind generators (shown in green, where the diameter indicates how much is in storage at a point in time), or near major load points (shown in blue). The algorithm adapts to the congestion on the grid. Note the dramatic reduction in the lines that are over capacity (the snapshot is made at the same point in time in the simulation).
Click here for movie (100 meg!).
SMART-Storage can be used to identify the best locations for storage, based on their marginal value over an entire planning period, taking into account near-optimal policies for charging and discharging in response to locational marginal prices.
[This research was funded by the National Science Foundation.]
Daniel Salas presents his work on grid level storage to the group. His work spans stochastic optimization (approximate dynamic programming), stochastic modeling of prices, and modeling of the power grid.
SMART-LSOC is an intelligent load and source controller developed jointly with the Center for Computational Learning Systems at Columbia University, as part of a DOE-funded projected for ConEd of New York City. We compared two approximate dynamic programming policies, a cost function approximation and a policy based on value function approximations, to develop robust policies for executing advance curtailments of buildings in anticipation of grid congestion. The image to the left shows the grid for Queens, NY, with the various primary feeders which may fail from time to time.Click here for the paper.
Deputy director Hugo Simao kicks off the 2013 summer season with a presentation on SMART-ISO, prior to giving this talk at the 2013 FERC Conference in D.C. Three years in development, SMART-ISO is beginning to produce results that accurately capture the historical behavior of PJM.
We have begun two projects managing energy systems for buildings. The first is a model of energy flows for Princeton University, which involves optimizing the chilled water energy storage facility with energy from the grid (at spot prices), gas turbine, and a diesel generator. The university operates several boilers and eight chillers. These have to be optimized to meet campus loads while minimizing exposure to real-time spot prices. A separate project involves optimizing steam generation for building loads, given the complex peak-load pricing policy of Consolidated Edison of New York.
Warren Powell met with members of the NJ state legislature and the Bureau of Public Utilities to help Tom Nyquist and Ted Borer from Princeton University explain new rules that might stabilize solar renewable energy credit markets. A multiagent simulator developed by Will Harrel '13 helped to analyze the effect of the newrules.
Warren Scott designed a direct policy search algorithm using his adaptation of the knowledge gradient algorithm for continuous parameters, resulting in a battery storage policy that produced solutions within 5-10 percent of a benchmark optimal policy. Along the way, he demonstrated the equivalence of projected Bellman error minimization and Bellman error minimization using instrumental variables (but neither of these worked as well as direct policy search). Warren defended his dissertation in May.