GPA Logo   News

STTP Draft Specification Available

To facilitate a collborative process for development of the Streaming Transport Protocol Specification (STTP) that is being developed as part of the ASP Project, the specification is now available on GitHub for review and comment. It's posted at https://github.com/sttp

The STTP specification defines a publish-subscribe data transfer protocol that has been optimized for exchanging streaming time series data, such as synchrophasor data that is used in the electric power industry, over Internet Protocol (IP). The protocol supports transferring both real-time and historical time series data at full or down-sampled resolutions. Protocol benefits are realized at scale when multiplexing very large numbers of time series data points at high speed, such as, hundreds of times per second per data point.

An updated PDF of the STTP specification is produced nightly.

August 20, 2017

openHistorian Version 2.3 Released

A new version of the openHistorain was released today. Version 2.3 includes:

  • Added optional timestamp reasonability checking for incoming measurements to be archived.
  • Suppressed blank warnings and messages from flowing to the console.
  • Simplified Datahub record operations with new modeled table functions.
  • Added a security mode indication to support FIPS compliance to primary web interface home page.
  • Along with numerous other minor bug fixes and improvements.

For more information and to download see: openHistorian on GitHub

July 12, 2017

ARMORE Public Release

Applied Resiliency for More Trustworthy Grid Operation (ARMORE) is an open-source software system that can perform inspection of network packets and alarm on communication that does not comply with the specified ARMORE policy. ARMORE can be configured to take action to block network traffic based on deep inspection of common substation communications protocols, such as the Distributed Network Protocol (DNP3). After validation for compliance with policy, ARMORE can encapsulate and encrypt legacy communications and resiliently transmit this information among ARMORE nodes (such as between the substation and the control center). Through this peer-based framework for secure information exchange, ARMORE provides the functionality to push secure, fault-tolerant real-time communication capabilities deeper into critical utility networks.

ARMORE was developed under DOE Office of Electricity Project 676 by GPA, the University of Illinois at Urbana-Champaign and Pacific Northwest National Laboratory over the period from October 2013 through June 2017.

See ARMORE on GitHub

June 30, 2017

PQ Dashboard User's Group Meeting

The inaugural Open PQ Dashboard User's Group Meeting was held at the EPRI offices in Knoxville on April 18, 2017.

The meeting focused on industry use cases for the open PQ Dashboard and it's data layer, openXDA.

April 12, 2017

New Product Versions Released

openPDC Version 2.4

After several months of pre-release testing, the openPDC version 2.4 is now available. In Version 2.4, there are new features, optimizations and enhancements including:

  • GrafanaAdapters: Added full set of aggregation and operational functions that operate on a per-series or per-set for all data sources that implement Grafana interfaces.
  • LogFileViewer: Added new enhanced general logging capabilities along with a new application, Log File Viewer, that is used to analyze logs.
  • PowerCalculations: Added calculators for wrapping angle difference and line impedance with resistance, reactance, conductance and susceptance results - includes both rectangular and polar based outputs.
  • PowerCalculations: Updated average frequency calculator to (1) exclude NaN values from average results, (2) allow definable unreasonable thresholds, (3) improve flat-line value detection to throw out repeating values, and (4) added flag to AverageFrequency calculator to allow unreasonable results, e.g., zero, to be reported as NaN.
  • GSF.TimeSeries: Added a new enhanced version of the time-series special compression algorithm, automatically enabled for new connections, used with the Gateway Exchange Protocol that uses much less bandwidth. Add ; compression=true to connection string of existing GEP subscriptions to enable.
  • Plus hundreds of other minor bug fixes, optimizations and improvements.

For more information and to download see: openPDC on GitHub

SIEGate Version 1.5

This version new version of SIEGate incorporates all the changes of the openPDC Version 2.4. For more information and to download see: SIEGate on GitHub

PDQTracker Version 1.2

This new version of PDQTracker includes all the applicable updates from the openPDC Version 2.4, plus:

  • StatHistorianReportGenerator: Added system up-time to each of the daily reports.
  • StatHistorianReportGenerator: Modified correctness report to properly count measurements received while the device was reporting an error to produce a more accurate report.
  • LogFileViewer: Added new enhanced general logging capabilities along with a new application, Log File Viewer, that is used to analyze logs.
  • Along with numerous other minor bug fixes and improvements.

For more information and to download see: PDQTracker on GitHub

substationSBG Version 1.3

This new version of the substationSBG includes all the applicable updates from the openPDC Version 2.4, plus:

  • GSF.Historian: Improved handling of roll-over situations when using ArchvieReaders to improve data availability even when a Data Gap Recovery is in process.
  • GSF.Historian: Updated 1.0 historian archive writes to not report time-tag exceptions for historical writes that are out of range.
  • HistorianAdapters: Modified LocalOutputAdapter startup message to use the correct archive file path when reading the path from the configuration file.
  • Along with numerous other minor bug fixes and improvements.

For more information and to download see: substationSBG on GitHub

March 17, 2017

New Version of Stream Splitter Released

Version 1.0.28 of the Synchrophasor Stream Splitter was released today. It includes:

  • A fix for a race condition that was causing to an infinite asynchronous loop for reverse TCP connections
  • A fix of the status light for listening servers that are started but have no connected devices
  • The addition of a configurable delay for reporting duplicate socket exceptions that defaults to every 10 seconds
  • Along with serveral other minor bug fixes and improvements.

For more information and to download see: Stream Splitter on GitHub

March 15, 2017

openMIC Version 1.0 Released

GPA has released a new open source product called openMIC (Meter Information Collector) that can poll DFRs and other substation devices and automatically download data via FTP or ModBus. Adminstrators can define multiple meter interrogation schedules in openMIC -- including polling each meter as fast as possbile. openMIC includes copious logging including a detailed meter interaction history in a relational data base to generate meter issue notifications and produce meter status reports. A mobile-ready application is included to show the iterrogation history of each meter/DFR.

March 10, 2017

GPA Selected to be Part of DOE Grid Moderization Initiative

The US Department of Energy (DOE) has announced the award of a $2.2 million dollar project called the Advanced Synchrophasor Project (ASP), to a team lead by GPA. The new publish-subscribe protocol will significantly improve the quality and robustness of the synchrophasor data exchange layer that functions as the foundation for reliability management tools. This project will lower both the first cost and on-going operting cost of operating synchrophasor data systems.

The new protocol will be called the Streaming Teletry Transport Protocol (STTP), and it will support transferring both real-time and historical time series data at full or down-sampled resolutions. Protocol benefits are realized at scale when multiplexing a large number of time series data points at high speed, such as, hundreds of times per second per data point. Ideal use cases for STTP will include those that need to securely exchange a large volume of continuously measured data. See the DOE News Release for more information.

October 19, 2016

openECA Project Selected for funding by DOE

The US Department of Energy (DOE) has announced the award of a $5 million dollar project to a team lead by GPA. The DOE funding will be used over the next two years to create software that enables the deployment of synchrophasor data analytics.

Partners with GPA on the project are Dominion Virginia Power, Oklahoma Gas and Electric Company, Southwest Power Pool, Northwestern Energy, Virginia Technological University and T&D Consulting Engineers. The project will create an “Open and Extensible Control and Analytics Platform of Phasor Data”. Called “openECA” the project software includes components to filter and condition the phasor data as well as 9 different analytic components including oscillation detection and wide-area voltage control.

August 3, 2015

openPDC Service Pack 1 Released

Service Pack 1 to Version 2.1 of the openPDC was released today so that a fix can be deployed to resolve a slow memory leak when continuously running the openPDC manager on the server which also hosts the openPDC. The service pack includes also includes several dozen enhancements and fixes in addition to those listed below. See: openPDC 2.1 Service Pack 1 on codeplex for the full list.

Service Pack 1 includes:

  • Change of installer license to the MIT license
  • Support for GEP using ZeroMQ
  • Improved alarm configuration
  • Data Quality Report replaced by separate “data completeness” and “data correctness” reports
  • Improved configuration for data gap filling in clustered deployments

Service Pack 1 fixes:

  • OSI PI Adapter
  • Memory management with GEP after periods of stress
  • Disconnection of unauthenticated TLS clients

Note that the SP1 fixes coming from the Grid Solutions Framework have also been applied as updates to SIEGate, substationSBG, PDQTracker and Project Alpha.

Version 2.2 of the openPDC is planned for release in March 2016.

July 29, 2015

PDQTracker Beta Deployed at PeakRC

The Beta version of PDQTracker is now available on codeplex. It was deployed today at PeakRC for testing and evaluation. This version of the PDQTracker includes all the fixes included with openPDC v2.1, including those in the forthcoming SP1 release.

Some of the improvements to be implemented in the next release of PDQTracker include:

  • Self-configuring IEEE C37.118 streams
  • Using relative time sources (e.g., a set of signals) for latency calculations
  • Bulk alarm configuration (e.g., spreadsheet loading)
  • Slow data (e.g., SCADA from OSI-PI) input comparisons
  • Use of openHistorian 2.0 engine for statistics to improve performance
July 16, 2015

openXDA Version 1.3 Released

A major release of openXDA was made today as part of the deployment of openXDA at Georgia Transmission. Version 1.3 includes the ability to automatically perform double-ended fault location along with significantly improved fault detection logic which provides better rejection of false positive results. In addition, version 1.3 includes:

  • A modified analysis engine with data-driven configuration of analytics modules.
  • A collection of email templates to allow for configuration of custom formats for the emails sent automatically when a fault is detected.
  • Performance improvements on the initial file scan of the system on startup.
  • Enhancements to support parallel processing of file data.
  • Improved logging mechanisms and increased verbosity of log messages.
  • Many minor bug fixes.
July 13, 2015

GPA Products Support ZeroMQ

The "zero" in ZeroMQ represents zero broker, zero latency (or low latency), zero administration and zero cost. With this as the business case, the fault-tolerant ZeroMQ messaging technology has been selected by the ARMORE design team as the method to transparently encapsulate and encrypt data in substation protocols as it is moved among ARMORE nodes. See: Why ZeroMQ is preferred for Synchrophasor Data

Using ZeroMQ and its Curve security protocol allows ARMORE to employ a fast, widely adopted messaging layer for secure data exchange for both command messages and encapsulated data packets. This enables ARMORE node interoperability even with future implementations by using common ZeroMQ semantics that guarantee a command sent by one implementation can be correctly processed by another implementation.

As part of the work for ARMORE, the Grid Solutions Framework now includes ZeroMQ messaging and it has been incorporated into the lasted development builds of the openPDC, substationSBG and SIEGate as a protocol type selectable through configuration.

June 1, 2015

Project Alpha Available on Codeplex

As a service to jump-start developers in the creation of new products based on the Time-Series Library, a Visual Studio project template called TSL Project Alpha is now available on Codeplex. It can be used as the starting point to develop new applications from GPA's extensible code base.

GPA has worked with several individuals and organizations over the years to develop custom action adapters (both proprietary and open source) that perform a synchrophasor analysis or calculation that is delivered to the user as a stand-alone product. Using the TSL Alpha Project it is now much more convenient for developers to create their own product by starting from a clean project template -- rather than building a new product as a one-off from an existing project, such as from the openPDC.

For more information see: TSL Project Alpha.

March 10, 2015

New Product Versions Released

openPDC Version 2.1

After several months of pre-release testing, the openPDC version 2.1 is now available. In Version 2.1, there are new features, optimizations and enhancements plus this is the first version of the openPDC to officially support Linux and Apple OS X operating systems -- POSIX environments. This POSIX support is currently for all components within the Time Series Library but the "product manager". See: TSL Components for more information.

Version 2.1 of the openPDC includes automated data recovery, or "gap filling", when connected to other devices that support GPA's Gateway Exchange Protocol. These devices include the openPDC, the new substation Secure Buffered Gateway (substationSBG) and SIEGate. With this feature, the openPDC can request data that was lost during routine maintenance and other communications outages. The missing data is requested at a rate to minimize adverse impacts to real-time operations.

Other major improvements in Version 2.1 of the openPDC include:

  • Improved LDAP/Active Directory integration and authentication -- including the ability to attempt an anonymous LDAP binding when no other options are available.
  • Improved historian interaction so that the system always yields to roll-over processing to prevent unnecessary file locks.
  • Improved processing of historian metadata file information (e.g., ppa_dbase.dat) using a variable length file format that supports non-fixed length strings and structures as well as use a dictionary style lookup for keys. This reduces required memory and disk space for large metadata repositories.
  • Specifically for those using the OSI-PI Historian, higher performance and smoother integration through incorporation of PI's new SDK.
  • Hundreds of other minor bug fixes, optimizations and improvements.

For more information and to download see: openPDC on Codeplex

SIEGate Version 1.1

This release of SIEGate enables the SIEGate service to be run on Linux and includes many bug fixes -- including those resolved with release of the openPDC Version 2.1.

For more information and to download see: SIEGate on Codeplex

substationSBG Version 1.0

After testing on fan-less substation computers the first production version of the substationSBG has been released. It also includes the ability to run the substationSBG service on Linux.

For more information and to download see: substationSBG on Codeplex

March 6, 2015

EPRI Open PQ Dashboard To Be Readied for Production Use

The Electric Power Research Institute (EPRI) has asked GPA to refine the EPRI Open PQ Dashboard Version 0.7 (beta) so that it can be easily deployable, fully-supported production application. Under this 2015 EPRI project, GPA will implement new system configuration features as well as more comprehensive PQ event categorization and reporting, among other improvements to the dashboard.

The EPRI Open PQ Dashboard is a browser-based tool that provides insight through an integrated presentation of PQ and DFR data. The Open PQ Dashboard displays data housed within openXDA data base. Disturbance and power quality trending data is presented in the dashboard in easily understood geographic, grid, histogram, and tabular displays that allow the user to quickly assess the status of the system and focus on the aspects of PQ that are most important for the task at hand.

March 2, 2015

GPA Changes to MIT License

The use of open source software is growing and its nature is evolving. To better align with a recent open source announcement from Microsoft, GPA is updating all source code to be released under the MIT License. Since GPA's inception in 2010, GPA has used the Eclipse Public License (EPL) for release of its source code. Both the Eclipse Public License and the MIT License are "permissive" free software licenses. "Permissive" meaning that the source code can be freely used within proprietary software.

GPA originally selected the Eclipse Public License since it was viewed as the permissive license that was the most congruent with the open source license used by the Tennessee Valley Authority where a large portion of GPA open source code originated. However, the EPL places some restrictions on the open source release of derivative software products. The MIT License is considerably more simple than the EPL and does not include the EPL restrictions. Therefore, the MIT license has been chosen to assure that GPA's code can be flexibly used as broadly as possible.

GPA is currently in the process of updating source code headers to reflect this change. This work is expected to be completed within the next few weeks.

February 20, 2015

openHistorian 2.0 Beta in Production Use at OG&E and Entergy

The new openHistorian 2.0 BETA has been installed and is in production use at Oklahoma Gas & Electric and Entergy archiving synchrophasor data.

The archive performance and historical query speed of the new historian deployment are ideal for large high-speed, streaming synchrophasor deployments.

The openHistorian 2.0 has been optimized for:

  • Assurance of archived data integrity / continuity
  • Broad data source connectivity
  • High performance data capture and retrieval
  • Efficient, high-volume data storage
  • High availability

January 15, 2015

System Event Explorer Now Available

The open System Event Explorer (openSEE) has been officially released on codeplex. See: openSystemEventExplorer.com.

openSEE is a browser-based wave-form display tool that can be implemented in conjunction with openXDA. A link to openSEE is typically embedded in e-mails automatically produced by openXDA so that e-mail recipients can quickly access the waveforms that were triggered based on DFR and PQ meter events.

openSEE will allow two waveforms to be displayed so that comparisons of data can be made -- from different channels in the same DFR that triggered the event or from channels in other DFRs. An optional phasor display is also available to easily resolve phase angles.

January 7, 2015