Abstract

There is a generalized consensus in the Non-Intrusive Load Monitoring research community on the importance of public datasets for improving this research field. Still, despite the considerable efforts to release public data, what is currently available suffers from serious issues, among which is the lack of widely accepted data models and common interfaces to access the currently available and future datasets. This paper proposes the Energy Monitoring and Disaggregation Data Format (EMD-DF64). EMD-DF64 is a data model, file format, and application programming interface developed to provide a unique interface to create, manage, and access high-frequency (>=1Hz) electric energy consumption datasets. More precisely, the present paper describes the data model and its respective implementation, which was done by leveraging the well-known Sony WAVE64 format that supports the storage of audio data and metadata annotations.

Abstract

The use of energy sharing models in smart grids has been widely addressed in the literature. However, feasible technical solutions that can deploy these models into reality, as well as the correct use of energy forecasts are not properly addressed. This paper proposes a simple, yet viable and feasible, solution to deploy energy management systems on the end-user-side in order to enable not only energy forecasting but also a distributed discriminatory-price auction peer-to-peer energy transaction market. This work also analyses the impact of four energy forecasting models on energy transactions: a mathematical model, a support vector machine model, an eXtreme Gradient Boosting model, and a TabNet model. To test the proposed solution and models, the system was deployed in five small offices and three residential households, achieving a maximum energy costs reduction of 10.89% within the community, ranging from 0.24% to 57.43% for each individual agent. The results demonstrated the potential of peer-to-peer energy transactions to promote energy cost reductions and enable the validation of auction-based energy transactions and the use of energy forecasting models in today’s buildings and end-users.

Abstract

This paper presents an overview of the literature on privacy protection in smart meters with a particular focus on Homomorphic Encryption (HE). Firstly, we introduce the concept of smart meters, the context in which they are inserted, the main concerns, and oppositions inherent to their use. Later,}an overview of privacy protection is presented, emphasizing the need to safeguard the privacy of smart-meter users by identifying, describing, and comparing the main approaches that seek to address this problem. Then, two privacy protection approaches based on HE are presented in more detail and additionally we present two possible application scenarios. Finally, the paper concludes with a brief overview of the unsolved challenges in HE and the most promising future research directions.

Abstract

Smart meter data is a cornerstone for the realization of next-generation electrical power grids by enabling the creation of novel energy data-based services like providing recommendations on how to save energy or predictive maintenance of electric appliances. Most of these services are developed on top of advanced machine-learning algorithms, which rely heavily on datasets for training, testing, and validation purposes. A limitation of most existing datasets, however, is the scarcity of labels. The SustDataED2 dataset described in this paper contains 96 days of aggregated and individual appliance consumption from one household in Portugal. The current and voltage waveforms were sampled at 12.8 kHz, and the individual consumption of 18 appliances was sampled at 0.5 Hz. The dataset also contains the timestamps of the ON-OFF transitions of the monitored appliances for the entire deployment duration, providing the necessary ground truth for the evaluation of machine learning problems, particularly Non-Intrusive Load Monitoring. The data is accessible in easy-to-use audio and comma-separated formats.

Abstract

The increased penetration of  Renewable Energy Sources (RES) as part of a decentralized and distributed power system makes net-load forecasting a critical component in the planning and operation of power systems. However, compared to the transmission level, producing accurate short-term net-load forecasts at the distribution level is complex due to the small number of consumers. Moreover, owing to the stochastic nature of RES, it is necessary to quantify the uncertainty of the forecasted net-load at any given time, which is critical for the real-world decision process. This work presents parameterized deep quantile regression for short-term probabilistic net-load forecasting at the distribution level. To be precise, we use a Deep Neural Network (DNN) to learn both the quantile fractions and quantile values of the quantile function. Furthermore, we propose a scoring metric that reflects the trade-off between predictive uncertainty performance and forecast accuracy. We evaluate the proposed techniques on historical real-world data from a low-voltage distribution substation and further assess its robustness when applied in real-time. The experiment’s outcomes show that the resulting forecasts from our approach are well-calibrated and provide a desirable trade-off between forecasting accuracies and predictive uncertainty performance that are very robust even when applied in real-time.

Abstract

In today’s society, a current concern is to mitigate the risks of global climate change. Throughout the years there have been several initiatives to achieve more sustainable energy distribution in buildings. In this work, a new methodology is proposed for identifying appliance consumption patterns in buildings. It consists of, at first, conducting a seasonality analysis based on the Auto-Correlation Function for detecting the different appliance use patterns that arise in a given time window. Then, it is conducted a Probability Distribution Analysis based on the auto-correlation results and the calculation of an informative measure to select the prevailing consumption pattern. The methodology enables to distinguish between different use patterns for a given appliance for each building at specific time intervals, e.g., the seasons of the year. For the purpose of illustration, the methodology is applied to consumption data of four appliances selected from a domestic energy consumption dataset (REFIT) over one year. The results provide several insights on how a given appliance use evolves throughout the seasons for each household, and also highlighting use similarity for different appliances across the seasons. These results would be, otherwise, hidden away, and would require an individual analysis of consumption patterns of each appliance. Consequently, the methodology provides a consistent mechanism to identify different user profiles.

Abstract

This paper presents the development and evaluation of EnnerSpectrum, a platform for electricity monitoring. The development was motivated by a gap between academic, fully custom-made monitoring solutions and commercial proprietary monitoring approaches. EnnerSpectrum is composed of two main entities, the back end, and the Gateway. The back end is a server comprised of flexible entities that can be configured to different monitoring scenarios. The Gateway interacts with equipment at a site that cannot interact directly with the back end. The paper presents the architecture and configuration of EnnerSpectrum for a long-term case study with 13 prosumers of electricity for approximately 36 months. During this period, the proposed system was able to adapt to several building and monitoring conditions while acquiring 95% of all the available consumption data. To finalize, the paper presents a set of lessons learned from running such a long-term study in the real world.

Abstract

With the advent of IoT and low-cost sensing technologies, the availability of data has reached levels never imagined before by the research community. However, independently of its size, data is only as valuable as the ability to have access to it. This paper presents the FIKWater dataset, which contains time series data for hot and cold water demand collected from three restaurant kitchens in Portugal for consecutive periods between two and four weeks. The measurements were taken using ultrasonic flow meters, at a sampling frequency of 15Hz. Additionally, some details of the monitored spaces are also provided.

Abstract

In the era of big data and artificial intelligence, public datasets are becoming increasingly important for researchers to build and evaluate their models. This paper presents the FIKWaste dataset, which contains time series data for the volume of waste produced in three restaurant kitchens in Portugal. Glass, paper, plastic, and undifferentiated waste bins were monitored for consecutive periods of four weeks. In addition to the time-series measurements, the FIKWaste dataset contains labels for waste disposal events, i.e., when the waste bins are emptied, and technical and non-technical details of the monitored kitchens.

Abstract

The key advantage of smart meters over traditional metering devices is their ability to transfer consumption information to remote data processing systems. Besides enabling the automated collection of a customer’s electricity consumption for billing purposes, the data collected by these devices makes the realization of many novel use cases possible.
However, the large majority of such services are tailored to improve the power grid’s operation as a whole.
For example, forecasts of household energy consumption or photovoltaic production allow for improved power plant generation scheduling. Similarly, the detection of anomalous consumption patterns can indicate electricity theft and serve as a trigger for corresponding investigations. Even though customers can directly influence their electrical energy consumption, the range of use cases to the users’ benefit remains much smaller than those that benefit the grid in general.
In this work, we thus review the range of services tailored to the needs of end-customers. By briefly discussing their technological foundations and their potential impact on future developments, we highlight the great potentials of utilizing smart meter data from a user-centric perspective. Several open research challenges in this domain, arising from the shortcomings of state-of-the-art data communication and processing methods, are furthermore given. We expect their investigation to lead to significant advancements in data processing services and ultimately raise the customer experience of operating smart meters.

Abstract

This paper presents an economic assessment of introducing solar-powered residential battery energy storage in the Madeira Island electric grid, where only micro-production for self-consumption is currently allowed. The evaluation was conducted against six local micro-producers using one year of energy consumption and solar photovoltaic production measurements and two distinct storage control strategies. Several inverter sizes and storage capacities were considered based on the six micro-producers’ consumption and production profiles. The results were then analyzed concerning year-long simulations and a projection for the next ten years. To this end, several indicators were assessed, including self-consumption, profit per Euro invested, number of cycles, and storage degradation. The results obtained show that despite the benefits of storage to increase the self-consumption rates, considerable drops in the storage prices are still necessary to achieve profitability during these devices’ lifetime. Furthermore, our results also highlight a very interesting trade-off between self-consumption, pre-charge, and profitability, in a sense that higher levels of pre-charge increase the chances of reaching profitability even though this will imply considerable drops in the levels of self-consumption.

Abstract

The advance in energy-sensing and smart-meter technologies have motivated the use of a Non-Intrusive Load Monitoring (NILM), a data-driven technique that recognizes active end-use appliances by analyzing the data streams coming from these devices. NILM offers an electricity consumption pattern of individual loads at consumer premises, which is crucial in the design of energy efficiency and energy demand management strategies in buildings. Appliance classification, also known as load identification is an essential sub-task for identifying the type and status of an unknown load from appliance features extracted from the aggregate power signal. Most of the existing work for appliance recognition in NILM uses a single-label learning strategy which, assumes only one appliance is active at a time. This assumption ignores the fact that multiple devices can be active simultaneously and requires a perfect event detector to recognize the appliance. In this paper proposes the Convolutional Neural Network (CNN)-based multi-label learning approach, which links multiple loads to an observed aggregate current signal. Our approach applies the Fryze power theory to decompose the current features into active and non-active components and use the Euclidean distance similarity function to transform the decomposed current into an image-like representation which, is used as input to the CNN. Experimental results suggest that the proposed approach is sufficient for recognizing multiple appliances from aggregated measurements.

Resources

Online Repository

Abstract

Appliance recognition is one of the vital sub-tasks of NILM in which a machine learning classier is used to detect and recognize active appliances from power measurements. The performance of the appliance classifier highly depends on the signal features used to characterize the loads. Recently, different appliance features derived from the voltage–current (V–I) waveforms have been extensively used to describe appliances. However, the performance of V–I-based approaches is still unsatisfactory as it is still not distinctive enough to recognize devices that fall into the same category. Instead, we propose an appliance recognition method utilizing the recurrence graph (RG) technique and convolutional neural networks (CNNs). We introduce the weighted recurrent graph (WRG) generation that, given one-cycle current and voltage, produces an image-like representation with more values than the binary output created by RG. Experimental results on three different sub-metered datasets show that the proposed WRG-based image representation provides superior feature representation and, therefore, improves classification performance compared to V–I-based features.

Resources

Online Repository

Abstract

The work in this paper proposes the application of the pinball quantile loss function to guide a deep neural network for Non-Intrusive Load Monitoring. The proposed architecture leverages concepts such as Convolution Neural Networks and Recurrent Neural Networks. For evaluation purposes, this paper also presents a set of complementary performance metrics for energy estimation. Finally, this paper also reports on the results of a comprehensive benchmark between the proposed network and three alternative deep neural networks, when guided by the pinball and Mean Squared Error loss functions. The obtained results confirm the disaggregation superiority of the proposed system, while also showing that the performances obtained using the pinball loss function are consistently superior to the ones obtained using the Mean Squared Error loss.

Resources

Supplementary Material

Abstract

Abstract

This paper reports on the different engineering, social and financial challenges behind the building and deploying electric energy monitoring and eco-feedback technology in real-world scenarios, which despite being relevant to the research community are seldom reported in the literature. The objectives of this paper are two-fold: First, discuss the technical and social constraints of real-world deployments. This includes, for example, hardware and software requirements, and issues related to security and intrusiveness of the monitoring solutions. Second, identify and understand the costs associated with developing and deploying such systems. These include hardware costs and consumed energy. To this end, we rely on over five years of experience developing and improving a non-intrusive energy monitoring research platform to enable the deployment of long and short-term studies of eco-feedback technology. During this time, two versions of that platform were deployed in 50 homes for periods that lasted between 6 and 18 consecutive months. By iteratively developing and deploying our sensing and eco-feedback infrastructures, we managed to build upon previous findings and lessons learned to understand how to create, deploy, and maintain such systems. Concurrently, we gained insights regarding what are some of the most relevant costs associated with running such experiments.

Supplementary Material