Elsevier

Atmospheric Environment

Volume 32, Issues 14–15, 1 August 1998, Pages 2627-2636
Atmospheric Environment

Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences

https://doi.org/10.1016/S1352-2310(97)00447-0Get rights and content

Abstract

Artificial neural networks are appearing as useful alternatives to traditional statistical modelling techniques in many scientific disciplines. This paper presents a general introduction and discussion of recent applications of the multilayer perceptron, one type of artificial neural network, in the atmospheric sciences.

Introduction

Neural networks, or more precisely artificial neural networks, are a branch of artificial intelligence. Multilayer perceptrons form one type of neural network as illustrated in the taxonomy in Fig. 1. This article only considers the multilayer perceptron since a growing number of articles are appearing in the atmospheric literature that cite its use. Many of these papers describe the benefits that neural networks offer when compared to more traditional statistical modelling techniques. Most of the papers briefly describe the workings of neural networks and provide references, to books and papers, from which the reader may obtain further information. This review is aimed at readers with little or no understanding of neural networks and is designed to act as a guide through the literature so that they may better appreciate this tool.

This review is divided into several sections, beginning with a brief introduction to the multilayer perceptron followed by a description of the most basic algorithm for training a multilayer perceptron, known as backpropagation. A review of some of the recent applications of the multilayer perceptron to atmospheric problems will be presented followed by a discussion of some of the common practical problems and limitations associated with a neural network approach.

Section snippets

The multi-layer perceptron: a brief introduction

Environmental modelling involves using a variety of approaches, possibly in combination. Choosing the most suitable approach depends on the complexity of the problem being addressed and the degree to which the problem is understood. Assuming adequate data and computing resources and if a strong theoretical understanding of the problem is available then a full numerical model is perhaps the most desirable solution. However, in general, as the complexity of a problem increases the theoretical

Training a multilayer perceptron—the back-propagation algorithm

Training a multilayer perceptron is the procedure by which the values for the individual weights are determined such that the relationship the network is modelling is accurately resolved. At this point we will consider a simple multilayer perceptron that contains only two weights. For any combination of weights the network error for a given pattern can be defined. By varying the weights through all possible values, and by plotting the errors in three-dimensional space, we end up with a plot

Multilayer perceptron applications in general

The multilayer perceptron has been applied to a wide variety of tasks, all of which can be categorised as either prediction, function approximation, or pattern classification. Prediction involves the forecasting of future trends in a time series of data given current and previous conditions. Function approximation is concerned with modelling the relationship between variables. Pattern classification involves classifying data into discrete classes. All of these applications are closely related

Multilayer perceptron applications in the atmospheric sciences

There is no space to discuss in detail all atmospheric science applications of the multilayer perceptron. Instead a brief overview of applications from prediction, function approximation and pattern classification will be presented. It is hoped that these papers illustrate the main principles of applying the multilayer perceptron to real-world atmospheric problems. Other papers will be mentioned for reference purposes.

Limits, problems and solutions—back-propagation and the multilayer perceptron in practice

The benefits of using multilayer perceptrons have been illustrated. One of the reasons often cited for not using multilayer perceptrons in practice, and artificial neural networks in general, is that they are difficult to implement and interpret. Although this is true to a certain degree, there is an abundance of useful information available that can assist in the process, enabling common pitfalls to be avoided. Commercially available software will often provide built in solutions to protect

Conclusion

The multilayer perceptron has been shown to be a useful tool for prediction, function approximation and classification. The practical benefits of a modelling system that can accurately reproduce any measurable relationship is huge. The benefits of the multilayer perceptron approach are particularly apparent in applications where a full theoretical model cannot be constructed, and especially when dealing with non-linear systems. The numerous difficulties in implementing, training and

Acknowledgements

We are grateful to Gavin Cawley, School of Information Systems, University of East Anglia and the anonymous reviewers for their helpful comments, and also to the School of Environmental Sciences, University of East Anglia, for supporting this work.

References (53)

  • J.A Benediktsson et al.

    Neural network approaches versus statistical methods in classification of multisource remote sensing data

    IEEE Transactions on Geoscience and Remote Sensing

    (1990)
  • J Benton et al.

    Results from the UN/ECE ICP-crops indicate the extent of exceedance of the critical levels of ozone in Europe

    Water, Air and Soil Pollution

    (1995)
  • C.M Bishop
  • L Breiman et al.
  • C.T Butler et al.

    Retrieving atmospheric temperature parameters from DMSP SSM/T-1 data with a neural network

    Journal of Geophysical Research

    (1996)
  • G.C Cawley et al.

    Reproducing a subjective classification scheme for atmospheric circulation patterns over the United Kingdom using a neural network

  • K.S Chen et al.

    Land-cover classification of multispectral imagery using a dynamic learning neural network

    Photogrammetric Engineering and Remote Sensing

    (1995)
  • J.H Churnside et al.

    Temperature profiling with neural network inversion of microwave radiometer data

    Journal of Atmospheric and Oceanic Technology

    (1994)
  • E.E Clothiaux et al.

    A first-guess feature-based algorithm for estimating wind speed in clear-air doppler radar spectra

    Journal of Atmospheric and Oceanic Technology

    (1994)
  • A.C Comrie

    Comparing neural networks and regression models for ozone forecasting

    Journal of Air and Waste Management

    (1997)
  • G.M Foody

    Land cover classification by an artificial neural network with ancillary information

    International Journal of Geographical Information Systems

    (1995)
  • G.M Foody

    Approaches for the production and evaluation of fuzzy land cover classifications from remotely sensed data

    International Journal of Remote Sensing

    (1996)
  • G.M Foody et al.

    Classification of remotely sensed data by an artificial neural networkissues related to training data characteristics

    Photogrammetric Engineering and Remote Sensing

    (1995)
  • M.W Gardner et al.

    Neural network modelling of the influence of local meteorology on surface ozone concentrations

  • G.D Garson

    Interpreting neural network connection weights

    Artificial Intelligence Expert

    (1991)
  • J.C Gibb

    Back propagation family album

    (1996)
  • Cited by (0)

    View full text