Functional Optimisation of Online Algorithms in Multilayer Neural Networks

We study the online dynamics of learning in fully connected soft committee machines in the student-teacher scenario. The locally optimal modulation function, which determines the learning algorithm, is obtained from a variational argument in such a manner as to maximise the average generalisation error decay per example. Simulations results for the resulting algorithm are presented for a few cases. The symmetric phase plateaux are found to be vastly reduced in comparison to those found when online backpropagation algorithms are used. A discussion of the implementation of these ideas as practical algorithms is given

Field research on the spectral properties of crops and soils, volume 1

The experiment design, data acquisition and preprocessing, data base management, analysis results and development of instrumentation for the AgRISTARS Supporting Research Project, Field Research task are described. Results of several investigations on the spectral reflectance of corn and soybean canopies as influenced by cultural practices, development stage and nitrogen nutrition are reported as well as results of analyses of the spectral properties of crop canopies as a function of canopy geometry, row orientation, sensor view angle and solar illumination angle are presented. The objectives, experiment designs and data acquired in 1980 for field research experiments are described. The development and performance characteristics of a prototype multiband radiometer, data logger, and aerial tower for field research are discussed

Vegetation and soils field research data base: Experiment summaries

Understanding of the relationships between the optical, spectral characteristics and important biological-physical parameters of earth-surface features can best be obtained by carefully controlled studies over fields and plots where complete data describing the condition of targets are attainable and where frequent, timely spectral measurement can be obtained. Development of a vegetation and soils field research data base was initiated in 1972 at Purdue University's Laboratory for Applications of Remote Sensing and expanded in the fall of 1974 by NASA as part of LACIE. Since then, over 250,000 truck-mounted and helicopter-borne spectrometer/multiband radiometer observations have been obtained of more than 50 soil series and 20 species of crops, grasses, and trees. These data are supplemented by an extensive set of biophysical and meteorological data acquired during each mission. The field research data form one of the most complete and best-documented data sets acquired for agricultural remote sensing research. Thus, they are well-suited to serve as a data base for research to: (1) quantiatively determine the relationships of spectral and biophysical characteristics of vegetation, (2) define future sensor systems, and (3) develop advanced data analysis techniques

Atlas of soil reflectance properties

A compendium of soil spectral reflectance curves together with soil test results and site information is presented in an abbreviated manner listing those soil properties most important in influencing soil reflectance. Results are presented for 251 soils from 39 states and Brazil. A narrative key describes relationships between soil parameters and reflectance curves. All soils are classified according to the U.S. soil taxonomy and soil series name for ease of identification

Prototype-based analysis of GAMA galaxy catalogue data

We present a prototype-based machine learning analysis of labeled galaxy catalogue data containing parameters from the Galaxy and Mass Assembly (GAMA) survey. Using both an unsupervised and supervised method, the Self-Organizing Map and Generalized Relevance Matrix Learning Vec- tor Quantization, we find that the data does not fully support the popular visual-inspection-based galaxy classification scheme employed to categorize the galaxies. In particular, only one class, the Little Blue Spheroids, is consistently separable from the other classes. In a proof-of-concept experiment, we present the galaxy parameters that are most discriminative for this class

Linear polarization of light by two wheat canopies measured at many view angles

The linear polarization and reflection of visible light by wheat as a function of sun-view directions, crop development stage, and wavelength were examined. Two-hundred spectra were taken continuously in wave-lengths from 0.45 to 0.72 Micron in 33 view directions using an Exotech model 20C spectroradiometer six meters above two wheat canopies in the boot and fully headed maturity stages. The analysis results show that the amount of linearly polarized light from the wheat canopies is greatest in the blue spectral region and decreases gradually with increasing wavelength. The results also show that the linearly polarized light from the canopies is generally greatest in the azimuth direction of the Sun and tends toward zero as the view direction tends toward the direction of the hot spot or anti-solar point. It is demonstrated that the single, angle of incidence of sunlight on the leaf, explains almost all of the variation of the amount of polarized light with Sun-view direction

Simulated response of a multispectral scanner over wheat as a function of wavelength and view/illumination direction

The reflectance response with view angle of wheat, was analyzed. The analyses, which assumes there are no atmospheric effects, and otherwise simulates the response of a multispectral scanner, is based upon spectra taken continuously in wavelength from 0.45 to 2.4 micrometers at more than 1200 view/illumination directions using an Exotech model 20C spectra radiometer. Data were acquired six meters above four wheat canopies, each at a different growth stage. The analysis shows that the canopy reflective response is a pronounced function of illumination angle, scanner view angle and wavelength. The variation is greater at low solar elevations compared to high solar elevations

Large Area Crop Inventory Experiment (LACIE). Crop spectra from LACIE field measurements

There are no author-identified significant results in this report

Phase transitions in optimal unsupervised learning

We determine the optimal performance of learning the orientation of the symmetry axis of a set of P = alpha N points that are uniformly distributed in all the directions but one on the N-dimensional sphere. The components along the symmetry breaking direction, of unitary vector B, are sampled from a mixture of two gaussians of variable separation and width. The typical optimal performance is measured through the overlap Ropt=B.J* where J* is the optimal guess of the symmetry breaking direction. Within this general scenario, the learning curves Ropt(alpha) may present first order transitions if the clusters are narrow enough. Close to these transitions, high performance states can be obtained through the minimization of the corresponding optimal potential, although these solutions are metastable, and therefore not learnable, within the usual bayesian scenario.Comment: 9 pages, 8 figures, submitted to PRE, This new version of the paper contains one new section, Bayesian versus optimal solutions, where we explain in detail the results supporting our claim that bayesian learning may not be optimal. Figures 4 of the first submission was difficult to understand. We replaced it by two new figures (Figs. 4 and 5 in this new version) containing more detail