Communications-Inspired Projection Design with Application to Compressive Sensing

We consider the recovery of an underlying signal x \in C^m based on projection measurements of the form y=Mx+w, where y \in C^l and w is measurement noise; we are interested in the case l < m. It is assumed that the signal model p(x) is known, and w CN(w;0,S_w), for known S_W. The objective is to design a projection matrix M \in C^(l x m) to maximize key information-theoretic quantities with operational significance, including the mutual information between the signal and the projections I(x;y) or the Renyi entropy of the projections h_a(y) (Shannon entropy is a special case). By capitalizing on explicit characterizations of the gradients of the information measures with respect to the projections matrix, where we also partially extend the well-known results of Palomar and Verdu from the mutual information to the Renyi entropy domain, we unveil the key operations carried out by the optimal projections designs: mode exposure and mode alignment. Experiments are considered for the case of compressive sensing (CS) applied to imagery. In this context, we provide a demonstration of the performance improvement possible through the application of the novel projection designs in relation to conventional ones, as well as justification for a fast online projections design method with which state-of-the-art adaptive CS signal recovery is achieved.Comment: 25 pages, 7 figures, parts of material published in IEEE ICASSP 2012, submitted to SIIM

Lingering Chukchi Sea sea ice and Chukchi Sea mean winds influence population age structure of euphausiids (krill) found in the bowhead whale feeding hotspot near Pt. Barrow, Alaska

© The Author(s), 2021. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Ashjian, C. J., Okkonen, S. R., Campbell, R. G., & Alatalo, P. Lingering Chukchi Sea sea ice and Chukchi Sea mean winds influence population age structure of euphausiids (krill) found in the bowhead whale feeding hotspot near Pt. Barrow, Alaska. Plos One, 16(7), (2021): e0254418, https://doi.org/10.1371/journal.pone.0254418.Interannual variability in euphausiid (krill) abundance and population structure and associations of those measures with environmental drivers were investigated in an 11-year study conducted in late August–early September 2005–2015 in offshelf waters (bottom depth > 40 m) in Barrow Canyon and the Beaufort Sea just downstream of Distributed Biological Observatory site 5 (DBO5) near Pt. Barrow, Alaska. Statistically-significant positive correlations were observed among krill population structure (proportion of juveniles and adults), the volume of Late Season Melt Water (LMW), and late-spring Chukchi Sea sea ice extent. High proportions of juvenile and adult krill were seen in years with larger volumes of LMW and greater spring sea ice extents (2006, 2009, 2012–2014) while the converse, high proportions of furcilia, were seen in years with smaller volumes of LMW and lower spring sea ice extent (2005, 2007, 2010, 2011, 2015). These different life stage, sea ice and water mass regimes represent integrated advective responses to mean fall and/or spring Chukchi Sea winds, driven by prevailing atmospheric pressure distributions in the two sets of years. In years with high proportions of juveniles and adults, late-spring and preceding-fall winds were weak and variable while in years with high proportions of furcilia, late-spring and preceding-fall winds were strong, easterly and consistent. The interaction of krill life history with yearly differences in the northward transports of krill and water masses along with sea ice retreat determines the population structure of late-summer krill populations in the DBO5 region near Pt. Barrow. Years with higher proportions of mature krill may provide larger prey to the Pt. Barrow area bowhead whale prey hotspot. The characteristics of prey near Pt. Barrow is dependent on krill abundance and size, large-scale environmental forcing, and interannual variability in recruitment success of krill in the Bering Sea.This research was supported by the National Science Foundation through grants PLR-1023331 (CJA), OPP-0436131 (CJA), PLR-1022139 (RGC), OPP-0436110 (RGC), PLR-1023446 (SRO), and OPP-043166 (SRO), the National Oceanic and Atmospheric Administration (NOAA) under cooperative agreement NA08OAR4320751 with the University of Alaska (SRO) and cooperative agreements NA17RJ1223 and NA09OAR4320129 with the Woods Hole Oceanographic Institution (CJA), the Bureau of Ocean Energy Management through Interagency Agreement 0106RU39923/M08PG20021 between the National Marine Fisheries Service and MMS/BOEM (CJA, RGC, SRO) and through the National Oceanographic Partnership Program award number N00014-08-1-0311 from the Office of Naval Research to the Woods Hole Oceanographic Institution (CJA, SRO, RGC). Additional support was provided by the Coastal Marine Institute at the University of Alaska (SRO, RGC) and the James M. and Ruth P. Clark Arctic Research Initiative Fund at the Woods Hole Oceanographic Institution (CJA). The participation of the K-12 teachers was supported by the National Science Foundation through the ARMADA program at the University of Rhode Island (2005, 2006) and through the POLARTrec program at the Arctic Research Consortium of the United States (2012)

Communications inspired linear discriminant analysis

We study the problem of supervised linear dimensionality reduction, taking an information-theoretic viewpoint. The linear projection matrix is designed by maximizing the mutual information between the projected signal and the class label. By harnessing a recent theoretical result on the gradient of mutual information, the above optimization problem can be solved directly using gradient descent, without requiring simplification of the objective function. Theoretical analysis and empirical comparison are made between the proposed method and two closely related methods, and comparisons are also made with a method in which Rényi entropy is used to define the mutual information (in this case the gradient may be computed simply, under a special parameter setting). Relative to these alternative approaches, the proposed method achieves promising results on real datasets. Copyright 2012 by the author(s)/owner(s)

Information-Theoretic Compressive Measurement Design

An information-theoretic projection design framework is proposed, of interest for feature design and compressive measurements. Both Gaussian and Poisson measurement models are considered. The gradient of a proposed information-theoretic metric (ITM) is derived, and a gradient-descent algorithm is applied in design; connections are made to the information bottleneck. The fundamental solution structure of such design is revealed in the case of a Gaussian measurement model and arbitrary input statistics. This new theoretical result reveals how ITM parameter settings impact the number of needed projection measurements, with this verified experimentally. The ITM achieves promising results on real data, for both signal recovery and classification

Working with simple machines

A set of examples is provided that illustrate the use of work as applied to simple machines. The ramp, pulley, lever and hydraulic press are common experiences in the life of a student and their theoretical analysis therefore makes the abstract concept of work more real. The mechanical advantage of each of these systems is also discussed so that students can evaluate their usefulness as machines.Comment: 9 pages, 4 figure

Reconstructing early Holocene seasonal bottom-water temperatures in the northern North Sea using stable oxygen isotope records of Arctica islandica shells

The knowledge of seasonal temperature variability in the ocean is essential for understanding climate and its response to forcing factors. Time intervals with highly dynamic climate and increased seasonal forcing such as the early Holocene are of particular interest. Yet, the temporal resolution of most existing climate records is not sufficient to reconstruct temperature seasonality. Here, we present the first seasonally resolved, early Holocene, bottom-water temperature record from the Viking Bank in the northern North Sea. The reconstruction is based on the stable oxygen isotope data (δ18Oshell) of two crossdated, radiocarbon-dated subfossil shells of Arctica islandica (Bivalvia). Oxygen isotope data were combined into a 21-year long record, dated at 9593–9573 (±55) cal yr BP The record indicates an early Holocene seasonal temperature amplitude up to ca. 4.5 °C. To estimate changes in the mean state and seasonality of temperature conditions between the present and early Holocene, the record and temperatures inferred thereof are compared with modern δ18Oshell profiles and instrumental temperature data. The results indicate that the seasonal amplitude of δ18Oshell signal in the subfossil shells reflects sea-level changes. The reconstruction suggests that the long-term average and seasonal variability of temperature were similar to modern times when considering changes in the relative sea level. Our data also confirm that δ18Oshell records are reproducible and track seasonal amplitude of bottom-water temperature variability, thus demonstrate the potential for application in reconstructions of past seasonality. Furthermore, our results show that δ18Oshell records can be used to reconstruct seasonal stratification dynamics. This novel application of sclerochronological data has the potential to be used to validate and constrain paleotidal models.publishedVersio

Immunization with syngeneic interferon-gamma (IFN-g) secreting tumour cells enhance the Therapeutic effect and Abscopal effect from combined treatment of subcutaneously implanted contra-lateral N29 tumours on Fischer rats with Pulsed electric fields (PEF) and 60Co-gamma radiation.

The aim of the present study is to study the Abscopal regression of subcutaneously implanted N29 rat glioma after immunization with syngeneic IFNg secreting cells and treatment of contra-lateral tumours with pulsed electric fields (PEF) and/or radiation therapy (RT). The study was performed on rats of the Fischer-344 strain with rat glioma N29 tumours implanted subcutaneously on the flank or on both the right treated hind leg and the left untreated hind leg. Once weekly for three weeks, the animals were given intra-peritoneal injections of irradiated, modified N29 tumour cells, secreting interferon-gamma (IFN-g). PEF was given with 16 exponentially decaying pulses at a maximum electric fields strength of 1400 V/cm and t1/e= 1 ms. RT was given with 60Co gamma radiation at daily fractions of 5 Gy, to a total absorbed dose of 20 Gy. The animals were arranged into controls and groups of various treatments: PEF, RT, PEF+RT and immunization (IFNg). Fitting the data obtained from consecutive measurements of tumour volume (TV) of each individual tumour to an exponential model TV = TV0*exp[TGR*t] estimated the tumours growth rate (TGR %per day) after the day of treatment (t = 0). TGR of the right-lateral treated tumour was significantly decreased for independent treatments with PEF and RT and with the combined treatment PEF+RT. With immunization (IFNg) alone and in combination with PEF there was, however, no significant decrease of the TGR of the right-lateral tumours. But in the combination of immunization with RT or PEF+RT there was a highly significant decrease of the TGR values. The Abscopal effect was evaluated by comparing the growth rate of the untreated contra lateral tumours with the treated tumours. TGR of the left-lateral untreated tumour in the groups with independent treatment of right-lateral tumours with PEF, was not significantly reduced. But the TGR values are significantly reduced in the group of rats treated with RT and the combination PEF + RT. With IFNg alone and in combinations with PEF or RT there was no significant decrease of the TGR in the left lateral tumours. But in the combination of IFNg with PEF+RT there was a highly significant decrease of the TGR values in the left lateral tumours. The specific therapeutic effect (STE = 1 - TGRExposed/ TGRCtrl ) after treatments with PEF was 0.30±0.01 and after RT 0.46±0.04 and after the combination PEF+RT 0.36+/- 0.08. After immunization with IFNg secreting tumour cells the STE 0.09+/- 0.07 is not significantly different from zero. Also for the combination of immunization and PEF the STE value of 0.07+/- 0.07 is not significantly different from zero. In the combination of immunization with RT the STE value was 0.32+/- 0.01 that is significantly different from zero and only slightly lower than for RT alone. The STE of the combination of immunization with (PEF+RT) resulted in an unexpectedly high STE value of 0.70+/- 0.08 that is highly significantly different from zero (p < 0.0001). The specific Abscopal effect (SAE = 1 - TGRUn-Exposed/ TGRCtrl ) of the contra lateral unexposed tumours in rats treated with PEF or RT are both significantly different from zero. For RT the average SAE value is 0.33+/- 0.04 and for PEF it is 0.11+/- 0.05. The SAE value for the combined treatment with PEF + RT is 0.26+/- 0.02 that is about the same as for RT alone. For immunization with IFNg secreting tumour cells only and IFNg +PEF the SAE values were not significantly different from zero. But IFNg combined with RT result in a SAE value of 0.18±0.12 and the combination of IFNg with PEF+RT results in an improved abscopal effect with the SAE value of 0.33+/- 0.06. After combined treatment with PEF + RT the average of the therapeutic enhancement ratio (TER = STEExperimental / STEIndependent) is 0.47 +/- 0.12 and the abscopal enhancement ratio (AER = SAEExperimental / SAEIndependent) is 0.61 +/- 0.1 respectively. With all three treatment modalities combined IFNg + PEF + RT and all combinations of independent treatments with PEF, RT or IFNg are considered, the average of the TER is 1.20+/- 0.15 and AER is 1.22+/- 0.20. This might indicate that there is a synergism on the tumours on both sides by combining PEF, RT and immunization with IFNg secreting cells. These results were first presented Nov 21-24, 2002, as Poster at Society of Neuro-Oncology (SNO) Annual Meeting, San Diego, USA (Persson et al 2002)

Assessing algal biomass and bio-optical distributions in perennially ice-covered polar ocean ecosystems

AbstractUnder-ice observations of algal biomass and seasonality are critical for understanding better how climate-driven changes affect polar ocean ecosystems. However, seasonal and interannual variability in algal biomass has been studied sparsely in perennially ice-covered polar ocean regions. To address this gap in polar ocean observing, bio-optical sensors for measuring chlorophyll fluorescence, optical scattering, dissolved organic matter fluorescence, and incident solar radiation were integrated into Ice-Tethered Profilers (ITPs). Eight such systems have been deployed in the Arctic Ocean, with five profilers completing their deployments to date including two that observed an entire annual cycle in the central Arctic Ocean and Beaufort Sea respectively. These time series revealed basic seasonal differences in the vertical distributions of algal biomass and related bio-optical properties in these two regions of the Arctic Ocean. Because they conduct profiles on daily or sub-daily scales, ITP bio-optical data allow more accurate assessments of the timing of changes in under-ice algal biomass such as the onset of the growing season in the water column, the subsequent export of particulate organic matter at the end, and the frequency of intermittent perturbations, which in the central Arctic Ocean were observed to have time scales of between one and two weeks