Hybrid approximate message passing

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical inference problems. This paper presents a systematic framework for incorporating such approximate message passing (AMP) methods in general graphical models. The key concept is a partition of dependencies of a general graphical model into strong and weak edges, with the weak edges representing interactions through aggregates of small, linearizable couplings of variables. AMP approximations based on the Central Limit Theorem can be readily applied to aggregates of many weak edges and integrated with standard message passing updates on the strong edges. The resulting algorithm, which we call hybrid generalized approximate message passing (HyGAMP), can yield significantly simpler implementations of sum-product and max-sum loopy belief propagation. By varying the partition of strong and weak edges, a performance--complexity trade-off can be achieved. Group sparsity and multinomial logistic regression problems are studied as examples of the proposed methodology.The work of S. Rangan was supported in part by the National Science Foundation under Grants 1116589, 1302336, and 1547332, and in part by the industrial affiliates of NYU WIRELESS. The work of A. K. Fletcher was supported in part by the National Science Foundation under Grants 1254204 and 1738286 and in part by the Office of Naval Research under Grant N00014-15-1-2677. The work of V. K. Goyal was supported in part by the National Science Foundation under Grant 1422034. The work of E. Byrne and P. Schniter was supported in part by the National Science Foundation under Grant CCF-1527162. (1116589 - National Science Foundation; 1302336 - National Science Foundation; 1547332 - National Science Foundation; 1254204 - National Science Foundation; 1738286 - National Science Foundation; 1422034 - National Science Foundation; CCF-1527162 - National Science Foundation; NYU WIRELESS; N00014-15-1-2677 - Office of Naval Research

Atomic Resonance and Scattering

Contains reports on six research projects.National Science Foundation (Grant PHY 83-06273)U.S. Navy - Office of Naval Research (Contract N00014-79-C-0183)Joint Services Electronics Program (Contract DAALO03-86-K-0002)National Science Foundation (Grant PHY 84-11483)National Science Foundation (Grant PHY 86-05893)National Science Foundation (Grant ECS 84-21392)U.S. Navy - Office of Naval Research (Contract N00014-83-K-0695)National Science Foundation (Grant CHE 84-21392

Optics and Quantum Electronics

Contains reports on ten research projects.Joint Services Electronics Program (Contract DAALO3-86-K-0002)National Science Foundation (Grant ECS 83-05448)National Science Foundation (Grant ECS 83-10718)National Science Foundation (Grant ECS 82-11650)National Science Foundation (Grant ECS 84-13178)National Science Foundation (Grant ECS 85-52701)US Air Force - Office of Scientific Research (Contract AFOSR-85-0213)National Institutes of Health (Contract 5-RO1-GM35459)U.S. Navy - Office of Naval Research (Contract N00014-86-K-0117

Atomic Resonance and Scattering

Contains reports on six research projects.National Science Foundation (PHY83-06273)Joint Services Electronics Program (DAAL03-86-K-0002)National Science Foundation (PHY84-11483)U.S. Navy-Office of Naval Research (Grant N00014-79-C-0183)Joint Services Electronics Program (Contract DAAG29-83-K-0003)National Science Foundation (Grant PHY83-07172-A01)U.S. Navy - Office of Naval Research (Grant N00014-83-K-0695)National Science Foundation (Grant CHE84-21392

New Source of Natural Fertilizer Discovered in Oceans

New findings suggest that the deep ocean is teeming with organisms that produce essential natural fertilizers. A National Science Foundation (NSF)-funded research team led by Jonathan Zehr, a marine scientist at the University of California, Santa Cruz, has discovered a previously unknown type of photosynthetic bacteria that fixes nitrogen, converting nitrogen from the atmosphere into a form other organisms can use

Optical Propagation and Communication

Contains research summary and reports on four research projects.National Science Foundation (Grant ECS81-20637)National Science Foundation (Grant ECS85-09143)Maryland Procurement Office (Contract MDA904-84-C-6037)National Science Foundation (Grant ECS84-15580)U.S. Army Research Office - Durham (Contract DAAG29-84-K-0095)U.S. Navy - Office of Naval Research (Contract NO0014-80-C-0941

View-Invariant Object Category Learning, Recognition, and Search: How Spatial and Object Attention Are Coordinated Using Surface-Based Attentional Shrouds

Air Force Office of Scientific Research (F49620-01-1-0397); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624

CNS Technology Website Administrative Guide (Version 1.0)

Air Force Office of Scientific Research (F49620-01-1-0397); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624)

Submicron Structures Technology and Research

Contains reports on ten research projects.Joint Services Electronics Program (Contract DAAG29-83-K-0003)Joint Services Electronics Program (Contract DAAL03-86-K-0002)National Science Foundation (Grant ECS82-05701)National Science Foundation (Grant ECS85-06565)Lawrence Livermore Laboratory (Subcontract 2069209)National Science Foundation (Grant ECS85-03443)U.S. Air Force - Office of Scientific Research (Grant AFOSR-85-0154)National Aeronautics and Space Administration (Grant NGL22-009-638)National Science Foundation (through KMS Fusion, Inc.)U.S. Navy - Office of Naval Research (Contract N00014-79-C-0908

Adaptive Resonance Theory

Air Force Office of Scientific Research (F49620-92-J-0225); National Science Foundation (IRI-90-00530); Office of Naval Research (N00014-91-J-4100