Learning Output Kernels for Multi-Task Problems

Simultaneously solving multiple related learning tasks is beneficial under a variety of circumstances, but the prior knowledge necessary to correctly model task relationships is rarely available in practice. In this paper, we develop a novel kernel-based multi-task learning technique that automatically reveals structural inter-task relationships. Building over the framework of output kernel learning (OKL), we introduce a method that jointly learns multiple functions and a low-rank multi-task kernel by solving a non-convex regularization problem. Optimization is carried out via a block coordinate descent strategy, where each subproblem is solved using suitable conjugate gradient (CG) type iterative methods for linear operator equations. The effectiveness of the proposed approach is demonstrated on pharmacological and collaborative filtering data

Dissipative stability theory for linear repetitive processes with application in iterative learning control

This paper develops a new set of necessary and sufficient conditions for the stability of linear repetitive processes, based on a dissipative setting for analysis. These conditions reduce the problem of determining whether a linear repetitive process is stable or not to that of checking for the existence of a solution to a set of linear matrix inequalities (LMIs). Testing the resulting conditions only requires compu- tations with matrices whose entries are constant in comparison to alternatives where frequency response computations are required

On the Control of Distributed Parameter Systems using a Multidimensional Systems Setting

The unique characteristic of a repetitive process is a series of sweeps, termed passes, through a set of dynamics defined over a finite duration with resetting before the start of the each new one. On each pass an output, termed the pass profile is produced which acts as a forcing function on, and hence contributes to, the dynamics of the next pass profile. This leads to the possibility that the output, i.e. the sequence of pass profiles, will contain oscillations which increase in amplitude in the pass-to-pass direction. Such behavior cannot be controlled by standard linear systems approach and instead they must be treated as a multidimensional system, i.e. information propagation in more than one independent direction. Physical examples of such processes include long-wall coal cutting and metal rolling. In this paper, stability analysis and control systems design algorithms are developed for a model where a plane, or rectangle, of information is propagated in the passto- pass direction. The possible use of these in the control of distributed parameter systems is then described using a fourthorder wavefront equation

Accelerated Consensus via Min-Sum Splitting

We apply the Min-Sum message-passing protocol to solve the consensus problem in distributed optimization. We show that while the ordinary Min-Sum algorithm does not converge, a modified version of it known as Splitting yields convergence to the problem solution. We prove that a proper choice of the tuning parameters allows Min-Sum Splitting to yield subdiffusive accelerated convergence rates, matching the rates obtained by shift-register methods. The acceleration scheme embodied by Min-Sum Splitting for the consensus problem bears similarities with lifted Markov chains techniques and with multi-step first order methods in convex optimization