104 research outputs found

    Cartesian differential categories revisited

    Full text link
    We revisit the definition of Cartesian differential categories, showing that a slightly more general version is useful for a number of reasons. As one application, we show that these general differential categories are comonadic over Cartesian categories, so that every Cartesian category has an associated cofree differential category. We also work out the corresponding results when the categories involved have restriction structure, and show that these categories are closed under splitting restriction idempotents.Comment: 17 page

    A unified framework for generalized multicategories

    Full text link
    Notions of generalized multicategory have been defined in numerous contexts throughout the literature, and include such diverse examples as symmetric multicategories, globular operads, Lawvere theories, and topological spaces. In each case, generalized multicategories are defined as the "lax algebras" or "Kleisli monoids" relative to a "monad" on a bicategory. However, the meanings of these words differ from author to author, as do the specific bicategories considered. We propose a unified framework: by working with monads on double categories and related structures (rather than bicategories), one can define generalized multicategories in a way that unifies all previous examples, while at the same time simplifying and clarifying much of the theory.Comment: 76 pages; final version, to appear in TA

    Reverse tangent categories

    Full text link
    Previous work has shown that reverse differential categories give an abstract setting for gradient-based learning of functions between Euclidean spaces. However, reverse differential categories are not suited to handle gradient-based learning for functions between more general spaces such as smooth manifolds. In this paper we propose a setting to handle this, which we call reverse tangent categories: tangent categories with an involution operation for their differential bundles

    Reverse Derivative Categories

    Get PDF
    The reverse derivative is a fundamental operation in machine learning and automatic differentiation. This paper gives a direct axiomatization of a category with a reverse derivative operation, in a similar style to that given by Cartesian differential categories for a forward derivative. Intriguingly, a category with a reverse derivative also has a forward derivative, but the converse is not true. In fact, we show explicitly what a forward derivative is missing: a reverse derivative is equivalent to a forward derivative with a dagger structure on its subcategory of linear maps. Furthermore, we show that these linear maps form an additively enriched category with dagger biproducts.Comment: Extended version of paper to appear at CSL 202
    • …
    corecore