Microscaling Data Formats for Deep Learning

Narrow bit-width data formats are key to reducing the computational and storage costs of modern deep learning applications. This paper evaluates Microscaling (MX) data formats that combine a per-block scaling factor with narrow floating-point and integer types for individual elements. MX formats balance the competing needs of hardware efficiency, model accuracy, and user friction. Empirical results on over two dozen benchmarks demonstrate practicality of MX data formats as a drop-in replacement for baseline FP32 for AI inference and training with low user friction. We also show the first instance of training generative language models at sub-8-bit weights, activations, and gradients with minimal accuracy loss and no modifications to the training recipe

The Life and Work of Ludwig Lewisohn

An imposing literary figure in America and Europe during the first half of the twentieth century, Ludwig Lewisohn (1882-1955) struggled with feelings of alienation in Christian America that were gradually resolved by his developing Jewish identity, a process reflected in hundreds of works of fiction, literary analysis, and social criticism. Born in Berlin, Lewisohn moved with his family in 1890 to South Carolina. Identified by others as a Jew, he remained an outsider throughout his youth. Lewisohn became a notable scholar and translator of German and French literature, teaching at Wisconsin and Ohio State. Following his mother's death in 1914, he began to explore the Jewish life he had rejected, and by 1920 became a Zionist committed to fighting assimilation. Accusatory and inflammatory, his memoir Up Stream (1922) struck at the very heart of American culture and society, and caused great controversy and lasting enmity. As strong emotional influences, the women in Lewisohn's life-his mother and four wives-helped to frame his life and work. Believing himself liberated by the woman he declared his "spiritual wife" while legally married to another, he proclaimed the artist's right to freedom in The Creative Life (1924), abandoned his editorship at The Nation, and fled to Europe. Lewisohn's fictionalized account of his failed marriage, The Case of Mr. Crump (1926), once again attacked the empty morality of this world and won Sigmund Freud's praise as the greatest psychological novel of the century. A creator of one of Paris's leading salons, Lewisohn ended his leisurely writer's life in 1934 to awaken America to the growing Nazi threat. Poised to face the unfinished marital battle at home, but anxious to engage in the coming struggle for Jewish survival and the future of Western civilization, he set sail, unsure of what lay ahead

Life and Work of Ludwig Lewisohn, Volume II

An imposing literary figure in America and Europe during the first half of the twentieth century, Ludwig Lewisohn (1882-1955) struggled with feelings of alienation in Christian America that were gradually resolved by his developing Jewish identity, a process reflected in hundreds of works of fiction, literary analysis, and social criticism. This second volume portrays Lewisohn's last decades as an outspoken opponent of Nazi Germany, a leading promoter of Jewish resettlement in Palestine, a member of Brandeis University's first faculty, and one of the earliest voices advocating Jewish renewal in America. Despite his activism, Lewisohn was no longer welcome in Zionist circles by 1948 as a result of his "unacceptable" opinions concerning British intransigence, organizational politics, and, particularly, Jewish cultural and religious decline. However, the invitation to join the newly established Brandeis University as its only full professor provided him with the opportunity he sought to contribute to the reshaping of American Jewry. Lewisohn's efforts would later bear fruit in the Jewish renewal movement of the next generation