11 research outputs found
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- :
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- De Toni Francesco
- De Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont Gérard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury María
- HajiHosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- Ilić Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner Zdeněk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski Germán
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix Rémi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- López Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- McKenna Michael
- McMillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirkin Shachar
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñán Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo González
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- Pàmies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot Benoît
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Suarez Pedro Ortiz
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- Sänger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- Taşar Davut Emre
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- Von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Workshop BigScience
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Šaško Mario
- Publication venue
- Publication date
- 10/12/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks
based on a few demonstrations or natural language instructions. While these
capabilities have led to widespread adoption, most LLMs are developed by
resource-rich organizations and are frequently kept from the public. As a step
towards democratizing this powerful technology, we present BLOOM, a
176B-parameter open-access language model designed and built thanks to a
collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer
language model that was trained on the ROOTS corpus, a dataset comprising
hundreds of sources in 46 natural and 13 programming languages (59 in total).
We find that BLOOM achieves competitive performance on a wide variety of
benchmarks, with stronger results after undergoing multitask prompted
finetuning. To facilitate future research and applications using LLMs, we
publicly release our models and code under the Responsible AI License
Management of Innovation in Micro, Small and Medium Enterprises in the Middle East and North Africa (MENA)
- Author
- &
- A B�hmer
- A Djeflat
- A Frenkel
- A Mansour
- A Mansour
- Afii-Anima
- Al Khouri
- B A Bouazza
- B Oyeyinka
- B Verspagen
- Byat
- D Kirby
- D Teece
- Daniele Schilir�
- E Abrahamson
- E Abrahamson
- E E Kossek
- E Elmansori
- Eschborn
- G Anderson
- H Chesbrough
- H De-Groot
- H E Aldrich
- H El-Sokari
- H Forsman
- H Ratiba
- Ifc
- Infodev
- J Morrison
- J Schumpeter
- J Tan
- Jwt
- K Al-Yahya
- L Stevenson
- M Orhan
- Nomita Sharma
- Oecd
- Oecd
- P Braunerhjelm
- P Drucker
- P Valentina
- P W Zgheib
- Paul Collier
- Pearce Nasr
- Q Saleem
- S Chaudhuri
- S Kawar
- Sme Dubai
- T Hinh
- T Hinh
- W Baumol
- Z Khoury
- Publication venue
- 'Elsevier BV'
- Publication date
- 01/01/2017
- Field of study
Cartwright on Capacities and Sen on Capabilities and the Firm
- Author
- Affirms Severine Deneulin
- Amartya Sen
- Andrea Falcon
- Aristotle
- Bradley W Bateman
- Bruce J Caldwell
- Carl Hempel
- Carl Hempel
- Categories
- Charles H Kahn
- Daniel Kahneman
- David A Crocker
- De Anima
- Edward Craig
- G Anscombe
- H G Lydell
- Henri Poincar�
- Hermann Bonitz
- J L Ackrill
- Jaakko Hintikka
- Jaakko Hintikka
- James Foster
- John B Davis
- John B Davis
- Jonathan Barnes
- Le Blond
- Martha C Nussbaum
- Menno
- Nancy Cartwright
- R J Hankinson
- R P Hardie
- R Skidelsky
- Ricardo F Crespo
- Ricardo F. Crespo
- Richard Sorabji
- Roger Frantz
- Stephan K�rner
- S�verine Deneulin
- Terence Irwin
- Uskali M�ki
- W K C Guthrie
- Wesley Salmon
- Publication venue
- 'Elsevier BV'
- Publication date
- 01/01/2008
- Field of study
II. Die Besonderheit193 des „Ganzen“. Jesus Christus – der Weg zum Leben
- Author
- An den Leser
- Art
- Bengel
- Bengel Tübingen
- Beweglichkeit
- Böhme
- Cassirer
- Castell
- Castell
- Castell
- Daher
- De Anima S.
- Dem Adjektiv „gemein
- Dem Adjektiv „gemein
- Dem Adjektiv „gemein
- dem Leben Bewegung Bewegung
- den Inspirierten
- Deo
- der Physic
- der Zweck
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders
- Ders Herrenberger Predigten I
- Ders Hl.
- Ders S.
- Ders S.
- Ders S.
- Ders S.
- Ders S.
- Ders S.
- Dieser „ewige Vorsatz
- Dinge
- Ebd S.
- Ebd S.
- Ebd S.
- Endelechiam
- Essentien
- Feststellung
- Gegen Manichäismus
- Georgulis Art
- Harttmann Murrhardt
- Harttmann Murrhardt
- Harttmenn Murrhardt
- Hebr
- Häußermann Theologia
- In
- In Oetinger
- In Oetinger
- Jacob Böhmes „drei Prinzipien
- Leben
- Leben der Dinge Hippocrates
- Magdalena Sybilla Rieger
- Materie
- Monadologie Zedier
- Nichts
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger
- Oetinger Aufmunternde
- Oetinger Duisburg
- Oetinger Etwas
- Oetinger Genealogie
- Oetinger Genealogie
- Oetinger Güldene
- Oetinger Leser
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger S.
- Oetinger Swedenborgs
- Oetinger Swedenborgs
- Oetinger Weinsberger
- Oetinger öfter
- Piepmeier Aporien
- Prinzipien
- Quellen der Selbstbewegung
- Ratschow Art
- Registres
- Theodicee
- Theologie der Elektrizität S.
- Vgl
- Vgl
- Vgl Oetinger
- Wesen
- Wesensaussage
- Zinn Theologie
- zu Recht
- zu Recht
- Zur Sefirotlehre Oetingers
- öchste Eigenschaft
- ührte Schlangen-Wesen
- „allgemeinen Wahrheitsgefühl
- „erbärmliches Wehklagen
- „sogenannte Unsterblichkeit
- Publication venue
- 'Vandenhoeck & Ruprecht GmbH & Co, KG'
- Publication date
- Field of study
Madame Guyon, Pietismus und deutschsprachige Literatur
- Author
- A R T H U R SCHOPENHAUER M
- Anima Gängelband
- Anm Spiritualite
- ANTOINE
- Außerlesene GERHARD TERSTEEGEN
- B.
- Band
- Beste Informationszusammenstellung
- Bibl Diese
- Bodmeriana Bibliotheca
- Catalogue
- Catalogue
- Der
- der Reclam-Ausgabe Ich
- Die
- Die
- Die Verserläuterung
- Druckorts
- E H R E G O T T DANIEL C O L B E R
- ECKHARDT
- G. T.St.
- Geistreiche Christliche
- GERHARD
- GERMAINE DE
- Geschichte des Pietismus B. ALBRECHT RITSCHL
- HEINZ LIEBING
- Hierzu
- J O H A N N CHRISTIAN
- JEAN
- JEAN
- Jeanne Die Separatausgaben
- JOHANN FRIEDRICH
- JOHANN JOACHIM
- K
- Knappe
- KURT
- le Frauen In
- Leben der Madame Für
- M A R S A Y
- Marsays Autobiographie Bericht
- Materien Discourse über
- MIGUEL DE
- Moritz TELBECK
- P
- Physiognomische Fragmente JOHANN CASPAR LAVATER
- Poiret Pierre
- Rezeptionsgeschichte der Madame Für Tersteegens
- RUTH
- Römer« Erklärung
- S
- Schrift Altes Die Heilige
- Staatsbibl Bayerische
- Staatsbibliothek Bayerische
- Ströme Geistliche
- TERSTEEGEN
- Timotheus Die
- V
- von Madame Christliche Unterweisung
- Vorschule der Ästhetik JEAN PAUL
- Publication venue
- 'Vandenhoeck & Ruprecht GmbH & Co, KG'
- Publication date
- Field of study
Conceptualisation: Interactions between Language, Mind, and World. An Introduction to Theory and History of Concepts
- Author
- ( Hadrian
- Abdurrahman
- Abu Al-Farabi
- Aentry+group%3d53%3aentry%3danima>
- Albert Einstein
- Alfred Schutz
- Andy Blunden
- Aristotle De Anima
- Arnaud Fournet
- August Bebel
- Aulus Postumius
- Ayn Rand
- Barbara C Malt
- Belinda Harper Sousa Maia
- Benjamin
- Benjamin
- Bertram F Malle
- Bertrand Russell
- Bertrand Russell
- Bertrand Russell
- Betrand Russell
- Bradford Z Mahon
- Chad Hansen
- Charles Peirce
- Charles S Peirce
- Christiane Stutterheim
- Christopher Hart
- Cristina D&apos
- Daniel A Weiskopf
- Daniel A Weiskopf
- Dante Alighieri
- David Rail
- Dennis Earl
- Dennis Earl
- Derrida
- Ed Quran
- Edouard
- Edouard Machery
- Edouard Machery
- Edward N Zalta
- English-Swahili Translation
- Erich Fromm
- Ernst Curtius
- Fee-Alexandra Haase
- Frank C Keil
- Friedrich Nietzsche
- Georg Wilhelm Hegel
- Gerard Delanty
- Gerhard K�bler
- Gerhard K�bler
- Gerhard K�bler
- Gerhard K�bler
- Gerhard K�bler
- Gilles Fauconnier
- Hans Wehr
- Hans Wehr
- Heinrich F Plett
- Henry Liddell
- Henry Liddell
- Henry Liddell
- Henry Liddell
- Ian A Apperly
- Ian A Apperly
- Ibm Corporation
- Immanual Kant
- Immanuel Kant
- Immanuel Kant
- Immanuel Kant
- Institutio Quintilian
- Jan
- Janne Mattila
- Jean Mandler
- Jean-Fran�ois Lyotard
- Jerome Dokic
- Jerry A Fodor
- Johann Micraelius
- John F Sowa
- Joseph D Novak
- Juan D Godino
- Juan Magari�os De Morentin
- Julius Pokorny
- Julius Pokorny
- J�rgen Habermas
- Karen O Solomon
- Kirsten F Condry
- Kjv The
- Lao Tzu
- Latin Dictionary
- Laura M Hiatt
- Leonard Talmy
- Leonard Talmy
- Leonid Perlovsky
- Leonid Perlovsky
- Liane &
- Martin Heidegger
- Mary D Mcvey
- Massimo Marraffa
- Mccaffrey
- Melike �z�m
- Melissa
- Merriam Webster Dictionary
- Michel Foucault
- Murat Aydede
- Nancy Nersessian
- Neil L Wilson
- Noam Chomsky
- Ockham
- Pamela J Shoemaker
- Paul Thagard
- Paul Werth
- Pixies
- Plato
- Plato The Sophist
- Quran
- Rekha Sapra
- Robert A Wilson
- Robert Greek-English Lexicon
- Robert Scott
- Robert Scott
- Robert Scott
- Rocco J Gennaro
- Ronald Simon
- Sami Syrj�m�ki
- Sandrine Zufferey
- Sapir
- Seana
- Semitic Root Repository
- Sigmund Freud
- Stephen
- Stephen
- Stephen C Levinson
- Sulayman Hayyim
- Susan Carey
- S�ren Stenlund
- Tamar Gendler
- Uta Priss
- Vaman Apte
- Victor H Mair
- Wallis Budge
- Website Charles
- Wiley Periodicals
- William Heinemann London
- William Heinemann London
- William London
- William M K Trochim
- William M Trochem
- William M Trochim
- William Of Ockham
- Wolfgang
- Y Y Yao
- Z Bradfor
- Publication venue
- 'Elsevier BV'
- Publication date
- 01/01/2014
- Field of study
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-Shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- Allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- de Toni Francesco
- de Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont Gérard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury María
- Hajihosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- Ilić Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner Zdeněk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski Germán
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix Rémi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- López Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- Mckenna Michael
- Mcmillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Ortiz Suarez Pedro
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñán Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo González
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- Pàmies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot Benoît
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-Aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- Sänger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Šaško Mario
- Publication venue
- HAL CCSD
- Publication date
- 12/11/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- :
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- De Toni Francesco
- De Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont Gérard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury María
- HajiHosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- Ilić Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner Zdeněk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski Germán
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix Rémi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- López Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- McKenna Michael
- McMillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirkin Shachar
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñán Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo González
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- Pàmies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot Benoît
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Suarez Pedro Ortiz
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- Sänger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- Taşar Davut Emre
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- Von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Workshop BigScience
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Šaško Mario
- Publication venue
- HAL CCSD
- Publication date
- 12/11/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License
Recent advances in prodrug-based nanoparticle therapeutics
- Author
- A. Golia B.R. Mahmood, Y. Fundora, K.A. Thornby, E.B. Chahine
- A. Wang-Gillam C.P. Li, G. Bodoky, A. Dean, Y.S. Shan, G. Jameson, T. Macarulla, K.H. Lee, D. Cunningham, J.F. Blanc, R.A. Hubner, C.F. Chiu, G. Schwartsmann, J.T. Siveke, F. Braiteh, V. Moyo, B. Belanger, N. Dhindsa, E. Bayever, D.D. Von Hoff, L.T. Chen, N.-S. Group
- Abdifetah
- Afifi
- Ahmad
- Akinc
- Al-Lawati
- Alberts
- Aljuffali
- Allan
- Aloy
- Angelova
- Anima
- Anselmo
- Arora
- Asaki
- Azadkhan
- Bai
- Barbuti
- Barhoum
- Barraud
- Barraud
- Barriga
- Beaumont
- Begines
- Bengalorkar
- Beverage
- Bhargava
- Blencowe
- Bobo
- Bomprezzi
- Bonvalot
- Bouhajib
- Bruderer
- Bulbake
- Cada
- Cai
- Cao
- Chapman
- Cheetham
- Chen
- Chen
- Chen
- Chen
- Chenthamara
- Choi
- Choi-Sledeski
- Clark
- Cohen
- Corboz
- Corboz
- Cui
- Cundy
- Cundy
- Cvetković
- Czupiel
- Darcis
- Das
- de Jonge
- Deeks
- Deng
- Derendorf
- Derfus
- Desai
- Dhingra
- Ding
- Dong
- Doronina
- Dosio
- Dragojevic
- Duan
- Duggan
- Dulinska-Litewka
- Eisenberg
- Elsheikh
- Engel
- English
- Evans
- Falanga
- Fang
- Fang
- Fernandez-Fernandez
- Fortuni
- Fu
- Fu
- Fukano
- Gabizon
- Gabizon
- Gabizon
- Gabizon
- Garcia
- Garmpis
- Gasparini
- Gessler
- Ghosh
- Gillis
- Giri
- Gluck
- Gnerre
- Goetz
- Gong
- Gonzalez-Carter
- Granfortuna
- Gray
- Grigoriadis
- Haddad
- Hall
- Han
- Han
- He
- Heidel
- Heinz
- Hoy
- Hoy
- Hrkach
- Hsieh
- Hua
- Husseini
- Høgset
- Ismail-Khan
- Jager
- Ji
- Johnstone
- Joubert
- Jubeh
- Kao
- Karaman
- Karaman
- Kenny
- Kim
- Koberle
- Kokil
- Koukouritaki
- Kratz
- Kratz
- Krise
- Ksander
- Kurokawa
- Laizure
- Langford
- Larsen
- Lasseter
- Lee
- Lee
- Leifer
- Lerchen
- Li
- Li
- Li
- Li
- Li
- Lim
- Lin
- Lin
- Linenberger
- Ling
- Linker
- Liu
- Liu
- Liu
- Liu
- Liu
- Liu
- Lorenzo-Redondo
- Lu
- Luo
- Luu
- Ma
- Ma
- Ma
- Madhusoodanan
- Mahmoodzadeh
- Malmborg
- Mandal
- Markovic
- Mathe
- Mathiyazhakan
- McClellan
- McGoon
- Meerum Terwogt
- Mehellou
- Mehellou
- Mehmood
- Meng
- Merali
- Min
- Mitchell
- Moorcroft
- Morris
- Munster
- Murphy
- Muscella
- Möllmann
- Nadler
- Najjar
- Najjar
- Neumann
- Nguyen
- Nicolaou
- Nomoto
- Norsworthy
- Noshi
- Nowotnik
- Nowotnik
- Omoto
- Ortiz de Montellano
- Paliwal
- Pan
- Park
- Patil
- Patil
- Patra
- Pawar
- Pawar
- Pei
- Pei
- Peiró Cadahía
- Piplani
- Plosker
- Qi
- Rains
- Rautio
- Rautio
- Reddy
- Rehmel
- Ren
- Rong
- Rooseboom
- Rosenblum
- Ruff
- Salama
- Sancho-Albero
- Schilder
- Scomparin
- Selbo
- Senapati
- Shan
- Sharma
- Sharma
- Shen
- Simon
- Simonneau
- Simplício
- Skwarczynski
- Sloat
- Slusarczyk
- Sofia
- Stappaerts
- Subbiah
- Sugawara
- Sumitomo
- Sun
- Sweeny
- Taghipour-Sabzevar
- Teft
- Thomas
- Tian
- Torchilin
- Trivedi
- Tsai
- Uchino
- Vaishya
- Valko
- van der Meel
- Ventola
- Ventola
- Verweij
- Vig
- Vokes
- Walther
- Wang
- Wang
- Wang
- Wang
- Wang
- Wang
- Wang
- Wassner
- Wiemer
- Wilczewska
- Wu
- Xiao
- Xu
- Yang
- Yang
- Yetisgin
- Yi
- Yin
- Zahednezhad
- Zalipsky
- Zanganeh
- Zeng
- Zhan
- Zhang
- Zhang
- Zhang
- Zhang
- Zhang
- Zhang
- Zhao
- Zhen
- Zheng
- Zheng
- Zhong
- Zhou
- Zhu
- Zielińska
- Publication venue
- 'Elsevier BV'
- Publication date
- Field of study