7 research outputs found
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- :
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- De Toni Francesco
- De Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont GĂ©rard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury MarĂa
- HajiHosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- IliÄ Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner ZdenÄk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski GermĂĄn
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix RĂ©mi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- LĂłpez Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- McKenna Michael
- McMillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirkin Shachar
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñån Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo GonzĂĄlez
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- PĂ mies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot BenoĂźt
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Suarez Pedro Ortiz
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- SĂ€nger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- TaĆar Davut Emre
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- Von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Workshop BigScience
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Ć aĆĄko Mario
- Publication venue
- Publication date
- 10/12/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks
based on a few demonstrations or natural language instructions. While these
capabilities have led to widespread adoption, most LLMs are developed by
resource-rich organizations and are frequently kept from the public. As a step
towards democratizing this powerful technology, we present BLOOM, a
176B-parameter open-access language model designed and built thanks to a
collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer
language model that was trained on the ROOTS corpus, a dataset comprising
hundreds of sources in 46 natural and 13 programming languages (59 in total).
We find that BLOOM achieves competitive performance on a wide variety of
benchmarks, with stronger results after undergoing multitask prompted
finetuning. To facilitate future research and applications using LLMs, we
publicly release our models and code under the Responsible AI License
A muon spectrometer with calorimeter dump used for the beauty search at the CERN Super Proton Synchrotron
- Author
- Alessandro B
- Alpe W
- Bartley J H
- Bisi V
- Bronzini F
- Carboni G
- Catanesi M G
- Clemente A
- Cobbaert H
- Conboy J E
- Coupland M
- Crosetti G
- De Vincenzi M
- Di Liberto S
- Duff Brian G
- Esten M J
- Fennel P
- Fidecaro Maria
- Frenkel A
- Gamba D
- Gerke C
- Harrison P
- Heymann Franz F
- Imrie D C
- Lamanna E
- Liberti L
- Marini G
- Martellotti G
- Muciaccia M T
- Musset P
- Natali S
- Nigro A
- Nuzzo S
- Parisi A
- Pellizzoni G
- Penso G
- Petrera S
- Petrolo E
- Pistilli P
- Poulard G
- Ramello L
- Renevey Max
- Riccati L
- Roberts I G
- RomanĂł L
- Roosen R
- Rosa G
- Ruggieri F
- Sciubba A
- Sletten H
- Trent P T
- Publication venue
- 'Elsevier BV'
- Publication date
- 28/05/1986
- Field of study
Results from CESR
- Author
- Alam M S
- Andrews D
- Avery P
- Bebek C
- Berkelman K
- Blanar G J
- Brody A
- Böhringer T
- Cabenda R
- Cassel David G
- Chadwick K
- Chauveau J
- Chen A
- Costantini F
- Csorna S E
- De Wire J S
- Dietl H
- Dobbins J
- Ehrlich R
- Eigen G
- Ferguson T
- Finocchiaro G
- Franzini P
- Fridman A
- Ganci P
- Gentile T
- Giannini G
- Gilchriese M G D
- Gittelman B
- Goldberg M
- Green J
- Haggerty J
- Han K
- Hartill D L
- Hempstead M
- Herb S W
- Herrup D A
- Herzlinger M
- Hicks R
- Horwitz N
- Imlay R
- Izen J M
- Kagan H
- Kandaswamy J
- Kass R
- Kooy H
- Kreinick D L
- Lederman Leon Max
- Lee-Franzini Juliet
- Levman G
- Lobkowicz F
- Longuemare C
- Loomis W A
- Lorenz E
- MacKay W W
- Mageras G
- Melissinos A C
- Metcalf W
- Mistry N B
- Moneti G C
- MĂŒller J J
- Nordberg E
- Olsen S L
- Panvini R S
- Pauss Felicitas
- Perchonok P
- Peterson D
- Pipkin F M
- Pistilli P
- Plunkett R K
- Poling R A
- Rice E
- Rohlf J
- Rosenfeld C
- Rucinski G J
- Sadoff A J
- Sannes F
- Schamberger R D
- Shinsky K A
- Siemann R H
- Silverman Alan
- Sivertz M
- Skubic P L
- Snyder A
- Spencer L J
- Sreedhar V V
- Stein P C
- Stone R
- Stone S
- Talman R
- Tanenbaum W M
- Thorndike E H
- Tuts P M
- Vogel H
- Weber D
- Wilcke R
- Wilson R
- Yoh J K
- Publication venue
- Publication date
- 01/01/1984
- Field of study
Safety of Retinopathy of Prematurity Examination and Imaging in Premature Infants
- Author
- Agnieshka Baumritter
- Agnieshka Baumritter
- Alex R. Kemper
- Alex R. Kemper
- Alice Gong
- Alice Gong
- Ann Marie Holleschau
- Anna Ells
- Anna Ells
- Antonio Capone
- April Ingram
- Balasubramanian
- Blencowe
- Bonnie Carlstrom
- Brandi Hubbuch
- Brenda Mann
- C. Mark Herring
- Candace R. Parker Ostroff
- Carmen McHenry
- Carolyn Wu
- Catherine Olson Jordan
- Charles C. Barr
- Claressa Whearry
- Clarke
- Clio Armitage Harper
- Craig Douglas
- Cyrie Ann Fry
- Danielle Ledoux
- Darla N. Nyquist
- David C. Musch
- David Dries
- David Emmert
- David L. Rogers
- David Morrison
- David Wallace
- Deborah Harrison
- Deborah VanderVeen
- Degirmencioglu
- Denise Pearson
- Dhaliwal
- Ditte J. Hess
- Don L. Bremer
- Du Tran-Viet
- E. Revell Martin
- Ebenezer Daniel
- Eli Smith
- Elnora Cokley
- Erick D. Bothun
- Fierson
- Fierson
- Fijalkowski
- Frank Weng
- G. Baker Hubbard
- G. Carl Gibson
- Gil Binenbaum
- Graham E. Quinn
- Graham Quinn
- Graham Quinn
- Gui-Shuang Ying
- Gui-shuang Ying
- Inge DeBecker
- Jason Mantagos
- Jennifer A. Shepard
- Jill Anderson
- John Stokes
- Karen A. Karp
- Karen Corff
- Karen Karp
- Kathleen McWilliams
- Kathryn Conner
- Katie Jo Farnsworth
- Kelli Satnes
- Kelly C. Wade
- Kelly Wade
- Kerry Davis
- Krista Sepielli
- Laurie Weaver
- Lee
- Lim
- Lisa Erbring
- Lisa Prosser
- Lucas Trigler
- Marilyn Escobedo
- Mary Brightwell-Arnold
- Mary Lou McGregor
- Maureen Maguire
- Max Pistilli
- Maxwell Pistilli
- Mehta
- Michael X. Repka
- Michelle Bottorff
- Michelle Huynh
- Mitchell
- Monte D. Mills
- Moral-Pumarega
- Mukherjee
- Nancy Benegas
- Neffendorf
- Nichole E. Miller
- Patrick Mitchell
- Peggy Fishman
- Peter Lloyd Hildebrand
- Quinn
- Quinn
- R. Michael Siatkowski
- Rachel Keith
- Rae R. Fellows
- Rahul Bhola
- Regina Hansen
- Rhonda âMichelleâ Young
- Robert Hoffman
- Rosalind Heemer
- Rosie Sorbie
- Rush
- Ryan Spaulding
- Samra
- Sandra Harkins
- Sandra Phillips
- Sandy Owings
- Sarah K. Jones
- Scott Ruark
- Sean Donahue
- Sharon Freedman
- SriniVas R. Sadda
- Stephen P. Christiansen
- Steven M. Kymes
- Suzanne Brandt
- Suzanne Johnston
- Tamar Winter
- Theresa Mansfield
- Trang B. Duros
- Will Anninger
- Wu
- Publication venue
- 'Elsevier BV'
- Publication date
- Field of study
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-Shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- Allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- de Toni Francesco
- de Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont GĂ©rard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury MarĂa
- Hajihosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- IliÄ Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner ZdenÄk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski GermĂĄn
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix RĂ©mi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- LĂłpez Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- Mckenna Michael
- Mcmillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Ortiz Suarez Pedro
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñån Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo GonzĂĄlez
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- PĂ mies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot BenoĂźt
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-Aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- SĂ€nger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Ć aĆĄko Mario
- Publication venue
- HAL CCSD
- Publication date
- 12/11/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
- Author
- :
- Abdollahi Arezoo
- Abdulmumin Idris
- Abrar Nafis
- Adelani David Ifeoluwa
- Aghagol Arash
- Aji Alham Fikri
- Ajibade Benjamin
- Akiki Christopher
- Akinlolu Martha
- Al-shaibani Maged S.
- Albanie Samuel
- Alfassy Amit
- Alizadeh Samira
- allal Loubna Ben
- Almubarak Khalid
- Altay Gabriel
- Alyafeai Zaid
- Ammanamanchi Pawan Sasanka
- Amuok Priscilla
- An Ran
- Antverg Omer
- Bach Stephen H.
- Bajaj Yash Shailesh
- Bamberger Zachary
- Bari M Saiful
- Barth Fabio
- Baruwa Ahmed
- Bawden Rachel
- Baylor Emi
- Bayrak Giyaseddin
- Behroozi Bahareh
- Beilharz Benjamin
- Bekman Stas
- Belinkov Yonatan
- Belkada Younes
- Bello Imane
- Beltagy Iz
- Ben-David Srulik
- Benyamina Hamza
- Bers Tali
- Bharati Sushil
- Bhattacharjee Joydeep
- Bhattacharya Indrani
- Biderman Stella
- Bogdanov Eli
- Bommasani Rishi
- Bose Shamik
- Bourfoune Hatim
- Bras Mathilde
- Brito Caio
- Broad Nicholas Michio
- Brody Shaked
- Bulchandani Lokesh
- Burns Gully
- Burynok Mykola
- Cahyawijaya Samuel
- Callahan Alison
- Canalli Rodrigo
- Carpuat Marine
- Casper Jared
- Castagné Roman
- Castillo Maria A
- Chaffin Antoine
- Chandrasekhar Ramya
- Chang Jonathan
- Chen Kimbo
- Cheng Newton
- Cheveleva Anastasia
- Chhablani Gunjan
- Chim Jenny
- Chung Hyung Won
- Clinciu Miruna
- Clive Jordan
- Coavoux Maximin
- Colombo Pierre
- Contractor Danish
- Cornette Pierre
- Cullan Michael
- Dahlberg Nathan
- Danchev Valentin
- Dash Ishani
- Datta Debajyoti
- David Davis
- de Bykhovetz Madeleine Hahn
- de Gibert Ona
- de la Rosa Javier
- De Toni Francesco
- De Wolf Michiel
- del Moral Albert Villanova
- Deshmukh Shlok S
- Dettmers Tim
- Dey Manan
- Dodge Jesse
- Dupont GĂ©rard
- Dutra Livia
- Eisenberg Renata
- Elbadri Maraim
- Elkott Nour
- Elsahar Hady
- Emezue Chris
- Espejel Omar
- Fahmy Nour
- Fan Angela
- Faranak Amy
- Feizpour Amir
- Ferrandis Carlos Muñoz
- Fevry Thibault
- Forde Jessica Zosa
- Fourrier Clémentine
- Freidank Moritz
- Fries Jason Alan
- Frohberg Jörg
- Fuhrimann Florian
- Fung Pascale
- Gallé Matthias
- Gandhi Sanchit
- Gao Leo
- Garda Samuele
- Garrette Dan
- Gehrmann Sebastian
- Gerchick Marissa
- Ghaleb Mustafa
- Ghauri Muhammed
- Gigant Théo
- Giorgi John
- Gokaslan Aaron
- Golde Jonas
- Gonzalez-Dios Itziar
- Grandury MarĂa
- HajiHosseini Azadeh
- Haller Patrick
- Hao Ryan
- Harliman Rheza
- Hazan Liam
- Heinzerling Benjamin
- Henderson Peter
- Hesslow Daniel
- Hevia Anthony
- Huang Max
- IliÄ Suzana
- Jain Chirag
- Jauhar Mohammad A.
- Jernite Yacine
- Jiang Mike Tian-Jian
- Johnson Isaac
- Jones Hessie
- Kainuma Tomoya
- Kalo Jan-Christoph
- Kang Jihyun
- Kang Myungsun
- Kasai Jungo
- Kashyap Abhinav Ramesh
- Kasner ZdenÄk
- Kassner Nora
- Kawamura Ken
- Khamis Nurulaqilla
- Khan Ammar
- Kiblawi Sid
- Kiela Douwe
- Kim Ethan
- Kim Najoung
- Kim Taewoon
- Klamm Christopher
- Kromann Rasmus
- Kruszewski GermĂĄn
- Kumar Srishti
- Kusa Wojciech
- Labrak Yanis
- Lacroix RĂ©mi
- Laippala Veronika
- Lansky David
- Laud Tanmay
- Launay Julien
- Laurençon Hugo
- Lavallée Pierre François
- Le Thanh
- Le Trieu
- Lee Wilson Y.
- Leong Colin
- Lepercq Violette
- Levkovizh Efrat
- Lhoest Quentin
- Li Conglong
- Ligozat Anne-Laure
- Limisiewicz Tomasz
- Liu Lu
- Liu Minna
- Lo Kyle
- Longpre Shayne
- Lovering Charles
- Luccioni Alexandra Sasha
- LĂłpez Roberto Luis
- Manica Matteo
- Manjavacas Enrique
- Martin Robert
- Masoud Maraim
- McKenna Michael
- McMillan-Major Angelina
- Mielke Sabrina J.
- Mieskes Margot
- Mihaljcic Mina
- Mikhailov Vladislav
- Miranda-Escalada Antonio
- Mirkin Shachar
- Mirza Fatima
- Mishra Mayank
- Mishra Shubhanshu
- Mitchell Margaret
- Molano Daniel
- Mou Chenghao
- Muellner Nikolaus
- Muennighoff Niklas
- Muhammad Shamsuddeen Hassan
- Muñoz Manuel Romero
- Nagel Sebastian
- Narayanan Deepak
- Natan Eyal Bar
- Nayak Nihal
- Neeraj Trishala
- Nejadgholi Isar
- Nezhurina Marianna
- Nguyen Duong A.
- Nguyen Huu
- Nguyen Olivier
- Nguyen Zach
- Nikoulina Vassilina
- Nikpoor Somaieh
- Nitzav Ariel Kreisberg
- Novikova Jekaterina
- Névéol Aurélie
- Ononiwu Frankline
- Osei Salomey
- Ott Simon
- Oyebade Tobi
- Ozoani Ezinwanne
- Pai Suhas
- Pais Shani
- Palasciano Alfredo
- Pandey Harshit
- Passmore Jesse
- Patil Suraj
- Patry Nicolas
- Pavlick Ellie
- Periñån Daniel León
- Pestana Amanda
- Peyrounette Myriam
- Phan Long
- Phang Jason
- Pistilli Giada
- Ponferrada Eduardo GonzĂĄlez
- Posada Jose David
- Prabhu Vrinda
- Press Ofir
- Protasov Vitaly
- Pruksachatkun Yada
- Pyysalo Sampo
- PĂ mies Marc
- Qiu Mike
- Radev Dragomir
- Raffel Colin
- Raja Arun
- Rajani Nazneen
- Rajbhandari Samyam
- Rasley Jeff
- Raunak Vikas
- Reiter Ehud
- Requena Stéphane
- Rezanejad Habib
- Ribeiro Rui
- Rieser Verena
- Roberts Adam
- Rogers Anna
- Roy Sourav
- Rozen Jos
- Rueda Alice
- Rush Alexander M.
- Ruwase Olatunji
- Ryabinin Max
- Sagot BenoĂźt
- Salesky Elizabeth
- Samagaio Mairon
- Samuel Olanrewaju
- Samwald Matthias
- Sang-aroonsiri Sinee
- Sanh Victor
- Sanseviero Omar
- Santilli Andrea
- Santos Ana
- Sanz Julio Bonis
- Saulnier Lucile
- Saxena Bharat
- Scao Teven Le
- Schick Timo
- Schoelkopf Hailey
- Schweter Stefan
- Scialom Thomas
- Sedenko Irina
- Seelam Natasha
- Seltzer Josh
- Serikov Oleg
- Sharma Abheesht
- Sharma Shanya
- Shavrina Tatiana
- Shen Sheng
- Shinzato Luisa
- Shoeybi Mohammad
- Shubber Sarmad
- Shukla Anima
- Si Chenglei
- Silberberg Stanislav
- Simhi Adi
- Singh Amanpreet
- Singh Ayush
- Singh Mayank
- Sivaraman Karthik Rangasai
- Smith Shaden
- Solaiman Irene
- Soroa Aitor
- Stiegler Arnaud
- Strobelt Hendrik
- Su Rosaline
- Su Ruisi
- Suarez Pedro Ortiz
- Subramani Nishant
- Subramonian Arjun
- Sun Zhiqing
- Sutawika Lintang
- Szczechla Eliza
- SĂ€nger Mario
- Tae Jaesung
- Takeuchi Maiko
- Taktasheva Ekaterina
- Talat Zeerak
- Tammour Aycha
- Tan Edward
- Tan Samson
- Tan Zhe
- Tang Xiangru
- Tanguy Ludovic
- Tazi Nouamane
- TaĆar Davut Emre
- Teehan Ryan
- Thakker Urmish
- Thrush Tristan
- Tobing Joseph
- Tojarieh Hadar
- Torrent Tiago Timponi
- Tow Jonathan
- Tran Hieu
- Tunuguntla Deepak
- Unldreaj Antigona
- Uri Yallow
- van der Wal Oskar
- van Strien Daniel
- Venkatraman Yash
- Viguier Sylvain
- Villegas Paulo
- Voloshina Ekaterina
- von Platen Patrick
- Von Werra Leandro
- Vrabec Helena U.
- Vu Minh Chien
- Wang Bo
- Wang Han
- Wang Silas
- Wang Thomas
- Weber Leon
- Webson Albert
- Weinberg Michael
- Winata Genta Indra
- Wolf Thomas
- Workshop BigScience
- Xie Zhongli
- Xu Canwen
- Xu Chuxin
- Xu Yifan
- Xu Yingxin
- Xu Yu
- Yang Yoyo
- Ye Zifan
- Yong Zheng-Xin
- Yu Dian
- Yu Ian
- Yun Tian
- Yvon François
- Zhang Minjia
- Zhang Rui
- Zhang Ruochen
- Zhou Chenxi
- Zhu Jian
- Zink Sydney
- Ć aĆĄko Mario
- Publication venue
- HAL CCSD
- Publication date
- 12/11/2022
- Field of study
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we publicly release our models and code under the Responsible AI License