EleutherAI (English Wikipedia)

Black, Sidney; Biderman, Stella; Hallahan, Eric; et al. (1 May 2022). GPT-NeoX-20B: An Open-Source Autoregressive Language Model. Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models. pp. 95–136. arXiv:2204.06745. doi:10.18653/v1/2022.bigscience-1.9. Retrieved 19 December 2022 – via Association for Computational Linguistics - Anthology.

analyticsindiamag.com

Nataraj, Poornima (28 February 2022). "Online tools to create mind-blowing AI art". Analytics India Magazine. Archived from the original on 8 February 2023. Retrieved 8 March 2023.

analyticsinsight.net

Chowdhury, Meghmala (29 December 2022). "Will Powerful AI Disrupt Industries Once Thought to be Safe in 2023?". Analytics Insight. Archived from the original on 1 January 2023. Retrieved 6 April 2023.

arxiv.org

Gao, Leo; Biderman, Stella; Black, Sid; et al. (31 December 2020). The Pile: An 800GB Dataset of Diverse Text for Language Modeling. arXiv 2101.00027. arXiv:2101.00027.
Black, Sid; Biderman, Stella; Hallahan, Eric; et al. (14 April 2022). "GPT-NeoX-20B| An Open-Source Autoregressive Language Model". arXiv:2204.06745 [cs.CL].
Sanh, Victor; et al. (2021). "Multitask Prompted Training Enables Zero-Shot Task Generalization". arXiv:2110.08207 [cs.LG].
Muennighoff, Niklas; Wang, Thomas; Sutawika, Lintang; Roberts, Adam; Biderman, Stella; Teven Le Scao; M Saiful Bari; Shen, Sheng; Yong, Zheng-Xin; Schoelkopf, Hailey; Tang, Xiangru; Radev, Dragomir; Alham Fikri Aji; Almubarak, Khalid; Albanie, Samuel; Alyafeai, Zaid; Webson, Albert; Raff, Edward; Raffel, Colin (2022). "Crosslingual Generalization through Multitask Finetuning". arXiv:2211.01786 [cs.CL].
Workshop, BigScience; et al. (2022). "BLOOM: A 176B-Parameter Open-Access Multilingual Language Model". arXiv:2211.05100 [cs.CL].
Zhang, Susan; Roller, Stephen; Goyal, Naman; Artetxe, Mikel; Chen, Moya; Chen, Shuohui; Dewan, Christopher; Diab, Mona; Li, Xian; Lin, Xi Victoria; Mihaylov, Todor; Ott, Myle; Shleifer, Sam; Shuster, Kurt; Simig, Daniel; Koura, Punit Singh; Sridhar, Anjali; Wang, Tianlu; Zettlemoyer, Luke (21 June 2022). "OPT: Open Pre-trained Transformer Language Models". arXiv:2205.01068 [cs.CL].
Touvron, Hugo; Lavril, Thibaut; Izacard, Gautier; Grave, Edouard; Lample, Guillaume; et al. (27 February 2023). "LLaMA: Open and Efficient Foundation Language Models". arXiv:2302.13971 [cs.CL].
Taylor, Ross; Kardas, Marcin; Cucurull, Guillem; Scialom, Thomas; Hartshorn, Anthony; Saravia, Elvis; Poulton, Andrew; Kerkez, Viktor; Stojnic, Robert (16 November 2022). "Galactica: A Large Language Model for Science". arXiv:2211.09085 [cs.CL].
Black, Sidney; Biderman, Stella; Hallahan, Eric; et al. (1 May 2022). GPT-NeoX-20B: An Open-Source Autoregressive Language Model. Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models. pp. 95–136. arXiv:2204.06745. doi:10.18653/v1/2022.bigscience-1.9. Retrieved 19 December 2022 – via Association for Computational Linguistics - Anthology.
Biderman, Stella; Schoelkopf, Hailey; Anthony, Quentin; Bradley, Herbie; O'Brien, Kyle; Hallahan, Eric; Mohammad Aflah Khan; Purohit, Shivanshu; USVSN Sai Prashanth; Raff, Edward; Skowron, Aviya; Sutawika, Lintang; Oskar van der Wal (2023). "Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling". arXiv:2304.01373 [cs.CL].
Choi, Dami; Shavit, Yonadav; Duvenaud, David (2023). "Tools for Verifying Neural Models' Training Data". arXiv:2307.00682 [cs.LG].
Biderman, Stella; USVSN Sai Prashanth; Sutawika, Lintang; Schoelkopf, Hailey; Anthony, Quentin; Purohit, Shivanshu; Raff, Edward (2023). "Emergent and Predictable Memorization in Large Language Models". arXiv:2304.11158 [cs.CL].
Gupta, Kshitij; Thérien, Benjamin; Ibrahim, Adam; Richter, Mats L.; Anthony, Quentin; Belilovsky, Eugene; Rish, Irina; Lesort, Timothée (2023). "Continual Pre-Training of Large Language Models: How to (Re)warm your model?". arXiv:2308.04014 [cs.CL].

berkeley.edu

ml.berkeley.edu

"Alien Dreams: An Emerging Art Scene - ML@B Blog". Alien Dreams: An Emerging Art Scene - ML@B Blog. Archived from the original on 10 March 2023. Retrieved 8 March 2023.

cbirt.net

"Meet OpenFold: Reimplementing AlphaFold2 to Illuminate Its Learning Mechanisms and Generalization". 21 August 2023.

doi.org

Yuan, Sha; Zhao, Hanyu; Du, Zhengxiao; Ding, Ming; Liu, Xiao; Cen, Yukuo; Zou, Xu; Yang, Zhilin; Tang, Jie (2021). "WuDaoCorpora: A super large-scale Chinese corpora for pre-training language models". AI Open. 2: 65–68. doi:10.1016/j.aiopen.2021.06.001.
Andonian, Alex; Biderman, Stella; Black, Sid; Gali, Preetham; Gao, Leo; Hallahan, Eric; Levy-Kramer, Josh; Leahy, Connor; Nestler, Lucas; Parker, Kip; Pieler, Michael; Purohit, Shivanshu; Songz, Tri; Phil, Wang; Weinbach, Samuel (10 March 2023). GPT-NeoX: Large Scale Autoregressive Language Modeling in PyTorch (Preprint). doi:10.5281/zenodo.5879544.
Black, Sidney; Biderman, Stella; Hallahan, Eric; et al. (1 May 2022). GPT-NeoX-20B: An Open-Source Autoregressive Language Model. Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models. pp. 95–136. arXiv:2204.06745. doi:10.18653/v1/2022.bigscience-1.9. Retrieved 19 December 2022 – via Association for Computational Linguistics - Anthology.

eleuther.ai

"About". EleutherAI. Retrieved 23 May 2024.
"EleutherAI Website". EleutherAI. Archived from the original on 2 July 2021. Retrieved 1 July 2021.
"CLIP-Guided Diffusion". EleutherAI. Archived from the original on 29 August 2023. Retrieved 20 August 2023.
"VQGAN-CLIP". EleutherAI. Archived from the original on 20 August 2023. Retrieved 20 August 2023.

blog.eleuther.ai

Leahy, Connor; Hallahan, Eric; Gao, Leo; Biderman, Stella (7 July 2021). "What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective". Archived from the original on 29 August 2023. Retrieved 1 March 2023.
Leahy, Connor; Hallahan, Eric; Gao, Leo; Biderman, Stella (7 July 2021). "What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective". EleutherAI Blog. Archived from the original on 29 August 2023. Retrieved 14 April 2023.
"The View from 30,000 Feet: Preface to the Second EleutherAI Retrospective". 2 March 2023.

forefront.ai

"GPT-J-6B: An Introduction to the Largest Open Source GPT Model | Forefront". www.forefront.ai. Archived from the original on 9 March 2023. Retrieved 1 March 2023.
"GPT-J-6B: An Introduction to the Largest Open Source GPT Model | Forefront". www.forefront.ai. Archived from the original on 9 March 2023. Retrieved 1 March 2023.

handle.net

hdl.handle.net

Khan, Mehtab; Hanna, Alex (2023). "The Subjects and Stages of AI Dataset Development: A Framework for Dataset Accountability". Ohio State Technology Law Journal. 19 (2): 171–256. hdl:1811/103549. SSRN 4217148.

huggingface.co

"Model Card for BioMedLM 2.7B". huggingface.co. Archived from the original on 5 June 2023. Retrieved 5 June 2023.
"EleutherAI/gpt-j-6B · Hugging Face". huggingface.co. Archived from the original on 12 March 2023. Retrieved 10 March 2023.

ieee.org

spectrum.ieee.org

Smith, Craig (21 March 2022). "EleutherAI: When OpenAI Isn't Open Enough". IEEE Spectrum. IEEE. Archived from the original on 29 August 2023. Retrieved 8 August 2023.
"EleutherAI: When OpenAI Isn't Open Enough". IEEE Spectrum. Archived from the original on 21 March 2023. Retrieved 1 March 2023.

infoworld.com

Yegulalp, James R. Borck, Martin Heller, Andrew C. Oliver, Ian Pointer, Matthew Tyson and Serdar (18 October 2021). "The best open source software of 2021". InfoWorld. Archived from the original on 8 March 2023. Retrieved 8 March 2023.{{cite web}}: CS1 maint: multiple names: authors list (link)
Yegulalp, James R. Borck, Martin Heller, Andrew C. Oliver, Ian Pointer, Isaac Sacolick, Matthew Tyson and Serdar (17 October 2022). "The best open source software of 2022". InfoWorld. Archived from the original on 8 March 2023. Retrieved 8 March 2023.{{cite web}}: CS1 maint: multiple names: authors list (link)

lifearchitect.ai

"AI: Megatron the Transformer, and its related language models". 24 September 2021. Archived from the original on 4 March 2023. Retrieved 8 March 2023.

ljvmiranda921.github.io

MIRANDA, LJ (8 August 2021). "The Illustrated VQGAN". ljvmiranda921.github.io. Archived from the original on 20 March 2023. Retrieved 8 March 2023.

nylon.com

"Inside The World of Uncanny AI Twitter Art". Nylon. 24 March 2022. Archived from the original on 29 August 2023. Retrieved 8 March 2023.

proofnews.org

Gilbertson, Annie (16 July 2024). "Apple, Nvidia, Anthropic Used Thousands of Swiped YouTube Videos to Train AI". Proof. Retrieved 18 July 2024.

research.google.com

colab.research.google.com

"CLIP Guided Diffusion HQ 256x256.ipynb - Colaboratory". Google Colab. Archived from the original on 29 August 2023. Retrieved 20 August 2023.

ssrn.com

papers.ssrn.com

Khan, Mehtab; Hanna, Alex (2023). "The Subjects and Stages of AI Dataset Development: A Framework for Dataset Accountability". Ohio State Technology Law Journal. 19 (2): 171–256. hdl:1811/103549. SSRN 4217148.

techcrunch.com

Wiggers, Kyle (2 March 2023). "Stability AI, Hugging Face and Canva back new AI research nonprofit". TechCrunch. Archived from the original on 29 August 2023. Retrieved 8 August 2023.
Wiggers, Kyle (2 March 2023). "Stability AI, Hugging Face and Canva back new AI research nonprofit". Archived from the original on 7 March 2023. Retrieved 8 March 2023.

thenonprofittimes.com

"AI Research Lab Launches Open Source Research Nonprofit".

theregister.com

Quach, Katyanna. "A man spent a year in jail on a murder charge involving disputed AI evidence. Now the case has been dropped". www.theregister.com. Archived from the original on 8 March 2023. Retrieved 8 March 2023.

unesco.org

"UNESCO Netexplo Forum 2021 | UNESCO". Archived from the original on 16 October 2022. Retrieved 8 March 2023.

venturebeat.com

"GPT-3's free alternative GPT-Neo is something to be excited about". VentureBeat. 15 May 2021. Archived from the original on 9 March 2023. Retrieved 14 April 2023.
"Microsoft and Nvidia team up to train one of the world's largest language models". 11 October 2021. Archived from the original on 27 March 2023. Retrieved 8 March 2023.
"GPT-3's free alternative GPT-Neo is something to be excited about". 15 May 2021. Archived from the original on 9 March 2023. Retrieved 10 March 2023.
"VentureBeat presents AI Innovation Awards nominees at Transform 2021". 16 July 2021. Archived from the original on 8 March 2023. Retrieved 8 March 2023.

vice.com

"Meet the Woman Making Viral Portraits of Mental Health on TikTok". www.vice.com. 30 November 2021. Archived from the original on 11 May 2023. Retrieved 8 March 2023.

wandb.ai

"Democratizing AI for Biology with OpenFold".

web.archive.org

Leahy, Connor; Hallahan, Eric; Gao, Leo; Biderman, Stella (7 July 2021). "What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective". Archived from the original on 29 August 2023. Retrieved 1 March 2023.
Smith, Craig (21 March 2022). "EleutherAI: When OpenAI Isn't Open Enough". IEEE Spectrum. IEEE. Archived from the original on 29 August 2023. Retrieved 8 August 2023.
Wiggers, Kyle (2 March 2023). "Stability AI, Hugging Face and Canva back new AI research nonprofit". TechCrunch. Archived from the original on 29 August 2023. Retrieved 8 August 2023.
Leahy, Connor; Hallahan, Eric; Gao, Leo; Biderman, Stella (7 July 2021). "What A Long, Strange Trip It's Been: EleutherAI One Year Retrospective". EleutherAI Blog. Archived from the original on 29 August 2023. Retrieved 14 April 2023.
"GPT-3's free alternative GPT-Neo is something to be excited about". VentureBeat. 15 May 2021. Archived from the original on 9 March 2023. Retrieved 14 April 2023.
"GPT-J-6B: An Introduction to the Largest Open Source GPT Model | Forefront". www.forefront.ai. Archived from the original on 9 March 2023. Retrieved 1 March 2023.
"EleutherAI: When OpenAI Isn't Open Enough". IEEE Spectrum. Archived from the original on 21 March 2023. Retrieved 1 March 2023.
"EleutherAI Website". EleutherAI. Archived from the original on 2 July 2021. Retrieved 1 July 2021.
"Microsoft and Nvidia team up to train one of the world's largest language models". 11 October 2021. Archived from the original on 27 March 2023. Retrieved 8 March 2023.
"AI: Megatron the Transformer, and its related language models". 24 September 2021. Archived from the original on 4 March 2023. Retrieved 8 March 2023.
"Model Card for BioMedLM 2.7B". huggingface.co. Archived from the original on 5 June 2023. Retrieved 5 June 2023.
"GPT-3's free alternative GPT-Neo is something to be excited about". 15 May 2021. Archived from the original on 9 March 2023. Retrieved 10 March 2023.
"EleutherAI/gpt-j-6B · Hugging Face". huggingface.co. Archived from the original on 12 March 2023. Retrieved 10 March 2023.
"GPT-J-6B: An Introduction to the Largest Open Source GPT Model | Forefront". www.forefront.ai. Archived from the original on 9 March 2023. Retrieved 1 March 2023.
"CLIP-Guided Diffusion". EleutherAI. Archived from the original on 29 August 2023. Retrieved 20 August 2023.
"CLIP Guided Diffusion HQ 256x256.ipynb - Colaboratory". Google Colab. Archived from the original on 29 August 2023. Retrieved 20 August 2023.
MIRANDA, LJ (8 August 2021). "The Illustrated VQGAN". ljvmiranda921.github.io. Archived from the original on 20 March 2023. Retrieved 8 March 2023.
"Inside The World of Uncanny AI Twitter Art". Nylon. 24 March 2022. Archived from the original on 29 August 2023. Retrieved 8 March 2023.
"This AI Turns Movie Text Descriptions Into Abstract Posters". Yahoo Life. 20 September 2021. Archived from the original on 27 December 2022. Retrieved 8 March 2023.
Quach, Katyanna. "A man spent a year in jail on a murder charge involving disputed AI evidence. Now the case has been dropped". www.theregister.com. Archived from the original on 8 March 2023. Retrieved 8 March 2023.
"Alien Dreams: An Emerging Art Scene - ML@B Blog". Alien Dreams: An Emerging Art Scene - ML@B Blog. Archived from the original on 10 March 2023. Retrieved 8 March 2023.
"VQGAN-CLIP". EleutherAI. Archived from the original on 20 August 2023. Retrieved 20 August 2023.
"We asked an AI tool to 'paint' images of Australia. Critics say they're good enough to sell". ABC News. 14 July 2021. Archived from the original on 7 March 2023. Retrieved 8 March 2023 – via www.abc.net.au.
Nataraj, Poornima (28 February 2022). "Online tools to create mind-blowing AI art". Analytics India Magazine. Archived from the original on 8 February 2023. Retrieved 8 March 2023.
"Meet the Woman Making Viral Portraits of Mental Health on TikTok". www.vice.com. 30 November 2021. Archived from the original on 11 May 2023. Retrieved 8 March 2023.
"UNESCO Netexplo Forum 2021 | UNESCO". Archived from the original on 16 October 2022. Retrieved 8 March 2023.
Yegulalp, James R. Borck, Martin Heller, Andrew C. Oliver, Ian Pointer, Matthew Tyson and Serdar (18 October 2021). "The best open source software of 2021". InfoWorld. Archived from the original on 8 March 2023. Retrieved 8 March 2023.{{cite web}}: CS1 maint: multiple names: authors list (link)
Yegulalp, James R. Borck, Martin Heller, Andrew C. Oliver, Ian Pointer, Isaac Sacolick, Matthew Tyson and Serdar (17 October 2022). "The best open source software of 2022". InfoWorld. Archived from the original on 8 March 2023. Retrieved 8 March 2023.{{cite web}}: CS1 maint: multiple names: authors list (link)
"VentureBeat presents AI Innovation Awards nominees at Transform 2021". 16 July 2021. Archived from the original on 8 March 2023. Retrieved 8 March 2023.
"What's next for AI: Gary Marcus talks about the journey toward robust artificial intelligence". ZDNET. Archived from the original on 1 March 2023. Retrieved 8 March 2023.
Chowdhury, Meghmala (29 December 2022). "Will Powerful AI Disrupt Industries Once Thought to be Safe in 2023?". Analytics Insight. Archived from the original on 1 January 2023. Retrieved 6 April 2023.
Wiggers, Kyle (2 March 2023). "Stability AI, Hugging Face and Canva back new AI research nonprofit". Archived from the original on 7 March 2023. Retrieved 8 March 2023.

wired.com

Gilbertson, Annie; Reisner, Alex (16 July 2024). "Apple, Nvidia, Anthropic Used Thousands of Swiped YouTube Videos to Train AI". WIRED. Retrieved 18 July 2024.

x.com

@EMostaque (2 March 2023). "Stability AI came out of @AiEleuther and we have been delighted to incubate it as the foundation was set up" (Tweet) – via Twitter.
@GaryMarcus (10 February 2022). "GPT-NeoX-20B, 20 billion parameter large language model made freely available to public, with candid report on strengths, limits, ecological costs, etc" (Tweet) – via Twitter.
@GaryMarcus (19 February 2022). "incredibly important result: "our results raise the question of how much [large language] models actually generalize beyond pretraining data"" (Tweet) – via Twitter.

yahoo.com

"This AI Turns Movie Text Descriptions Into Abstract Posters". Yahoo Life. 20 September 2021. Archived from the original on 27 December 2022. Retrieved 8 March 2023.

yandex.com

Grabovskiy, Ilya (2022). "Yandex publishes YaLM 100B, the largest GPT-like neural network in open source" (Press release). Yandex. Retrieved 5 June 2023.

youtube.com

"Talk with Stella Biderman on The Pile, GPT-Neo and MTG". The Interference Podcast. 2 April 2021. Retrieved 26 March 2023.

zdnet.com

"What's next for AI: Gary Marcus talks about the journey toward robust artificial intelligence". ZDNET. Archived from the original on 1 March 2023. Retrieved 8 March 2023.