GPT-2 (Japanese Wikipedia)

Analysis of information sources in references of the Wikipedia article "GPT-2" in Japanese language version.

refsWebsite

Global rank Japanese rank

41web.archive.org

1^st place

14doi.org

2^nd place

6^th place

13wikipedia.org

low place

10arxiv.org

69^th place

227^th place

5theverge.com

114^th place

625^th place

4openai.com

1,559^th place

1,682^nd place

3nih.gov

4^th place

24^th place

3aclweb.org

low place

2vox.com

484^th place

2,490^th place

2venturebeat.com

616^th place

2,168^th place

2towardsdatascience.com

8,920^th place

low place

2theguardian.com

12^th place

120^th place

2technologyreview.com

1,943^rd place

3,910^th place

2bham.ac.uk

6,934^th place

low place

2harvard.edu

18^th place

107^th place

2wikidata.org

43^rd place

1,892^nd place

2worldcat.org

5^th place

19^th place

1distill.pub

low place

1arr.am

low place

1sciencehistory.org

3,963^rd place

low place

1unive.it

low place

1semanticscholar.org

11^th place

1,537^th place

1handle.net

102^nd place

78^th place

1mit.edu

415^th place

1,150^th place

1stanford.edu

179^th place

608^th place

1ed.ac.uk

1,871^st place

2,715^th place

1berkeley.edu

580^th place

1,954^th place

1jstor.org

26^th place

275^th place

1unsw.edu.au

4,584^th place

low place

1deeplearningbook.org

low place

1ieice.org

low place

6,278^th place

1nips.cc

low place

1researchgate.net

120^th place

616^th place

1colah.github.io

low place

1cv-foundation.org

low place

1cmu.edu

1,564^th place

3,249^th place

1theregister.com

3,700^th place

8,453^rd place

1syncedreview.com

low place

1thegradient.pub

low place

1usejournal.com

low place

1usgamer.net

2,202^nd place

8,349^th place

1gizmodo.com

474^th place

1,922^nd place

1techcrunch.com

187^th place

440^th place

1huggingface.co

low place

1talktotransformer.com

low place

1creativeengines.ai

low place

aclweb.org

“N-gram Counts and Language Models from the Common Crawl”. pp. 3579–3584 (May 2014). 28 January 2021時点のオリジナルよりアーカイブ。22 January 2021閲覧。
“A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference”. Association for Computational Linguistics (1 June 2018). 11 February 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。 “At 433k examples, this resource is one of the largest corpora available for natural language inference (a.k.a. recognizing textual entailment), [...] offering data from ten distinct genres of written and spoken English [...] while supplying an explicit setting for evaluating cross-genre domain adaptation.”
“LSDSem 2017 Shared Task: The Story Cloze Test”. Association for Computational Linguistics (3 April 2017). 22 November 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。 “The LSDSem’17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choose the correct ending to the story. Successful narrative understanding (getting closer to human performance of 100%) requires systems to link various levels of semantics to commonsense knowledge.”

arr.am

Arram (July 9, 2020). “GPT-3: An AI that's eerily good at writing almost anything”. Arram Sabeti. July 20, 2020時点のオリジナルよりアーカイブ。July 31, 2020閲覧。

arxiv.org

Hegde, Chaitra; Patil, Shrikumar (9 June 2020). "Unsupervised Paraphrase Generation using Pre-trained Language Models". arXiv:2006.05477 [cs.CL]。
Polosukhin, Illia; Kaiser, Lukasz; Gomez, Aidan N.; Jones, Llion; Uszkoreit, Jakob; Parmar, Niki; Shazeer, Noam; Vaswani, Ashish (12 June 2017). "Attention Is All You Need". arXiv:1706.03762 [cs.CL]。
Bahdanau, Dzmitry; Cho, Kyunghyun; Bengio, Yoshua (1 September 2014). "Neural Machine Translation by Jointly Learning to Align and Translate". arXiv:1409.0473 [cs.CL]。
Luong, Minh-Thang; Pham, Hieu; Manning, Christopher D. (17 August 2015). "Effective Approaches to Attention-based Neural Machine Translation". arXiv:1508.04025 [cs.CL]。
Brown, Tom B.; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish; Askell, Amanda; Agarwal, Sandhini; Herbert-Voss, Ariel; Krueger, Gretchen; Henighan, Tom; Child, Rewon; Ramesh, Aditya; Ziegler, Daniel M.; Wu, Jeffrey; Winter, Clemens; Hesse, Christopher; Chen, Mark; Sigler, Eric; Litwin, Mateusz; Gray, Scott; Chess, Benjamin; Clark, Jack; Berner, Christopher; McCandlish, Sam; Radford, Alec; Sutskever, Ilya; Amodei, Dario (22 July 2020). "Language Models are Few-Shot Learners". arXiv:2005.14165 [cs.CL]。
Zhu, Yukun; Kiros, Ryan; Zemel, Rich; Salakhutdinov, Ruslan; Urtasun, Raquel; Torralba, Antonio; Fidler, Sanja (2015). Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books. pp. 19–27. arXiv:1506.06724.
Zhu, Yukun; Kiros, Ryan; Zemel, Richard; Salakhutdinov, Ruslan; Urtasun, Raquel; Torralba, Antonio; Fidler, Sanja (22 June 2015). "Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books". arXiv:1506.06724 [cs.CV]. # of books: 11,038 / # of sentences: 74,004,228 / # of words: 984,846,357 / mean # of words per sentence: 13 / median # of words per sentence: 11
Lai, Guokun; Xie, Qizhe; Hanxiao, Liu; Yang, Yiming; Hovy, Eduard (15 April 2017). "RACE: Large-scale ReAding Comprehension Dataset From Examinations". arXiv:1704.04683 [cs.CL]。
Wang, Alex; Singh, Amanpreet; Michael, Julian; Hill, Felix; Levy, Omar; Bowman, Samuel R. (20 April 2018). "GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding". arXiv:1804.07461 [cs.CL]。
Trinh, Trieu H.; Le, Quoc V. (7 June 2018). "A Simple Method for Commonsense Reasoning". arXiv:1806.02847 [cs.CL]。

berkeley.edu

aima.cs.berkeley.edu

Russell, Stuart J.; Norvig, Peter (2003), Artificial Intelligence: A Modern Approach (2nd ed.), Upper Saddle River, New Jersey: Prentice Hall, p. 24, ISBN 0-13-790395-2, オリジナルの2011-02-28時点におけるアーカイブ。 2021年1月12日閲覧, ""Overall, the AI industry boomed from a few million dollars in 1980 to billions of dollars in 1988. Soon after that came a period called the 'AI Winter'""

bham.ac.uk

cs.bham.ac.uk

Hancox, P.J. (26 January 1996). “SEM1A5 – Part 1 – A brief history of NLP”. University of Birmingham. 13 January 2021時点のオリジナルよりアーカイブ。12 January 2021閲覧。
Hancox, P.J. (26 January 1996). “SEM1A5 – Part 1 – The state-of-the-art”. University of Birmingham. 16 January 2021時点のオリジナルよりアーカイブ。12 January 2021閲覧。

cmu.edu

cs.cmu.edu

Tsvetkov, Yulia (22 June 2017). “Opportunities and Challenges in Working with Low-Resource Languages”. Carnegie Mellon University. 31 March 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。

colah.github.io

Olah, Chris (27 August 2015). “Understanding LSTM Networks”. 1 August 2017時点のオリジナルよりアーカイブ。22 January 2021閲覧。

creativeengines.ai

“CreativeEngines”. June 25, 2021閲覧。

cv-foundation.org

Zhu, Yukun; Kiros, Ryan; Zemel, Rich; Salakhutdinov, Ruslan; Urtasun, Raquel; Torralba, Antonio; Fidler, Sanja (2015). Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books. pp. 19–27. arXiv:1506.06724.

deeplearningbook.org

Goodfellow, Ian; Bengio, Yoshua; Courville, Aaron (2016). “6.5 Back-Propagation and Other Differentiation Algorithms”. Deep Learning. MIT Press. pp. 200–220. ISBN 9780262035613. オリジナルの2018-01-27時点におけるアーカイブ。 2021年3月14日閲覧。

distill.pub

Olah, Chris; Carter, Shan (8 September 2016). “Attention and Augmented Recurrent Neural Networks”. Distill 1 (9). doi:10.23915/distill.00001. オリジナルの22 December 2020時点におけるアーカイブ。 22 January 2021閲覧。.

doi.org

Olah, Chris; Carter, Shan (8 September 2016). “Attention and Augmented Recurrent Neural Networks”. Distill 1 (9). doi:10.23915/distill.00001. オリジナルの22 December 2020時点におけるアーカイブ。 22 January 2021閲覧。.
Turing, Alan (October 1950), "Computing Machinery and Intelligence", Mind, LIX (236): 433–460, doi:10.1093/mind/LIX.236.433, ISSN 0026-4423。
Samuel, Arthur (1959). “Some Studies in Machine Learning Using the Game of Checkers”. IBM Journal of Research and Development 3 (3): 210–229. doi:10.1147/rd.33.0210.
Hutchins, John (1997). “From first conception to first demonstration: the nascent years of machine translation, 1947–1954. A chronology.”. Machine Translation 12, 195–252 12 (3): 195–252. doi:10.1023/A:1007969630568.
Weizenbaum, Joseph (January 1966), “ELIZA – A Computer Program For the Study of Natural Language Communication Between Man And Machine”, Communications of the ACM 9 (1): 36–45, doi:10.1145/365153.365168
Bassett, Caroline (2019). “The computational therapeutic: exploring Weizenbaum's ELIZA as a history of the present”. AI & Society 34 (4): 803–812. doi:10.1007/s00146-018-0825-9.
Olazaran, Mikel (1996). “A Sociological Study of the Official History of the Perceptrons Controversy”. Social Studies of Science 26 (3): 611–659. doi:10.1177/030631296026003005. JSTOR 285702.
Rumelhart, David E.; Hinton, Geoffrey E.; Williams, Ronald J. (1986a). “Learning representations by back-propagating errors”. Nature 323 (6088): 533–536. Bibcode: 1986Natur.323..533R. doi:10.1038/323533a0.
LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey (2015). “Deep learning”. Nature 521 (7553): 436–444. Bibcode: 2015Natur.521..436L. doi:10.1038/nature14539. PMID 26017442.
Sepp Hochreiter; Jürgen Schmidhuber (1997). “Long short-term memory”. Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. オリジナルの2021-01-22時点におけるアーカイブ。 2021年1月20日閲覧。.
Graves, A.; Liwicki, M.; Fernández, S.; Bertolami, R.; Bunke, H.; Schmidhuber, J. (May 2009). “A Novel Connectionist System for Unconstrained Handwriting Recognition”. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (5): 855–868. doi:10.1109/tpami.2008.137. ISSN 0162-8828. PMID 19299860.
Märgner, Volker; Abed, Haikal El (July 2009). “ICDAR 2009 Arabic Handwriting Recognition Competition”. 2009 10th International Conference on Document Analysis and Recognition: 1383–1387. doi:10.1109/ICDAR.2009.256. ISBN 978-1-4244-4500-4.
Wolf, Thomas; Debut, Lysandre; Sanh, Victor; Chaumond, Julien; Delangue, Clement; Moi, Anthony; Cistac, Pierric; Rault, Tim et al. (2020). “Transformers: State-of-the-Art Natural Language Processing”. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. pp. 38–45. doi:10.18653/v1/2020.emnlp-demos.6
Köbis, Nils; Mossink, Luca D. (1 January 2021). “Artificial intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry”. Computers in Human Behavior 114: 106553. doi:10.1016/j.chb.2020.106553.

ed.ac.uk

dai.ed.ac.uk

Howe, J. (November 1994). “Artificial Intelligence at Edinburgh University : a Perspective”. 17 August 2007時点のオリジナルよりアーカイブ。30 August 2007閲覧。 “Lighthill's [1973] report provoked a massive loss of confidence in AI by the academic establishment in the UK (and to a lesser extent in the US). It persisted for a decade ― the so-called 'AI Winter'”

gizmodo.com

Nelius, Joanna (3 August 2020). “This AI-Powered Choose-Your-Own-Adventure Text Game Is Super Fun and Makes No Sense”. Gizmodo. 28 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

handle.net

hdl.handle.net

Winograd, Terry (1971-01-01) (英語). Procedures as a Representation for Data in a Computer Program for Understanding Natural Language. hdl:1721.1/7095. オリジナルの2021-01-13時点におけるアーカイブ。 2021年1月12日閲覧。.

harvard.edu

ui.adsabs.harvard.edu

Rumelhart, David E.; Hinton, Geoffrey E.; Williams, Ronald J. (1986a). “Learning representations by back-propagating errors”. Nature 323 (6088): 533–536. Bibcode: 1986Natur.323..533R. doi:10.1038/323533a0.
LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey (2015). “Deep learning”. Nature 521 (7553): 436–444. Bibcode: 2015Natur.521..436L. doi:10.1038/nature14539. PMID 26017442.

huggingface.co

transformer.huggingface.co

“Write With Transformer”. December 4, 2019閲覧。

ieice.org

search.ieice.org

Fukushima, Kunihiko「位置ずれに影響されないパターン認識機構の神経回路のモデル --- ネオコグニトロン ---」『Trans. IECE』J62-A第10号、October 1979、658–665頁、オリジナルの2021年1月28日時点におけるアーカイブ、2021年1月20日閲覧。

jstor.org

Olazaran, Mikel (1996). “A Sociological Study of the Official History of the Perceptrons Controversy”. Social Studies of Science 26 (3): 611–659. doi:10.1177/030631296026003005. JSTOR 285702.

mit.edu

dspace.mit.edu

Winograd, Terry (1971-01-01) (英語). Procedures as a Representation for Data in a Computer Program for Understanding Natural Language. hdl:1721.1/7095. オリジナルの2021-01-13時点におけるアーカイブ。 2021年1月12日閲覧。.

nih.gov

pubmed.ncbi.nlm.nih.gov

LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey (2015). “Deep learning”. Nature 521 (7553): 436–444. Bibcode: 2015Natur.521..436L. doi:10.1038/nature14539. PMID 26017442.
Sepp Hochreiter; Jürgen Schmidhuber (1997). “Long short-term memory”. Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. オリジナルの2021-01-22時点におけるアーカイブ。 2021年1月20日閲覧。.
Graves, A.; Liwicki, M.; Fernández, S.; Bertolami, R.; Bunke, H.; Schmidhuber, J. (May 2009). “A Novel Connectionist System for Unconstrained Handwriting Recognition”. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (5): 855–868. doi:10.1109/tpami.2008.137. ISSN 0162-8828. PMID 19299860.

nips.cc

papers.nips.cc

ゼップ・ホッフライター; ユルゲン・シュミットフーバー (1997年), “LSTM can Solve Hard Long Time Lag Problems” (英語), Advances in Neural Information Processing Systems 9, Advances in Neural Information Processing Systems , Wikidata Q77698282

openai.com

“Better Language Models and Their Implications”. OpenAI (14 February 2019). 19 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
“GPT-2: 1.5B Release” (英語). OpenAI (2019年11月5日). 2019年11月14日時点のオリジナルよりアーカイブ。2019年11月14日閲覧。

cdn.openai.com

Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilua (14 February 2019). Language models are unsupervised multitask learners. 1. オリジナルの6 February 2021時点におけるアーカイブ。 19 December 2020閲覧。.
“Improving Language Understanding by Generative Pre-Training”. OpenAI. pp. 12 (11 June 2018). 26 January 2021時点のオリジナルよりアーカイブ。23 January 2021閲覧。

researchgate.net

Sepp Hochreiter; Jürgen Schmidhuber (1997). “Long short-term memory”. Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. オリジナルの2021-01-22時点におけるアーカイブ。 2021年1月20日閲覧。.

sciencehistory.org

Nye, Mary Jo (2016). “Speaking in Tongues: Science's centuries-long hunt for a common language”. Distillations 2 (1): 40–43. オリジナルの3 August 2020時点におけるアーカイブ。 22 March 2018閲覧。.

semanticscholar.org

api.semanticscholar.org

John Hutchins. The first public demonstration of machine translation: the Georgetown-IBM system, 7th January 1954 (PDF) (Report). S2CID 132677。

stanford.edu

hci.stanford.edu

“SHRDLU”. Stanford Human-Computer Interaction (HCI) Group. 2020年8月16日時点のオリジナルよりアーカイブ。2021年1月12日閲覧。

syncedreview.com

“The Staggering Cost of Training SOTA AI Models”. Synced (27 June 2019). 24 November 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。

talktotransformer.com

“Talk to Transformer”. December 4, 2019閲覧。

techcrunch.com

Ha, Anthony (4 February 2021). “AI Dungeon-maker Latitude raises $3.3M to build games with 'infinite' story possibilities”. TechCrunch. 21 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

technologyreview.com

Hao, Karen (September 23, 2020). “OpenAI is giving Microsoft exclusive access to its GPT-3 language model” (英語). MIT Technology Review 2020年9月25日閲覧. ""The companies say OpenAI will continue to offer its public-facing API, which allows chosen users to send text to GPT-3 or OpenAI’s other models and receive its output. Only Microsoft, however, will have access to GPT-3’s underlying code, allowing it to embed, repurpose, and modify the model as it pleases.""
“An AI is training counselors to deal with teens in crisis”. MIT Technology Review (26 February 2021). 27 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

thegradient.pub

Zhang, Hugh (19 February 2019). “OpenAI: Please Open Source Your Language Model”. The Gradient. 28 January 2021時点のオリジナルよりアーカイブ。28 February 2021閲覧。

theguardian.com

Hern, Alex (14 February 2019). “New AI fake text generator may be too dangerous to release, say creators”. The Guardian. 14 February 2019時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Schwartz, Oscar (4 July 2019). “Could 'fake text' be the next global political threat?”. The Guardian. オリジナルの16 July 2019時点におけるアーカイブ。 16 July 2019閲覧。

theregister.com

Quach, Katyanna (14 February 2019). “Roses are red, this is sublime: We fed OpenAI's latest chat bot a classic Reg headline”. The Register. 9 March 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

theverge.com

Vincent, James (7 November 2019). “OpenAI has published the text-generating AI it said was too dangerous to share”. The Verge. 11 June 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Vincent, James (14 February 2019). “OpenAI's new multitalented AI writes, translates, and slanders”. The Verge. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Vincent, James (21 February 2019). “AI researchers debate the ethics of sharing potentially harmful programs”. The Verge. 9 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Vincent, James (6 June 2019). “There's a subreddit populated entirely by AI personifications of other subreddits”. The Verge. 21 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Vincent, James (24 July 2019). “This AI-powered autocompletion software is Gmail's Smart Compose for coders”. The Verge. 9 March 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

towardsdatascience.com

Kaiser, Caleb (31 January 2020). “Too big to deploy: How GPT-2 is breaking servers”. Towards Data Science. 15 February 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Bajpai, Akash (23 February 2019). “Recurrent Neural Networks: Deep Learning for NLP”. Towards Data Science. 19 January 2021閲覧。

unive.it

open.unive.it

John Hutchins. The first public demonstration of machine translation: the Georgetown-IBM system, 7th January 1954 (PDF) (Report). S2CID 132677。

unsw.edu.au

cse.unsw.edu.au

Wilson, Bill (24 June 2012). “The Machine Learning Dictionary”. www.cse.unsw.edu.au. 26 August 2018時点のオリジナルよりアーカイブ。19 January 2021閲覧。

usejournal.com

blog.usejournal.com

“OpenGPT-2: We Replicated GPT-2 Because You Can Too”. Noteworthy (22 August 2019). 27 February 2021閲覧。

usgamer.net

Olson, Mathew (17 December 2019). “AI Dungeon 2, the Text Adventure Where You Can do Nearly Anything, Is Now on Mobile”. 20 September 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。

venturebeat.com

Johnson, Khari (20 August 2019). “OpenAI releases curtailed version of GPT-2 language model”. VentureBeat. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Wiggers, Kyle (23 March 2020). “Google open-sources framework that reduces AI training costs by up to 80%”. VentureBeat. 26 November 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。

vox.com

Piper, Kelsey (15 May 2019). “A poetry-writing AI has just been unveiled. It's ... pretty good.”. Vox. 7 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Piper, Kelsey (14 February 2019). “An AI helped us write this article”. Vox. 8 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。

web.archive.org

Piper, Kelsey (15 May 2019). “A poetry-writing AI has just been unveiled. It's ... pretty good.”. Vox. 7 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Johnson, Khari (20 August 2019). “OpenAI releases curtailed version of GPT-2 language model”. VentureBeat. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Vincent, James (7 November 2019). “OpenAI has published the text-generating AI it said was too dangerous to share”. The Verge. 11 June 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
“Better Language Models and Their Implications”. OpenAI (14 February 2019). 19 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Kaiser, Caleb (31 January 2020). “Too big to deploy: How GPT-2 is breaking servers”. Towards Data Science. 15 February 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Hern, Alex (14 February 2019). “New AI fake text generator may be too dangerous to release, say creators”. The Guardian. 14 February 2019時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilua (14 February 2019). Language models are unsupervised multitask learners. 1. オリジナルの6 February 2021時点におけるアーカイブ。 19 December 2020閲覧。.
“Improving Language Understanding by Generative Pre-Training”. OpenAI. pp. 12 (11 June 2018). 26 January 2021時点のオリジナルよりアーカイブ。23 January 2021閲覧。
Olah, Chris; Carter, Shan (8 September 2016). “Attention and Augmented Recurrent Neural Networks”. Distill 1 (9). doi:10.23915/distill.00001. オリジナルの22 December 2020時点におけるアーカイブ。 22 January 2021閲覧。.
“GPT-2: 1.5B Release” (英語). OpenAI (2019年11月5日). 2019年11月14日時点のオリジナルよりアーカイブ。2019年11月14日閲覧。
Arram (July 9, 2020). “GPT-3: An AI that's eerily good at writing almost anything”. Arram Sabeti. July 20, 2020時点のオリジナルよりアーカイブ。July 31, 2020閲覧。
Hancox, P.J. (26 January 1996). “SEM1A5 – Part 1 – A brief history of NLP”. University of Birmingham. 13 January 2021時点のオリジナルよりアーカイブ。12 January 2021閲覧。
Nye, Mary Jo (2016). “Speaking in Tongues: Science's centuries-long hunt for a common language”. Distillations 2 (1): 40–43. オリジナルの3 August 2020時点におけるアーカイブ。 22 March 2018閲覧。.
Winograd, Terry (1971-01-01) (英語). Procedures as a Representation for Data in a Computer Program for Understanding Natural Language. hdl:1721.1/7095. オリジナルの2021-01-13時点におけるアーカイブ。 2021年1月12日閲覧。.
“SHRDLU”. Stanford Human-Computer Interaction (HCI) Group. 2020年8月16日時点のオリジナルよりアーカイブ。2021年1月12日閲覧。
Hancox, P.J. (26 January 1996). “SEM1A5 – Part 1 – The state-of-the-art”. University of Birmingham. 16 January 2021時点のオリジナルよりアーカイブ。12 January 2021閲覧。
Howe, J. (November 1994). “Artificial Intelligence at Edinburgh University : a Perspective”. 17 August 2007時点のオリジナルよりアーカイブ。30 August 2007閲覧。 “Lighthill's [1973] report provoked a massive loss of confidence in AI by the academic establishment in the UK (and to a lesser extent in the US). It persisted for a decade ― the so-called 'AI Winter'”
Russell, Stuart J.; Norvig, Peter (2003), Artificial Intelligence: A Modern Approach (2nd ed.), Upper Saddle River, New Jersey: Prentice Hall, p. 24, ISBN 0-13-790395-2, オリジナルの2011-02-28時点におけるアーカイブ。 2021年1月12日閲覧, ""Overall, the AI industry boomed from a few million dollars in 1980 to billions of dollars in 1988. Soon after that came a period called the 'AI Winter'""
Wilson, Bill (24 June 2012). “The Machine Learning Dictionary”. www.cse.unsw.edu.au. 26 August 2018時点のオリジナルよりアーカイブ。19 January 2021閲覧。
Goodfellow, Ian; Bengio, Yoshua; Courville, Aaron (2016). “6.5 Back-Propagation and Other Differentiation Algorithms”. Deep Learning. MIT Press. pp. 200–220. ISBN 9780262035613. オリジナルの2018-01-27時点におけるアーカイブ。 2021年3月14日閲覧。
Fukushima, Kunihiko「位置ずれに影響されないパターン認識機構の神経回路のモデル --- ネオコグニトロン ---」『Trans. IECE』J62-A第10号、October 1979、658–665頁、オリジナルの2021年1月28日時点におけるアーカイブ、2021年1月20日閲覧。
Sepp Hochreiter; Jürgen Schmidhuber (1997). “Long short-term memory”. Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. オリジナルの2021-01-22時点におけるアーカイブ。 2021年1月20日閲覧。.
Olah, Chris (27 August 2015). “Understanding LSTM Networks”. 1 August 2017時点のオリジナルよりアーカイブ。22 January 2021閲覧。
“N-gram Counts and Language Models from the Common Crawl”. pp. 3579–3584 (May 2014). 28 January 2021時点のオリジナルよりアーカイブ。22 January 2021閲覧。
Tsvetkov, Yulia (22 June 2017). “Opportunities and Challenges in Working with Low-Resource Languages”. Carnegie Mellon University. 31 March 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。
“A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference”. Association for Computational Linguistics (1 June 2018). 11 February 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。 “At 433k examples, this resource is one of the largest corpora available for natural language inference (a.k.a. recognizing textual entailment), [...] offering data from ten distinct genres of written and spoken English [...] while supplying an explicit setting for evaluating cross-genre domain adaptation.”
“LSDSem 2017 Shared Task: The Story Cloze Test”. Association for Computational Linguistics (3 April 2017). 22 November 2020時点のオリジナルよりアーカイブ。23 January 2021閲覧。 “The LSDSem’17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choose the correct ending to the story. Successful narrative understanding (getting closer to human performance of 100%) requires systems to link various levels of semantics to commonsense knowledge.”
Quach, Katyanna (14 February 2019). “Roses are red, this is sublime: We fed OpenAI's latest chat bot a classic Reg headline”. The Register. 9 March 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
“The Staggering Cost of Training SOTA AI Models”. Synced (27 June 2019). 24 November 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Wiggers, Kyle (23 March 2020). “Google open-sources framework that reduces AI training costs by up to 80%”. VentureBeat. 26 November 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Vincent, James (14 February 2019). “OpenAI's new multitalented AI writes, translates, and slanders”. The Verge. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Piper, Kelsey (14 February 2019). “An AI helped us write this article”. Vox. 8 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Schwartz, Oscar (4 July 2019). “Could 'fake text' be the next global political threat?”. The Guardian. オリジナルの16 July 2019時点におけるアーカイブ。 16 July 2019閲覧。
Vincent, James (21 February 2019). “AI researchers debate the ethics of sharing potentially harmful programs”. The Verge. 9 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Zhang, Hugh (19 February 2019). “OpenAI: Please Open Source Your Language Model”. The Gradient. 28 January 2021時点のオリジナルよりアーカイブ。28 February 2021閲覧。
Vincent, James (6 June 2019). “There's a subreddit populated entirely by AI personifications of other subreddits”. The Verge. 21 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Vincent, James (24 July 2019). “This AI-powered autocompletion software is Gmail's Smart Compose for coders”. The Verge. 9 March 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Olson, Mathew (17 December 2019). “AI Dungeon 2, the Text Adventure Where You Can do Nearly Anything, Is Now on Mobile”. 20 September 2020時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Nelius, Joanna (3 August 2020). “This AI-Powered Choose-Your-Own-Adventure Text Game Is Super Fun and Makes No Sense”. Gizmodo. 28 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
Ha, Anthony (4 February 2021). “AI Dungeon-maker Latitude raises $3.3M to build games with 'infinite' story possibilities”. TechCrunch. 21 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。
“An AI is training counselors to deal with teens in crisis”. MIT Technology Review (26 February 2021). 27 February 2021時点のオリジナルよりアーカイブ。27 February 2021閲覧。

wikidata.org

ゼップ・ホッフライター; ユルゲン・シュミットフーバー (1995年8月21日), Long Short Term Memory , Wikidata Q98967430
ゼップ・ホッフライター; ユルゲン・シュミットフーバー (1997年), “LSTM can Solve Hard Long Time Lag Problems” (英語), Advances in Neural Information Processing Systems 9, Advances in Neural Information Processing Systems , Wikidata Q77698282

wikipedia.org

en.wikipedia.org

Piper, Kelsey (15 May 2019). “A poetry-writing AI has just been unveiled. It's ... pretty good.”. Vox. 7 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Johnson, Khari (20 August 2019). “OpenAI releases curtailed version of GPT-2 language model”. VentureBeat. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Vincent, James (7 November 2019). “OpenAI has published the text-generating AI it said was too dangerous to share”. The Verge. 11 June 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
“Better Language Models and Their Implications”. OpenAI (14 February 2019). 19 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Hern, Alex (14 February 2019). “New AI fake text generator may be too dangerous to release, say creators”. The Guardian. 14 February 2019時点のオリジナルよりアーカイブ。19 December 2020閲覧。
“Improving Language Understanding by Generative Pre-Training”. OpenAI. pp. 12 (11 June 2018). 26 January 2021時点のオリジナルよりアーカイブ。23 January 2021閲覧。
Hao, Karen (September 23, 2020). “OpenAI is giving Microsoft exclusive access to its GPT-3 language model” (英語). MIT Technology Review 2020年9月25日閲覧. ""The companies say OpenAI will continue to offer its public-facing API, which allows chosen users to send text to GPT-3 or OpenAI’s other models and receive its output. Only Microsoft, however, will have access to GPT-3’s underlying code, allowing it to embed, repurpose, and modify the model as it pleases.""
Turing, Alan (October 1950), "Computing Machinery and Intelligence", Mind, LIX (236): 433–460, doi:10.1093/mind/LIX.236.433, ISSN 0026-4423。
Weizenbaum, Joseph (January 1966), “ELIZA – A Computer Program For the Study of Natural Language Communication Between Man And Machine”, Communications of the ACM 9 (1): 36–45, doi:10.1145/365153.365168
Crevier, Daniel [in 英語] (1993), AI: The Tumultuous Search for Artificial Intelligence, New York, NY: BasicBooks, ISBN 0-465-02997-3。
Sepp Hochreiter; Jürgen Schmidhuber (1997). “Long short-term memory”. Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. オリジナルの2021-01-22時点におけるアーカイブ。 2021年1月20日閲覧。.
Vincent, James (14 February 2019). “OpenAI's new multitalented AI writes, translates, and slanders”. The Verge. 18 December 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。
Piper, Kelsey (14 February 2019). “An AI helped us write this article”. Vox. 8 November 2020時点のオリジナルよりアーカイブ。19 December 2020閲覧。

worldcat.org

Turing, Alan (October 1950), "Computing Machinery and Intelligence", Mind, LIX (236): 433–460, doi:10.1093/mind/LIX.236.433, ISSN 0026-4423。

search.worldcat.org

Graves, A.; Liwicki, M.; Fernández, S.; Bertolami, R.; Bunke, H.; Schmidhuber, J. (May 2009). “A Novel Connectionist System for Unconstrained Handwriting Recognition”. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (5): 855–868. doi:10.1109/tpami.2008.137. ISSN 0162-8828. PMID 19299860.