Transformer (機械学習モデル) (Japanese Wikipedia)

Analysis of information sources in references of the Wikipedia article "Transformer (機械学習モデル)" in Japanese language version.

refsWebsite

Global rank Japanese rank

69^th place

227^th place

2googleblog.com

1,272^nd place

1,494^th place

2^nd place

6^th place

551^st place

1,605^th place

1,559^th place

1,682^nd place

low place

low place

1jalammar.github.io

low place

low place

low place

low place

low place

1,534^th place

5^th place

19^th place

aclweb.org

Clark, Kevin; Khandelwal, Urvashi; Levy, Omer; Manning, Christopher D. (August 2019). “What Does BERT Look at? An Analysis of BERT's Attention”. Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP (Florence, Italy: Association for Computational Linguistics): 276–286. doi:10.18653/v1/W19-4828.

arxiv.org

Polosukhin, Illia; Kaiser, Lukasz (12 June 2017). "Attention Is All You Need". arXiv:1706.03762 [cs.CL]。
Kitaev, Nikita; Kaiser, Łukasz. "Reformer: The Efficient Transformer". arXiv:2001.04451 [cs.LG]。
Wang, Alex; Singh, Amanpreet; Michael, Julian; Hill, Felix; Levy, Omer; Bowman, Samuel (2018). “GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding”. Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP (Stroudsburg, PA, USA: Association for Computational Linguistics): 353–355. arXiv:1804.07461. doi:10.18653/v1/w18-5446.
Noever, David; Ciolino, Matt (21 August 2020). "The Chess Transformer: Mastering Play using Generative Language Models". arXiv:2008.04057 [cs.AI]。
“An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”. 2020年11月19日閲覧。

coursera.org

“Task with long sequences”. 2020年11月20日閲覧。

doi.org

Clark, Kevin; Khandelwal, Urvashi; Levy, Omer; Manning, Christopher D. (August 2019). “What Does BERT Look at? An Analysis of BERT's Attention”. Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP (Florence, Italy: Association for Computational Linguistics): 276–286. doi:10.18653/v1/W19-4828.
Wang, Alex; Singh, Amanpreet; Michael, Julian; Hill, Felix; Levy, Omer; Bowman, Samuel (2018). “GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding”. Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP (Stroudsburg, PA, USA: Association for Computational Linguistics): 353–355. arXiv:1804.07461. doi:10.18653/v1/w18-5446.

googleblog.com

ai.googleblog.com

“Open Sourcing BERT: State-of-the-Art Pre-training for Natural Language Processing”. Google AI Blog. 2019年8月25日閲覧。
“Reformer: The Efficient Transformer” (英語). Google AI Blog. 2020年10月22日閲覧。

indico.io

“Sequence Modeling with Neural Networks (Part 2): Attention Models”. Indico (2016年4月18日). 2019年10月15日閲覧。

jalammar.github.io

Alammar. “The Illustrated Transformer”. jalammar.github.io. 2019年10月15日閲覧。

medium.com

Allard (2019年7月1日). “What is a Transformer?” (英語). Medium. 2019年10月21日閲覧。
Monsters (2017年9月26日). “10 Applications of Artificial Neural Networks in Natural Language Processing” (英語). Medium. 2019年10月21日閲覧。

openai.com

“Better Language Models and Their Implications”. OpenAI (2019年2月14日). 2019年8月25日閲覧。

worldcat.org

Yang, Zhilin Dai, Zihang Yang, Yiming Carbonell, Jaime Salakhutdinov, Ruslan Le, Quoc V. (2019-06-19). XLNet: Generalized Autoregressive Pretraining for Language Understanding. OCLC 1106350082