Ciprian Chelba, Tomas Mikolov, Mike Schuster, Qi Ge, Thorsten Brants, Phillipp Koehn, Tony Robinson:One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling. 4.März 2014, arxiv:1312.3005.
Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer:Deep Contextualized Word Representations. In: Marilyn Walker, Heng Ji, Amanda Stent (Hrsg.): Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers). Association for Computational Linguistics, New Orleans, Louisiana Juni 2018, S.2227–2237, doi:10.18653/v1/N18-1202.
Ce Zhou, Qian Li, Chen Li, Jun Yu, Yixin Liu, Guangjing Wang, Kai Zhang, Cheng Ji, Qiben Yan, Lifang He, Hao Peng, Jianxin Li, Jia Wu, Ziwei Liu, Pengtao Xie, Caiming Xiong, Jian Pei, Philip S. Yu, Lichao Sun:A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT. In: International Journal of Machine Learning and Cybernetics. 24.November 2024, ISSN1868-8071, doi:10.1007/s13042-024-02443-6.
Aparna Sunil Kale, Vinay Pandya, Fabio Di Troia, Mark Stamp:Malware classification with Word2Vec, HMM2Vec, BERT, and ELMo. In: Journal of Computer Virology and Hacking Techniques. Band19, Nr.1, 22.April 2022, ISSN2263-8733, S.1–16, doi:10.1007/s11416-022-00424-3.
Younghoon Lee:Systematic Homonym Detection and Replacement Based on Contextual Word Embedding. In: Neural Processing Letters. Band53, Nr.1, 2021, ISSN1573-773X, S.17–36, doi:10.1007/s11063-020-10376-8.
Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, Jianfeng Gao:Deep Learning-based Text Classification: A Comprehensive Review. In: ACM Computing Surveys. Band54, Nr.3, 2021, ISSN0360-0300, S.1–40, doi:10.1145/3439726.
Oren Melamud, Jacob Goldberger, Ido Dagan:context2vec: Learning Generic Context Embedding with Bidirectional LSTM. In: Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning. Association for Computational Linguistics, Berlin, Germany August 2016, S.51–61, doi:10.18653/v1/K16-1006.
Ce Zhou, Qian Li, Chen Li, Jun Yu, Yixin Liu, Guangjing Wang, Kai Zhang, Cheng Ji, Qiben Yan, Lifang He, Hao Peng, Jianxin Li, Jia Wu, Ziwei Liu, Pengtao Xie, Caiming Xiong, Jian Pei, Philip S. Yu, Lichao Sun:A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT. In: International Journal of Machine Learning and Cybernetics. 24.November 2024, ISSN1868-8071, doi:10.1007/s13042-024-02443-6.
Aparna Sunil Kale, Vinay Pandya, Fabio Di Troia, Mark Stamp:Malware classification with Word2Vec, HMM2Vec, BERT, and ELMo. In: Journal of Computer Virology and Hacking Techniques. Band19, Nr.1, 22.April 2022, ISSN2263-8733, S.1–16, doi:10.1007/s11416-022-00424-3.
Younghoon Lee:Systematic Homonym Detection and Replacement Based on Contextual Word Embedding. In: Neural Processing Letters. Band53, Nr.1, 2021, ISSN1573-773X, S.17–36, doi:10.1007/s11063-020-10376-8.
Shervin Minaee, Nal Kalchbrenner, Erik Cambria, Narjes Nikzad, Meysam Chenaghlu, Jianfeng Gao:Deep Learning-based Text Classification: A Comprehensive Review. In: ACM Computing Surveys. Band54, Nr.3, 2021, ISSN0360-0300, S.1–40, doi:10.1145/3439726.