Residual neural network (English Wikipedia)

Zhang, Aston; Lipton, Zachary; Li, Mu; Smola, Alexander J. (2024). "8.6. Residual Networks (ResNet) and ResNeXt". Dive into deep learning. Cambridge New York Port Melbourne New Delhi Singapore: Cambridge University Press. ISBN 978-1-009-38943-3.

doi.org (Global: 2^nd place; English: 2^nd place)

He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2016). Deep Residual Learning for Image Recognition (PDF). Conference on Computer Vision and Pattern Recognition. arXiv:1512.03385. doi:10.1109/CVPR.2016.90.
Deng, Jia; Dong, Wei; Socher, Richard; Li, Li-Jia; Li, Kai; Li, Fei-Fei (2009). ImageNet: A large-scale hierarchical image database. Conference on Computer Vision and Pattern Recognition. doi:10.1109/CVPR.2009.5206848.
Sepp Hochreiter; Jürgen Schmidhuber (1997). "Long short-term memory". Neural Computation. 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. S2CID 1915014.
He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2016). Identity Mappings in Deep Residual Networks (PDF). European Conference on Computer Vision. arXiv:1603.05027. doi:10.1007/978-3-319-46493-0_38.
Szegedy, Christian; Ioffe, Sergey; Vanhoucke, Vincent; Alemi, Alex (2017). Inception-v4, Inception-ResNet and the impact of residual connections on learning (PDF). AAAI Conference on Artificial Intelligence. arXiv:1602.07261. doi:10.1609/aaai.v31i1.11231.
Winding, Michael; Pedigo, Benjamin; Barnes, Christopher; Patsolic, Heather; Park, Youngser; Kazimiers, Tom; Fushiki, Akira; Andrade, Ingrid; Khandelwal, Avinash; Valdes-Aleman, Javier; Li, Feng; Randel, Nadine; Barsotti, Elizabeth; Correia, Ana; Fetter, Fetter; Hartenstein, Volker; Priebe, Carey; Vogelstein, Joshua; Cardona, Albert; Zlatic, Marta (10 Mar 2023). "The connectome of an insect brain". Science. 379 (6636) eadd9330. bioRxiv 10.1101/2022.11.28.516756v1. doi:10.1126/science.add9330. PMC 7614541. PMID 36893230. S2CID 254070919.
De N, Rafael Lorente (1938-05-01). "Analysis of the Activity of the Chains of Internuncial Neurons". Journal of Neurophysiology. 1 (3): 207–244. doi:10.1152/jn.1938.1.3.207. ISSN 0022-3077.
McCulloch, Warren S.; Pitts, Walter (1943-12-01). "A logical calculus of the ideas immanent in nervous activity". The Bulletin of Mathematical Biophysics. 5 (4): 115–133. doi:10.1007/BF02478259. ISSN 1522-9602.
Felix A. Gers; Jürgen Schmidhuber; Fred Cummins (2000). "Learning to Forget: Continual Prediction with LSTM". Neural Computation. 12 (10): 2451–2471. CiteSeerX 10.1.1.55.5709. doi:10.1162/089976600300015015. PMID 11032042. S2CID 11598600.
He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2015). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification (PDF). International Conference on Computer Vision. arXiv:1502.01852. doi:10.1109/ICCV.2015.123.
Huang, Gao; Liu, Zhuang; van der Maaten, Laurens; Weinberger, Kilian (2017). Densely Connected Convolutional Networks (PDF). Conference on Computer Vision and Pattern Recognition. arXiv:1608.06993. doi:10.1109/CVPR.2017.243.
Huang, Gao; Sun, Yu; Liu, Zhuang; Weinberger, Kilian (2016). Deep Networks with Stochastic Depth (PDF). European Conference on Computer Vision. arXiv:1603.09382. doi:10.1007/978-3-319-46493-0_39.
Lee, Youngwan; Kim, Jonghee; Willette, Jeffrey; Hwang, Sung Ju (2022). MPViT: Multi-Path Vision Transformer for Dense Prediction (PDF). Conference on Computer Vision and Pattern Recognition. pp. 7287–7296. arXiv:2112.11010. doi:10.1109/CVPR52688.2022.00714.
Xie, Saining; Girshick, Ross; Dollar, Piotr; Tu, Zhuowen; He, Kaiming (2017). Aggregated Residual Transformations for Deep Neural Networks (PDF). Conference on Computer Vision and Pattern Recognition. pp. 1492–1500. arXiv:1611.05431. doi:10.1109/CVPR.2017.634.
Hu, Jie; Shen, Li; Sun, Gang (2018). Squeeze-and-Excitation Networks (PDF). Conference on Computer Vision and Pattern Recognition. pp. 7132–7141. arXiv:1709.01507. doi:10.1109/CVPR.2018.00745.

ethz.ch (Global: 2,224^th place; English: 1,900^th place)

safari.ethz.ch

Rosenblatt, Frank (1961). Principles of neurodynamics. perceptrons and the theory of brain mechanisms (PDF).

gwern.net (Global: low place; English: 9,044^th place)

Lang, Kevin; Witbrock, Michael (1988). "Learning to tell two spirals apart" (PDF). Proceedings of the 1988 Connectionist Models Summer School: 52–59.

image-net.org (Global: low place; English: low place)

"ILSVRC2015 Results". image-net.org.
Jie, Hu (2017). Squeeze-and-Excitation Networks (PDF). Beyond ImageNet Large Scale Visual Recognition Challenge, Workshop at CVPR 2017 (Presentation).

jku.at (Global: low place; English: low place)

bioinf.jku.at

Hochreiter, Sepp (1991). Untersuchungen zu dynamischen neuronalen Netzen (PDF) (diploma thesis). Technical University Munich, Institute of Computer Science, advisor: J. Schmidhuber.

jmlr.org (Global: low place; English: low place)

Bengio, Yoshua; Ducharme, Réjean; Vincent, Pascal; Jauvin, Christian (2003). "A Neural Probabilistic Language Model". Journal of Machine Learning Research. 3 (Feb): 1137–1155. ISSN 1533-7928.

microsoft.com (Global: 153^rd place; English: 151^st place)

blogs.microsoft.com

Linn, Allison (2015-12-10). "Microsoft researchers win ImageNet computer vision challenge". The AI Blog. Retrieved 2024-06-29.

mlr.press (Global: low place; English: low place)

proceedings.mlr.press

Dong, Yihe; Cordonnier, Jean-Baptiste; Loukas, Andreas (2021). Attention is not all you need: pure attention loses rank doubly exponentially with depth (PDF). International Conference on Machine Learning. PMLR. pp. 2793–2803. arXiv:2103.03404.

neurips.cc (Global: low place; English: low place)

proceedings.neurips.cc

Hanin, Boris; Rolnick, David (2018). How to Start Training: The Effect of Initialization and Architecture (PDF). Conference on Neural Information Processing Systems. Vol. 31. Curran Associates, Inc. arXiv:1803.01719.
Srivastava, Rupesh Kumar; Greff, Klaus; Schmidhuber, Jürgen (2015). Training Very Deep Networks (PDF). Conference on Neural Information Processing Systems. arXiv:1507.06228.

nih.gov (Global: 4^th place; English: 4^th place)

pubmed.ncbi.nlm.nih.gov

Sepp Hochreiter; Jürgen Schmidhuber (1997). "Long short-term memory". Neural Computation. 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. S2CID 1915014.
Winding, Michael; Pedigo, Benjamin; Barnes, Christopher; Patsolic, Heather; Park, Youngser; Kazimiers, Tom; Fushiki, Akira; Andrade, Ingrid; Khandelwal, Avinash; Valdes-Aleman, Javier; Li, Feng; Randel, Nadine; Barsotti, Elizabeth; Correia, Ana; Fetter, Fetter; Hartenstein, Volker; Priebe, Carey; Vogelstein, Joshua; Cardona, Albert; Zlatic, Marta (10 Mar 2023). "The connectome of an insect brain". Science. 379 (6636) eadd9330. bioRxiv 10.1101/2022.11.28.516756v1. doi:10.1126/science.add9330. PMC 7614541. PMID 36893230. S2CID 254070919.
Felix A. Gers; Jürgen Schmidhuber; Fred Cummins (2000). "Learning to Forget: Continual Prediction with LSTM". Neural Computation. 12 (10): 2451–2471. CiteSeerX 10.1.1.55.5709. doi:10.1162/089976600300015015. PMID 11032042. S2CID 11598600.

ncbi.nlm.nih.gov

Winding, Michael; Pedigo, Benjamin; Barnes, Christopher; Patsolic, Heather; Park, Youngser; Kazimiers, Tom; Fushiki, Akira; Andrade, Ingrid; Khandelwal, Avinash; Valdes-Aleman, Javier; Li, Feng; Randel, Nadine; Barsotti, Elizabeth; Correia, Ana; Fetter, Fetter; Hartenstein, Volker; Priebe, Carey; Vogelstein, Joshua; Cardona, Albert; Zlatic, Marta (10 Mar 2023). "The connectome of an insect brain". Science. 379 (6636) eadd9330. bioRxiv 10.1101/2022.11.28.516756v1. doi:10.1126/science.add9330. PMC 7614541. PMID 36893230. S2CID 254070919.

openai.com (Global: 1,559^th place; English: 1,155^th place)

cdn.openai.com

Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilya (14 February 2019). "Language models are unsupervised multitask learners" (PDF). Archived (PDF) from the original on 6 February 2021. Retrieved 19 December 2020.

physiology.org (Global: 5,293^rd place; English: 7,651^st place)

De N, Rafael Lorente (1938-05-01). "Analysis of the Activity of the Chains of Internuncial Neurons". Journal of Neurophysiology. 1 (3): 207–244. doi:10.1152/jn.1938.1.3.207. ISSN 0022-3077.

psu.edu (Global: 207^th place; English: 136^th place)

citeseerx.ist.psu.edu

Felix A. Gers; Jürgen Schmidhuber; Fred Cummins (2000). "Learning to Forget: Continual Prediction with LSTM". Neural Computation. 12 (10): 2451–2471. CiteSeerX 10.1.1.55.5709. doi:10.1162/089976600300015015. PMID 11032042. S2CID 11598600.

researchgate.net (Global: 120^th place; English: 125^th place)

Sepp Hochreiter; Jürgen Schmidhuber (1997). "Long short-term memory". Neural Computation. 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. S2CID 1915014.

semanticscholar.org (Global: 11^th place; English: 8^th place)

api.semanticscholar.org

Sepp Hochreiter; Jürgen Schmidhuber (1997). "Long short-term memory". Neural Computation. 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735. PMID 9377276. S2CID 1915014.
Winding, Michael; Pedigo, Benjamin; Barnes, Christopher; Patsolic, Heather; Park, Youngser; Kazimiers, Tom; Fushiki, Akira; Andrade, Ingrid; Khandelwal, Avinash; Valdes-Aleman, Javier; Li, Feng; Randel, Nadine; Barsotti, Elizabeth; Correia, Ana; Fetter, Fetter; Hartenstein, Volker; Priebe, Carey; Vogelstein, Joshua; Cardona, Albert; Zlatic, Marta (10 Mar 2023). "The connectome of an insect brain". Science. 379 (6636) eadd9330. bioRxiv 10.1101/2022.11.28.516756v1. doi:10.1126/science.add9330. PMC 7614541. PMID 36893230. S2CID 254070919.
Felix A. Gers; Jürgen Schmidhuber; Fred Cummins (2000). "Learning to Forget: Continual Prediction with LSTM". Neural Computation. 12 (10): 2451–2471. CiteSeerX 10.1.1.55.5709. doi:10.1162/089976600300015015. PMID 11032042. S2CID 11598600.

springer.com (Global: 274^th place; English: 309^th place)

link.springer.com

He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2016). Identity Mappings in Deep Residual Networks (PDF). European Conference on Computer Vision. arXiv:1603.05027. doi:10.1007/978-3-319-46493-0_38.
McCulloch, Warren S.; Pitts, Walter (1943-12-01). "A logical calculus of the ideas immanent in nervous activity". The Bulletin of Mathematical Biophysics. 5 (4): 115–133. doi:10.1007/BF02478259. ISSN 1522-9602.
Huang, Gao; Sun, Yu; Liu, Zhuang; Weinberger, Kilian (2016). Deep Networks with Stochastic Depth (PDF). European Conference on Computer Vision. arXiv:1603.09382. doi:10.1007/978-3-319-46493-0_39.

thecvf.com (Global: low place; English: low place)

openaccess.thecvf.com

He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2016). Deep Residual Learning for Image Recognition (PDF). Conference on Computer Vision and Pattern Recognition. arXiv:1512.03385. doi:10.1109/CVPR.2016.90.
He, Kaiming; Zhang, Xiangyu; Ren, Shaoqing; Sun, Jian (2015). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification (PDF). International Conference on Computer Vision. arXiv:1502.01852. doi:10.1109/ICCV.2015.123.
Huang, Gao; Liu, Zhuang; van der Maaten, Laurens; Weinberger, Kilian (2017). Densely Connected Convolutional Networks (PDF). Conference on Computer Vision and Pattern Recognition. arXiv:1608.06993. doi:10.1109/CVPR.2017.243.
Lee, Youngwan; Kim, Jonghee; Willette, Jeffrey; Hwang, Sung Ju (2022). MPViT: Multi-Path Vision Transformer for Dense Prediction (PDF). Conference on Computer Vision and Pattern Recognition. pp. 7287–7296. arXiv:2112.11010. doi:10.1109/CVPR52688.2022.00714.
Xie, Saining; Girshick, Ross; Dollar, Piotr; Tu, Zhuowen; He, Kaiming (2017). Aggregated Residual Transformations for Deep Neural Networks (PDF). Conference on Computer Vision and Pattern Recognition. pp. 1492–1500. arXiv:1611.05431. doi:10.1109/CVPR.2017.634.
Hu, Jie; Shen, Li; Sun, Gang (2018). Squeeze-and-Excitation Networks (PDF). Conference on Computer Vision and Pattern Recognition. pp. 7132–7141. arXiv:1709.01507. doi:10.1109/CVPR.2018.00745.

web.archive.org (Global: 1^st place; English: 1^st place)

Radford, Alec; Wu, Jeffrey; Child, Rewon; Luan, David; Amodei, Dario; Sutskever, Ilya (14 February 2019). "Language models are unsupervised multitask learners" (PDF). Archived (PDF) from the original on 6 February 2021. Retrieved 19 December 2020.

worldcat.org (Global: 5^th place; English: 5^th place)

search.worldcat.org

De N, Rafael Lorente (1938-05-01). "Analysis of the Activity of the Chains of Internuncial Neurons". Journal of Neurophysiology. 1 (3): 207–244. doi:10.1152/jn.1938.1.3.207. ISSN 0022-3077.
McCulloch, Warren S.; Pitts, Walter (1943-12-01). "A logical calculus of the ideas immanent in nervous activity". The Bulletin of Mathematical Biophysics. 5 (4): 115–133. doi:10.1007/BF02478259. ISSN 1522-9602.
Bengio, Yoshua; Ducharme, Réjean; Vincent, Pascal; Jauvin, Christian (2003). "A Neural Probabilistic Language Model". Journal of Machine Learning Research. 3 (Feb): 1137–1155. ISSN 1533-7928.

Residual neural network (English Wikipedia)

aaai.org (Global: 9,352nd place; English: 5,696th place)

cdn.aaai.org

arxiv.org (Global: 69th place; English: 59th place)

books.google.com (Global: 3rd place; English: 3rd place)

d2l.ai (Global: low place; English: low place)

doi.org (Global: 2nd place; English: 2nd place)

ethz.ch (Global: 2,224th place; English: 1,900th place)

safari.ethz.ch

gwern.net (Global: low place; English: 9,044th place)

image-net.org (Global: low place; English: low place)

jku.at (Global: low place; English: low place)

bioinf.jku.at

jmlr.org (Global: low place; English: low place)

microsoft.com (Global: 153rd place; English: 151st place)

blogs.microsoft.com

mlr.press (Global: low place; English: low place)

proceedings.mlr.press

neurips.cc (Global: low place; English: low place)

proceedings.neurips.cc

nih.gov (Global: 4th place; English: 4th place)

pubmed.ncbi.nlm.nih.gov

ncbi.nlm.nih.gov

openai.com (Global: 1,559th place; English: 1,155th place)

cdn.openai.com

physiology.org (Global: 5,293rd place; English: 7,651st place)

psu.edu (Global: 207th place; English: 136th place)

citeseerx.ist.psu.edu

researchgate.net (Global: 120th place; English: 125th place)

semanticscholar.org (Global: 11th place; English: 8th place)

api.semanticscholar.org

springer.com (Global: 274th place; English: 309th place)

link.springer.com

thecvf.com (Global: low place; English: low place)

openaccess.thecvf.com

web.archive.org (Global: 1st place; English: 1st place)

worldcat.org (Global: 5th place; English: 5th place)

search.worldcat.org

aaai.org (Global: 9,352^nd place; English: 5,696^th place)

arxiv.org (Global: 69^th place; English: 59^th place)

books.google.com (Global: 3^rd place; English: 3^rd place)

doi.org (Global: 2^nd place; English: 2^nd place)

ethz.ch (Global: 2,224^th place; English: 1,900^th place)

gwern.net (Global: low place; English: 9,044^th place)

microsoft.com (Global: 153^rd place; English: 151^st place)

nih.gov (Global: 4^th place; English: 4^th place)

openai.com (Global: 1,559^th place; English: 1,155^th place)

physiology.org (Global: 5,293^rd place; English: 7,651^st place)

psu.edu (Global: 207^th place; English: 136^th place)

researchgate.net (Global: 120^th place; English: 125^th place)

semanticscholar.org (Global: 11^th place; English: 8^th place)

springer.com (Global: 274^th place; English: 309^th place)

web.archive.org (Global: 1^st place; English: 1^st place)

worldcat.org (Global: 5^th place; English: 5^th place)