ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
1.8k
Citations
23
Influential Citations
Drug Discovery Today
Venue
2018
Year
Over the past decade, deep learning has achieved remarkable success in various artificial intelligence research areas. Evolved from the previous research on artificial neural networks, this technology has shown superior performance to other machine learning algorithms in areas such as image and voice recognition, natural language processing, among others. The first wave of applications of deep learning in pharmaceutical research has emerged in recent years, and its utility has gone beyond bioactivity predictions and has shown promise in addressing diverse problems in drug discovery. Examples will be discussed covering bioactivity prediction, de novo molecular design, synthesis prediction and biological image analysis.
This paper, published in 2018, is a seminal review that captured the early wave of deep learning applications in drug discovery. At a time when deep learning was already transforming image and speech recognition, its potential in pharmaceutical research was just beginning to be recognized. The authors, from AstraZeneca, were among the first to systematically catalog and discuss how deep learning could be applied to key challenges in drug discovery, moving beyond traditional bioactivity prediction to areas like molecular design and synthesis planning.
The paper's significance is underscored by its citation count (over 1800), indicating its role as a key reference for researchers and practitioners entering the field. It helped legitimize deep learning as a viable approach in a conservative industry, providing a roadmap for future research. By highlighting diverse applications, it broadened the scope of what was considered possible with deep learning in chemistry and biology, encouraging cross-disciplinary collaboration.
The paper's main technical contribution is its categorization and analysis of deep learning applications in four key areas:
The paper also discusses the evolution from artificial neural networks to modern deep learning architectures, emphasizing the importance of large datasets and computational resources. It provides a conceptual framework for how deep learning can be integrated into the drug discovery pipeline.
As a review, the paper does not present new experimental results but synthesizes findings from multiple studies. It reports that deep learning has demonstrated superior performance to other machine learning algorithms in various tasks, such as bioactivity prediction, where deep models often achieve higher accuracy than traditional QSAR methods. In de novo design, generative models have been shown to produce valid and novel molecules with optimized properties. For synthesis prediction, deep learning models have achieved high accuracy in predicting reaction outcomes, and in image analysis, they have enabled automated and accurate phenotypic classification.
However, the abstract does not provide specific quantitative metrics, so the paper's value lies more in its qualitative assessment and direction-setting rather than in concrete benchmarks.
The broader impact of this paper is substantial. It helped catalyze a wave of research and investment in AI-driven drug discovery, leading to the founding of numerous startups and partnerships between tech and pharma companies. It also influenced the development of more advanced deep learning models, such as graph neural networks and transformers, which have since become standard in the field. The paper's emphasis on diverse applications encouraged researchers to explore creative uses of deep learning, from protein folding prediction to clinical trial design. As a highly cited review, it continues to serve as an entry point for newcomers and a reference for experts, cementing deep learning's role as a transformative technology in pharmaceutical research.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba