ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
112
Citations
5
Influential Citations
Genetic Epidemiology
Venue
2008
Year
Abstract The detection of genotypes that predict common, complex disease is a challenge for human geneticists. The phenomenon of epistasis, or gene‐gene interactions, is particularly problematic for traditional statistical techniques. Additionally, the explosion of genetic information makes exhaustive searches of multilocus combinations computationally infeasible. To address these challenges, neural networks (NN), a pattern recognition method, have been used. One limitation of the NN approach is that its success is dependent on the architecture of the network. To solve this, machine‐learning approaches have been suggested to evolve the best NN architecture for a particular data set. In this study we provide a detailed technical description of the use of grammatical evolution to optimize neural networks (GENN) for use in genetic association studies. We compare the performance of GENN to that of a previous machine‐learning NN application—genetic programming neural networks in both simulated and real data. We show that GENN greatly outperforms genetic programming neural networks in data sets with a large number of single nucleotide polymorphisms. Additionally, we demonstrate that GENN has high power to detect disease‐risk loci in a range of high‐order epistatic models. Finally, we demonstrate the scalability of the GENN method with increasing numbers of variables—as many as 500,000 single nucleotide polymorphisms. Genet. Epidemiol . 2008. © 2008 Wiley‐Liss, Inc.
This paper addresses a critical bottleneck in genetic epidemiology: detecting epistatic interactions (gene-gene interactions) that underlie common complex diseases. Traditional statistical methods struggle with the combinatorial explosion of multi-locus tests, and neural networks offer a pattern-recognition alternative. However, neural network performance is highly sensitive to architecture choices, which are often manually tuned. By introducing grammatical evolution to automatically optimize neural network architectures (GENN), the authors provide a scalable, automated solution that can handle up to 500,000 SNPs—a scale relevant to modern genome-wide association studies (GWAS). This work is significant because it bridges machine learning and genetics, offering a practical tool for discovering non-linear, high-order interactions that are missed by single-locus tests.
The key quantitative finding is that GENN greatly outperforms genetic programming neural networks in datasets with a large number of single nucleotide polymorphisms. Specifically, the paper reports high power for detecting disease-risk loci in high-order epistatic models and demonstrates scalability up to 500,000 SNPs. These results are based on both simulated data (with known ground truth) and real genetic data, providing robust evidence of GENN's effectiveness.
This work has broader implications for the AI field by demonstrating the effectiveness of grammatical evolution for neural architecture search in a high-dimensional, real-world domain. It shows that automated machine learning (AutoML) techniques can be successfully applied to genetic epidemiology, potentially enabling discoveries of complex genetic interactions that contribute to common diseases. The scalability to 500,000 SNPs also suggests that such methods could be integrated into standard GWAS pipelines, moving beyond single-locus analysis to embrace epistatic models.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba