Preprint
Machine Learning

Comparison of approaches for machine‐learning optimization of neural networks for detecting gene‐gene interactions in genetic epidemiology

Alison A. Motsinger‐Reif, Scott M. Dudek, Lance W. Hahn, Marylyn D. Ritchie
February 8, 2008Genetic Epidemiology112 citations

112

Citations

5

Influential Citations

Genetic Epidemiology

Venue

2008

Year

Abstract

Abstract The detection of genotypes that predict common, complex disease is a challenge for human geneticists. The phenomenon of epistasis, or gene‐gene interactions, is particularly problematic for traditional statistical techniques. Additionally, the explosion of genetic information makes exhaustive searches of multilocus combinations computationally infeasible. To address these challenges, neural networks (NN), a pattern recognition method, have been used. One limitation of the NN approach is that its success is dependent on the architecture of the network. To solve this, machine‐learning approaches have been suggested to evolve the best NN architecture for a particular data set. In this study we provide a detailed technical description of the use of grammatical evolution to optimize neural networks (GENN) for use in genetic association studies. We compare the performance of GENN to that of a previous machine‐learning NN application—genetic programming neural networks in both simulated and real data. We show that GENN greatly outperforms genetic programming neural networks in data sets with a large number of single nucleotide polymorphisms. Additionally, we demonstrate that GENN has high power to detect disease‐risk loci in a range of high‐order epistatic models. Finally, we demonstrate the scalability of the GENN method with increasing numbers of variables—as many as 500,000 single nucleotide polymorphisms. Genet. Epidemiol . 2008. © 2008 Wiley‐Liss, Inc.

Analysis

Why This Paper Matters

This paper addresses a critical bottleneck in genetic epidemiology: detecting epistatic interactions (gene-gene interactions) that underlie common complex diseases. Traditional statistical methods struggle with the combinatorial explosion of multi-locus tests, and neural networks offer a pattern-recognition alternative. However, neural network performance is highly sensitive to architecture choices, which are often manually tuned. By introducing grammatical evolution to automatically optimize neural network architectures (GENN), the authors provide a scalable, automated solution that can handle up to 500,000 SNPs—a scale relevant to modern genome-wide association studies (GWAS). This work is significant because it bridges machine learning and genetics, offering a practical tool for discovering non-linear, high-order interactions that are missed by single-locus tests.

Technical Contributions

  • Grammatical Evolution for Neural Architecture Search: The paper provides a detailed technical description of using grammatical evolution (a form of genetic programming) to evolve the topology and parameters of neural networks, automating the search for optimal architectures.
  • Comparison with Genetic Programming Neural Networks: The authors directly compare GENN to an earlier machine-learning NN approach (genetic programming neural networks) on both simulated and real data, establishing a clear performance baseline.
  • Scalability Demonstration: GENN is shown to scale effectively from small datasets to datasets with 500,000 SNPs, a key requirement for real-world genomic studies.
  • High Power in Epistatic Models: GENN achieves high power to detect disease-risk loci across a range of high-order epistatic models, validating its utility for complex trait genetics.

Results

The key quantitative finding is that GENN greatly outperforms genetic programming neural networks in datasets with a large number of single nucleotide polymorphisms. Specifically, the paper reports high power for detecting disease-risk loci in high-order epistatic models and demonstrates scalability up to 500,000 SNPs. These results are based on both simulated data (with known ground truth) and real genetic data, providing robust evidence of GENN's effectiveness.

Significance

This work has broader implications for the AI field by demonstrating the effectiveness of grammatical evolution for neural architecture search in a high-dimensional, real-world domain. It shows that automated machine learning (AutoML) techniques can be successfully applied to genetic epidemiology, potentially enabling discoveries of complex genetic interactions that contribute to common diseases. The scalability to 500,000 SNPs also suggests that such methods could be integrated into standard GWAS pipelines, moving beyond single-locus analysis to embrace epistatic models.