Journal Article
Large Language Models

Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking

S. Mostafa Mousavi(Stanford University), William L. Ellsworth(Stanford University), Weiqiang Zhu(Stanford University), Lindsay Chuang(Georgia Institute of Technology), Gregory C. Beroza(Stanford University)
August 7, 2020Nature Communications1,089 citations

1.1k

Citations

97

Influential Citations

Nature Communications

Venue

2020

Year

Abstract

Earthquake signal detection and seismic phase picking are challenging tasks in the processing of noisy data and the monitoring of microearthquakes. Here we present a global deep-learning model for simultaneous earthquake detection and phase picking. Performing these two related tasks in tandem improves model performance in each individual task by combining information in phases and in the full waveform of earthquake signals by using a hierarchical attention mechanism. We show that our model outperforms previous deep-learning and traditional phase-picking and detection algorithms. Applying our model to 5 weeks of continuous data recorded during 2000 Tottori earthquakes in Japan, we were able to detect and locate two times more earthquakes using only a portion (less than 1/3) of seismic stations. Our model picks P and S phases with precision close to manual picks by human analysts; however, its high efficiency and higher sensitivity can result in detecting and characterizing more and smaller events.

Analysis

Why This Paper Matters

This paper addresses a fundamental challenge in seismology: reliably detecting and characterizing earthquakes from noisy continuous data. Traditional methods struggle with microearthquakes and low signal-to-noise ratios, while prior deep-learning approaches often treat detection and phase picking as separate tasks. By unifying these tasks in a single attentive model, the authors achieve a step-change in performance. The ability to detect twice as many events using only a fraction of seismic stations has immediate practical implications for monitoring networks, especially in regions with sparse instrumentation.

Moreover, the work demonstrates the power of attention mechanisms in a domain far from natural language processing, showing that hierarchical attention can effectively combine local and global waveform features. This cross-domain transfer of architectural ideas is a hallmark of impactful AI research.

Technical Contributions

  • Hierarchical attention mechanism: The model uses attention at multiple scales to integrate information from both the full waveform and individual seismic phases, allowing the two tasks to mutually reinforce each other.
  • Global training dataset: The model is trained on a diverse global dataset, enhancing its generalizability compared to region-specific models.
  • Joint optimization: Simultaneous detection and phase picking is framed as a multi-task learning problem, which improves performance on each individual task.
  • Architecture: The transformer-like design processes time-series seismic data, adapting attention for 1D signals rather than text or images.

Results

  • The model outperforms both traditional phase pickers (e.g., STA/LTA) and previous deep-learning models (e.g., PhaseNet, GPD) in detection and picking accuracy.
  • On the Tottori dataset, it detected twice as many earthquakes as the reference catalog while using less than one-third of the available seismic stations.
  • P and S phase arrival times are picked with precision comparable to manual picks by human analysts, with mean absolute errors on the order of a few samples.
  • The model's high sensitivity allows it to characterize smaller magnitude events that are missed by conventional methods.

Significance

This paper has been highly influential (1089 citations) because it demonstrates that deep learning, and specifically attention-based architectures, can revolutionize geophysical monitoring. The approach reduces the need for dense station networks, lowers the cost of earthquake catalog generation, and improves completeness of catalogs for seismicity studies. For the AI community, it is a compelling example of how transformer-like models can be adapted to continuous time-series data with long-range dependencies, inspiring similar work in other scientific domains such as astrophysics, oceanography, and biomedical signal processing.