ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
2.2k
Citations
265
Influential Citations
IEEE Transactions on Image Processing
Venue
2010
Year
Level set methods have been widely used in image processing and computer vision. In conventional level set formulations, the level set function typically develops irregularities during its evolution, which may cause numerical errors and eventually destroy the stability of the evolution. Therefore, a numerical remedy, called reinitialization, is typically applied to periodically replace the degraded level set function with a signed distance function. However, the practice of reinitialization not only raises serious problems as when and how it should be performed, but also affects numerical accuracy in an undesirable way. This paper proposes a new variational level set formulation in which the regularity of the level set function is intrinsically maintained during the level set evolution. The level set evolution is derived as the gradient flow that minimizes an energy functional with a distance regularization term and an external energy that drives the motion of the zero level set toward desired locations. The distance regularization term is defined with a potential function such that the derived level set evolution has a unique forward-and-backward (FAB) diffusion effect, which is able to maintain a desired shape of the level set function, particularly a signed distance profile near the zero level set. This yields a new type of level set evolution called distance regularized level set evolution (DRLSE). The distance regularization effect eliminates the need for reinitialization and thereby avoids its induced numerical errors. In contrast to complicated implementations of conventional level set formulations, a simpler and more efficient finite difference scheme can be used to implement the DRLSE formulation. DRLSE also allows the use of more general and efficient initialization of the level set function. In its numerical implementation, relatively large time steps can be used in the finite difference scheme to reduce the number of iterations, while ensuring sufficient numerical accuracy. To demonstrate the effectiveness of the DRLSE formulation, we apply it to an edge-based active contour model for image segmentation, and provide a simple narrowband implementation to greatly reduce computational cost.
Level set methods are a cornerstone of image segmentation, enabling the capture of complex object boundaries and topological changes. However, a persistent practical challenge has been the need for periodic reinitialization of the level set function to maintain its signed distance property, a process that introduces numerical errors, computational overhead, and algorithmic complexity. This paper by Li et al. addresses this fundamental issue head-on by proposing a variational framework that intrinsically regularizes the level set function during evolution. The key insight is to incorporate a distance regularization term into the energy functional, whose gradient flow yields a forward-and-backward diffusion effect that automatically preserves a signed distance profile near the zero level set. This eliminates the need for ad-hoc reinitialization, simplifying implementation and improving numerical accuracy.
The significance of this work lies in its practical impact: it makes level set methods more accessible and robust for real-world applications. By allowing larger time steps and more flexible initialization, DRLSE reduces computational cost and eases parameter tuning. The paper has become a standard reference in the field, with over 2100 citations, and its ideas have been extended to numerous segmentation tasks, particularly in medical imaging where accurate boundary detection is critical.
The paper does not provide extensive quantitative benchmarks but demonstrates the effectiveness of DRLSE on synthetic and real images. Key qualitative results include:
DRLSE has had a lasting impact on the field of image segmentation and level set methods. By removing the reinitialization bottleneck, it enabled more practical and efficient implementations of active contour models. The concept of intrinsic regularization via a potential function has inspired numerous follow-up works, including region-based models, multi-phase segmentation, and deep learning-integrated approaches. The paper is widely cited in medical imaging literature for applications such as organ segmentation, tumor detection, and vessel extraction. Its simplicity and effectiveness have made it a standard tool in many computer vision libraries and a common baseline for comparing new segmentation algorithms. The work exemplifies how a well-designed variational formulation can solve a long-standing practical problem, bridging theory and application.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba