Fix NVIDIA Driver Performance Issues in Stable Diffusion WebUI
Error message
[Resolved] NVIDIA driver performance issues
Diagnosis
If you are running Stable Diffusion WebUI and experiencing generation slowdowns, images getting stuck mid-render, or a noticeable drop in performance after updating your NVIDIA drivers, you are encountering a known issue with NVIDIA's memory management changes introduced in driver version 536.67. The exact error is not a single message but manifests as performance degradation during heavy memory usage, particularly when running Stable Diffusion and DaVinci Resolve. According to the official NVIDIA release notes for version 536.67, the driver implemented a fix for creative application stability issues seen during heavy memory usage, but this fix itself caused performance degradation in Stable Diffusion. NVIDIA has since addressed this with driver version 537.58 (537.42 for Studio drivers) and later, and has also published a help article to disable system memory fallback behavior.
What Causes This Error
1. NVIDIA Driver Memory Management Change (Most Common)
Starting with driver version 536.67, NVIDIA introduced a fix for creative application stability during heavy memory usage. However, as confirmed in the official release notes for 536.67 (see Source 2), this fix resulted in performance degradation when running Stable Diffusion and DaVinci Resolve. The issue is tracked by NVIDIA under bug number 4172676. The driver change altered how the GPU handles memory allocation when VRAM is exhausted, causing the system to fall back to system memory in a way that severely slows down generation.
2. Outdated or Incompatible Driver Versions
Users who updated to driver versions between 536.67 and 537.58 (or 537.42 for Studio) are most affected. The issue was first reported in June 2023 and persisted through several driver releases. Driver version 536.67 did not fix the issue, as explicitly stated in its release notes. Even after NVIDIA claimed a fix in version 537.58, some users reported that the issue was still not resolved, leading to the GitHub issue being reopened on October 19, 2023.
3. System Memory Fallback Behavior
According to NVIDIA's own help article (referenced in the GitHub issue update), the performance degradation is linked to a system memory fallback behavior. When VRAM is full, the driver may attempt to use system RAM as a fallback, but this process is not optimized for the high-bandwidth requirements of AI inference, causing stalls and slowdowns.
How to Fix It

Solution 1: Upgrade to the Latest NVIDIA Driver (Recommended)
NVIDIA has resolved this issue starting with driver version 537.58 (537.42 for Studio drivers). As of October 31, 2023, the GitHub issue maintainers confirmed that the problem should be entirely resolved with driver version 546.01 or newer. Follow these steps:
- Check your current driver version: Open the NVIDIA Control Panel (right-click on desktop) and go to Help > System Information. Look for the "Driver Version" field.
- Download the latest driver: Go to the official NVIDIA driver download page at https://www.nvidia.com/download/Find.aspx. Select your GPU model and operating system, then download the latest Game Ready or Studio driver (version 546.01 or newer).
- Perform a clean installation: When running the installer, select "Custom (Advanced)" and check the box for "Perform a clean installation." This removes all previous driver files and settings, reducing the chance of conflicts.
- Restart your computer: After installation, reboot to ensure the new driver is fully loaded.
- Test Stable Diffusion WebUI: Launch the WebUI and run a few generations. Performance should return to normal.
Expected outcome: Generation speeds should be restored, and no more stalling or slowdowns during heavy memory usage.
Solution 2: Disable System Memory Fallback (For Driver 546.01+)
If you are on driver version 546.01 or newer and still experience issues, NVIDIA has published a help article to disable the system memory fallback behavior. Follow the guide at https://nvidia.custhelp.com/app/answers/detail/a_id/5490. The exact steps from that article are:
- Open the NVIDIA Control Panel.
- Navigate to "Manage 3D Settings."
- Under "Global Settings," find the option "System Memory Fallback Policy" (or similar, depending on driver version).
- Set it to "Off" or "Disabled."
- Apply the changes and restart Stable Diffusion WebUI.
Note: This setting may not appear in older drivers. If you cannot find it, upgrade to the latest driver first.
Solution 3: Downgrade to Driver Version 531 or Below (Fallback)
If upgrading does not work or you need an immediate fix, downgrading to a driver version before the memory management change is a reliable workaround. This was the original recommendation from the GitHub issue discussion (Source 1).
- Uninstall your current driver: Use Display Driver Uninstaller (DDU) in Safe Mode to completely remove the existing NVIDIA driver. This prevents conflicts between old and new driver files.
- Download driver version 531 or below: Go to https://www.nvidia.com/download/Find.aspx and manually select a driver version from the list. Look for versions like 531.79 or earlier. You may need to use third-party archives like Guru3D's driver collection if NVIDIA no longer hosts older versions.
- Install the older driver: Run the installer with a clean installation as described in Solution 1.
- Restart and test: Reboot and verify that Stable Diffusion WebUI runs without slowdowns.
Caveat: Older drivers may lack security updates and optimizations for newer games or applications. Only use this as a temporary measure until you can upgrade to a fixed driver.
Solution 4: Community-Reported Workarounds
Some users on the GitHub issue thread reported that the issue persisted even after driver updates. For these cases, the following community-sourced workarounds may help:
- Reduce batch size or image resolution: Lowering the memory footprint can avoid triggering the fallback behavior. Try generating one image at a time instead of batches, or reduce the resolution to 512x512.
- Use the
--medvramor--lowvramflags: When launching Stable Diffusion WebUI, add these flags to the command line to optimize memory usage. For example:
orpython launch.py --medvrampython launch.py --lowvram - Monitor VRAM usage: Use tools like GPU-Z or the Task Manager to check if VRAM is being exhausted. If it is, the fallback behavior may be triggered.
If Nothing Works
If none of the above solutions restore performance, consider the following escalation paths:
- Check the NVIDIA driver release notes: Visit https://us.download.nvidia.com/Windows/ and look for the latest release notes PDF. Search for bug number 4172676 to see if a fix is listed.
- File a bug report with NVIDIA: Use the NVIDIA Developer Bug Report tool or contact NVIDIA support directly. Reference the tracking number 4172676.
- Post on the Stable Diffusion WebUI GitHub issue: The original issue at https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/11063 is still open for discussion. Provide your driver version, GPU model, and a detailed description of the problem.
- Use an alternative WebUI fork: Some users have reported better stability with forks like Vladmandic's automatic (https://github.com/vladmandic/automatic), which may have additional memory management optimizations.
How to Prevent It
To avoid this issue in the future:
- Keep your NVIDIA drivers updated: Regularly check for new driver releases, especially if you use Stable Diffusion frequently. NVIDIA has acknowledged this bug and is actively working on fixes.
- Monitor driver release notes: Before updating, read the release notes PDF for any known issues related to Stable Diffusion or creative applications. Look for mentions of bug 4172676.
- Use a stable driver version: If you find a driver version that works well (e.g., 531 or below), consider sticking with it until you have confirmed that a newer version does not introduce regressions.
- Limit VRAM usage: Configure Stable Diffusion WebUI to use less VRAM by default. Use the
--medvramflag in your launch script to reduce the chance of hitting the fallback behavior. - Back up your current driver: Before updating, note your current driver version so you can easily downgrade if needed.
The #1 Stable diffusion Newsletter
The most important stable diffusion updates, guides, and fixes — one weekly email.
No spam, unsubscribe anytime. Privacy policy
Sources & References
This page was researched from 2 independent sources, combined and verified for completeness.
- 1.[Resolved] NVIDIA driver performance issuesGitHub issue
- 2.Solution comment by catboxanon (5 reactions)GitHub issue
Related Error Solutions
Keep exploring Stable Diffusion
Stable Diffusion resources
Latest AI answers
Skip the manual work
Ready-made AI workflows and automation templates — import and run instead of building from scratch.