I found that this is a nice clean solution.
Click Start -> Run
Go to Local Computer Policy -> Computer Configuration -> Administrative Templates -> Windows Components -> Windows Update
Double-click on "No auto-restart for scheduled Automatic Update installation"
Reboot the computer.
For more details, please check the link: