Safe Mode in Windows XP and later is not really much different than regular mode. The main difference is that extra settings, files, and drivers are not loaded. If the extra settings, files, and drivers are causing a problem for you, then run it in Safe Mode. If not, there is no need to use Safe Mode.
The main purpose of Safe Mode is to diagnose where a problem is coming from. If the problem does not exist in Safe Mode, then the default settings and the standard drivers are not causing the problem. If the problem does exist in Safe Mode, something in standard Windows could be causing the problem.
Running in Safe Mode does not neccessarily mean that things will run faster or better.