Are you trying to run Apache as a service?
Windows services do not like 'removable media'.
Did you copy on the Control Panel (it works on all Windows versions and improves diagnostics)
What is in the Apache error log ?
Take a look at this topic and the Windows error messages -viewtopic.php?p=199419
Your USB drive may be powering down.