Sounds like a starter problem. Unplug it and plug it back in again, normally does the trick for me.
From which side? The wiring side or bulb side?
Can I do it without removing the bumper?
You can, it's very fiddley for those of us with big hands though. Just unplug the green wire, push it back in till it clicks, and give it a wirl.
