does sound like the servo (it's normal). it should only ever stop hissing once you've exhausted the vacuum (with the engine off).
try this: immediately after having turned off the engine, pump the brake pedal half a dozen times - you should initially hear it hiss with every pump and then it'll stop doing so once you've exhausted the vacuum in the servo. the brake pedal should now feel much firmer. now, with your foot pressing the pedal down, restart the engine: the pedal should slowly sink a little as the vacuum builds back up. your servo's fine if this all works.