Hmm, there are two types of Alpine cage.
One hooks in the old fashioned way. And the other (like mine) has two little circlular shaped things right at the front. If they clip in it should not push out.
Your's sounds like the first type, which has clips half way back along the cage that should catch on the head unit.