When coming in to a IVR When a option in the IVR or Direct dial to an EXT. the language

When coming in to a IVR through a language tunnel.
Then Pressing a option that takes me direct to an EXT. or when using direct dial EXT.
the set language falls off.