If we are talking about a car with an external shift cable, yes it will still have reverse and whatever forward gear is selected with all solenoids off (usually 4th gear).

If there is no external cable, then I would expect neutral / park (depending on manual... Login to read more.