The lantern beside the entrance ___ on until midnight every evening.

Explication

The singular head noun lantern requires the third-person singular form stays in this habitual present-tense statement. Stay belongs with plural subjects and I, you, we or they, while stayed and staying do not supply the requested finite present form.