[Flight] Warn once if eval is disabled in dev environment (#35661)

[Flight] Warn once if eval is disabled in dev environment (#35661) #1084