Да, если вай-фай не нашла, то в режим точки доступа уходит, к ней можно подключиться и настроить всё
Access Point Mode
ESPHome has an optional “Access Point Mode”. If you include ap: in your wifi configuration, ESPHome will automatically set up an access point that you can connect to. Additionally, you can specify both a “normal” station mode and AP mode at the same time. This will cause ESPHome to only enable the access point when no connection to the wifi router can be made.