Bypassing authentication for API using SWAG

I have a number of containers, which I expose outside my network using SWAG and Cloudflare Zero Trust Tunnels, secured via google auth.
Some of these applications (e.g. immich, home-assistant) have companion apps that I can install on my iOS device. These companion apps work fine when I am in my home network, but how can I add the dns I tunnel through?
E.g. if I input 192.123.23.23.1:8123 for home-assistant it works (in my network). I would want it to work using homeassistant.mydomain.com
Has anybody managed to get this to work? Can one add some sort of bypass here?