Unable to resolve *.orchestrated.com endpoints due to DNS issues

Incident Report for OBeer

Resolved

On Mar 11, 2023, at 4:39 PM, our DNS Hosting provider removed our DNS records, disrupting OBeer customers’ connections. We tried to restore a backup with the provider but sought alternatives due to the 2-day restoration time. By 7:31 PM, we moved DNS hosting to AWS Route 53 and restored a backup zone file. Connection restoration varied for customers; clearing DNS caches helped. Most issues resolved by Monday.

On Mar 13, Enterprise 1 users faced server access issues, caused by DNS caching on a Remote Desktop Gateway server. Restarting the server resolved the problem by 12:07 PM. To prevent recurrence, we’ve moved all DNS hosting to AWS Route 53 for greater reliability.
Posted Mar 11, 2023 - 16:30 MST