Today's issues was a result of a configuration issue in our deployment process that caused a secret to be set incorrectly. While we believed the issue had been fixed last week, a later update unintentionally reverted the change. Today a service was restarted after our system automatically recovered from a failed probe. This caused one of our services to fail in connecting with the data store as the secret was incorrectly configured.

Resolution:
We manually updated the configuration to restore services immediately after our monitoring reported problems.

Steps to prevent similar failures in the future:

• Improved how we manage sensitive configuration values in our infrastructure.
• Added fallback behavior so the service remains operational even if a connection to data store isn't possible.

Please reach out if you have any questions via your support Slack channel or via support@enterspeed.com

The Management App is now fully available. We will update with more information as we learn more.

We are seeing an issue with logging in on the Management App. We are currently investigating.