Services experiencing reduced performance and instability.
Services are operational. We continue to investigate and consider further long term improvements.
Yesterday evening (UTC) we introduced a few extra changes to increase support for load in certain areas of our services. We will continue to monitor the situation, services are still slightly degraded but overall should be functional.
The issues currently seen are related to increased load across our services, some specific problems have been identified and resolved. Services are not down, but you may experience intermittent timeouts/errors depending on which service. we are looking at various options to further improve this and increase our capacity.
We are investigating degraded service across our services. This is manifesting as occasional error messages or slow response times for API requests and/or frontend services.
This appears to be due to increased traffic across but we are investigating the source and what capacity we can increase.
This incident affected: API Servers (Metadata Store (MDS) API, REST API, OAI-PMH, GraphQL API) and Frontend Applications (Fabrica, Commons).