Active Incident

Updated a few seconds ago

Incident Status

Operational

Components

BLOX CMS

Locations

US-EAST-1, US-MIDWEST-1



October 22, 2025 12:45PM CDT
October 22, 2025 5:45PM UTC
[Identified] BLOX has identified, based on reports from multiple customers, that an issue with the BLOX NXT collaboration server. Editing documents that were modified in the NXT admin in the last 48 hours may cause duplication of content fields such as the title, slug, body copy, etc. may occur. Content produced sometime after 8AM central this morning appears to be unaffected. The initial mitigation has been to purge all temporary versions of these documents from the collaboration server and restore from the BLOX CMS revision saved on disk. For the majority of existing content, this seems to have corrected the behavior - however - if documents were proactively saved while viewing them in the editor with duplicate data, manually removing the duplicated content will be necessary. The issue appears to be linked to a change from the collaboration service provider and we are working with our vendor on further discovery and mitigation. As part of the investigation and to prevent further issues, we will be temporarily disabling collaboration in NXT. After the investigation and confirmation of a fix, we will begin restoring collaboration mode for sites that have it enabled.

October 22, 2025 4:36PM CDT
October 22, 2025 9:36PM UTC
[Identified] We have determined that an upgrade from our collaboration server vendor about 12 hours ago is related to the issue. The problem appears to be a newly created race condition in how synchronization of updates happens in the editor. We are still working with their support team on this problem. Additionally, we are working on an out-of-band release to add more defensive code and retry logic to handle the situation more gracefully without fully disabling collaboration if an issue is detected.

October 23, 2025 11:13AM CDT
October 23, 2025 4:13PM UTC
[Monitoring] Our collaboration vendor and development team has confirmed that the issue with the server was fixed as of 9PM central yesterday. We will begin re-enabling collaboration on clients that had it enabled at 10AM central yesterday. Clients that did not have collaboration on before that time will not have the feature enabled. As part of turning the service back on, we will continue to monitor for reported issues.

October 23, 2025 12:40PM CDT
October 23, 2025 5:40PM UTC
[Monitoring] Collaboration services have been re-enabled and may require a fresh login to see the change enabled again. We are continuing to monitor sites for any issues.

BLOX CMS




Operational

Job Processing




Operational

BLOX Total CMS




Operational

Network




Operational

Database




Operational

Storage System




Operational

Support Call Center




Operational

BLOX VMS




Operational

Rayos CMS




Operational

FTP, Drive, DNS, E-Mail




Operational

E-Editions




Operational

Advertising & Behavioral Targeting




Operational

Business Directory




Operational

Forms




Operational

Subscription




Operational

Analytics & Email Reach




Operational

Calendar




Operational

BLOX CMS /APP




Operational

Sandstone Administration




Operational

OTT & NOW App




Operational

GamesPerform




Operational

Data Insights




Operational

History (Last 7 days)

Incident Status

Operational


Components

BLOX CMS


Locations

US-EAST-1, US-MIDWEST-1




October 23, 2025 11:44AM CDT
October 23, 2025 4:44PM UTC
[Monitoring] Flex Templates 3.270.2 will be released out-of-band at 1:00PM central. This release makes a change to the robots meta tag for assets with the Advertorial flag. There are no other changes in this release.

October 24, 2025 2:08PM CDT
October 24, 2025 7:08PM UTC
[Resolved] Software released without incidents.

Incident Status

Degraded Performance


Components

Analytics & Email Reach


Locations

US-EAST-1, US-MIDWEST-1




October 20, 2025 11:05AM CDT
October 20, 2025 4:05PM UTC
[Monitoring] Due to the AWS outage some email newsletters were delivered late this morning. The system recovered itself and by 6:00 AM all the emails were sent out successfully.

October 22, 2025 12:48PM CDT
October 22, 2025 5:48PM UTC
[Resolved] BLOX Email Reach is stable since October 20, 2025 06:05AM CDT.

Incident Status

Operational


Components

BLOX CMS


Locations

US-EAST-1, US-MIDWEST-1




October 17, 2025 1:13PM CDT
October 17, 2025 6:13PM UTC
[Monitoring] BLOX CMS 1.89.5 and BLOX Syndication 1.61.1 will be released at 1:30 PM central. These releases includes improvements to prevent excess memory consumption in the search index.

October 20, 2025 10:02AM CDT
October 20, 2025 3:02PM UTC
[Resolved] Software released.