Pingcord - Notice history

All systems operational

Website - Operational

100% - uptime
Apr 2024 · 99.94%May · 100.0%Jun · 100.0%

Previous page

Next page

Apr 2024
May 2024
Jun 2024

Notice history

Jun 2024

No notices reported this month

May 2024

Meta connection issues
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We have resolved the issue with our access to Meta's APIs. Facebook and Instagram integrations should begin to work again as usual. We will monitor the situation closely to ensure it has been resolved.

  • Investigating
    Investigating
    We are currently investigating this incident.

Apr 2024

YouTube Trackers
  • Resolved
    Resolved

    We are pleased to confirm all trackers have been renewed. Please report any issues as usual in our support server. Thank you for your continued patience!

  • Identified
    Identified

    We have identified an issue with tracker connections to YouTube for some channels.

    We have deployed a fix and are currently renewing all trackers as a precautionary measure. This process will take a few hours to get through all of the trackers. Once your channel's tracker is fixed, YouTube may send us any queued events which will cause Pingcord to post the alerts. However, we appreciate you may have already posted a message yourself so Pingcord will "suppress" the @ mention tags for any video uploads over 3 hours ago. This means they will still appear in Discord like a mention but it has not notified your users.

Ongoing database issues
  • Resolved
    Resolved

    As of now the service is restored. We will continue to monitor the service throughout the weekend.

  • Monitoring
    Monitoring

    Emergency database maintenance has been completed successfully.

    Unfortunately, due to the nature of the database crash, any changes made to pre-existing integrations will be rolled back to this morning. New servers that joined after the crash should have their integrations preserved.

    Thank you for your continued patience.

  • Investigating
    Update

    We have now started the database backup process. During this time, we are reconciling any changes made from this morning's outage. This may take some time to process all of the records.

    We will attempt to save any data received from Twitch, YouTube, etc. to recover pings after the downtime.

    Please keep an eye out here, or join our Discord server at https://discord.gg/QKwDHGy for further information.

  • Investigating
    Investigating

    We are currently investigating issues related to our outage earlier this morning. It appears our database cluster has not recovered properly and as a result some integrations may be missing.

    We are in the processing of confirming if this is the case. If so, we will reset our servers using a backup from before the outage this morning. To do this, we will take Pingcord offline temporarily to carry this out. We plan to do this by 7pm UTC (around 2 hours from this message at 8pm UK time, 3pm ET, 12 noon PT). The downtime will last a few hours but we will try and queue any incoming data and send the pings out afterwards.

    Thank you for your continued patience while we sort out these issues.

Database issues
  • Resolved
    Resolved

    The affected issues have been resolved. We will continue to monitor the services closely. We apologise for any inconvenience caused.

  • Monitoring
    Monitoring

    Pingcord is beginning the recovery process, and pings should slowly start to come through. Pingcord will suppress mentions for events that have happened > 2 hours ago, to prevent annoying users. Thank you for your patience while we work through these issues.

    We are monitoring the situation closely and will provide updates soon.

  • Investigating
    Investigating

    The Pingcord website is currently down. We are investigating the root cause of the issue and will update this page with further updates.

Apr 2024 to Jun 2024

Next