Pingcord - YouTube API Issues – Détails de l'incident

Réseautage CloudFlare connaît une dégradation des performances

YouTube API Issues

RésoluPerformances dégradées1024 heures 58 minutes

Concernés

Twitter

Performances dégradées depuis 10:01 PM à 8:00 AM, Panne majeure depuis 8:00 AM à 7:45 PM, Performances dégradées depuis 7:45 PM à 12:00 AM, Opérationnel depuis 12:00 AM à 3:00 PM

Youtube

Performances dégradées depuis 10:01 PM à 8:00 AM, Panne majeure depuis 8:00 AM à 7:45 PM, Performances dégradées depuis 7:45 PM à 12:00 AM, Opérationnel depuis 12:00 AM à 3:00 PM

  • RésoluUTC
    This incident has been resolved.
  • SurveilléUTC

    Following a fix by Google Engineering last week, all YouTube trackers have been re-established over the last few days.

    We will continue to run the backup system while monitoring traffic to ensure we are seeing a similar level of activity from before the issues started. Once we're happy, we'll switch off the backup system.

  • Mettre à jourUTC

    Update: We apologise that the backup system had malfunctioned since earlier today. The backup system's issue has now been resolved and pings are recovering.

    We are *still* waiting on updates from Google Engineering regarding the main issue that has caused us to rely on the backup system.

    Original issue:

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

  • Mettre à jourUTC

    Update: We apologise that the backup system had malfunctioned since earlier today. The backup system's issue has now been resolved and pings are recovering.

    We are *still* waiting on updates from Google Engineering regarding the main issue that has caused us to rely on the backup system.

    Original issue:

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

  • Mettre à jourUTC

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

    We will provide further updates when we receive them from Google.

  • Mettre à jourUTC

    Current estimated impact: 5% of YouTube channels affected

    While we await updates from Google, we are continuing to identify and setup mitigations to reduce any impact to notifications. Any affected existing YouTube channel trackers are being moved to a temporary system. Once this is complete, we will be able to support new YouTube channel registrations.

  • IdentifiéUTC

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service and has been reported to Google Engineering. We are awaiting their response.

    Trackers for new YouTube channels will fail to create and will be stuck as "Creating tracker..."

    Existing channels will be unaffected until their trackers expire.

    We are exploring any mitigations we can implement to minimise the impact.