Pingcord - YouTube API Issues – Détails de l'incident

Performances partiellement dégradées

YouTube API Issues

Surveillé
Performances dégradées
Signalé le il y a environ 1 mois

Concernés

Twitter

Performances dégradées depuis 10:01 PM à 8:00 AM, Panne majeure depuis 8:00 AM à 7:45 PM, Performances dégradées depuis 7:45 PM à 12:00 AM, Opérationnel depuis 12:00 AM à 12:00 AM

Youtube

Performances dégradées depuis 10:01 PM à 8:00 AM, Panne majeure depuis 8:00 AM à 7:45 PM, Performances dégradées depuis 7:45 PM à 12:00 AM, Opérationnel depuis 12:00 AM à 12:00 AM

Mises à jour
  • Surveillé
    UTC
    Surveillé

    Following a fix by Google Engineering last week, all YouTube trackers have been re-established over the last few days.

    We will continue to run the backup system while monitoring traffic to ensure we are seeing a similar level of activity from before the issues started. Once we're happy, we'll switch off the backup system.

  • Mettre à jour
    UTC
    Mettre à jour

    Update: We apologise that the backup system had malfunctioned since earlier today. The backup system's issue has now been resolved and pings are recovering.

    We are *still* waiting on updates from Google Engineering regarding the main issue that has caused us to rely on the backup system.

    Original issue:

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

  • Mettre à jour
    UTC
    Mettre à jour

    Update: We apologise that the backup system had malfunctioned since earlier today. The backup system's issue has now been resolved and pings are recovering.

    We are *still* waiting on updates from Google Engineering regarding the main issue that has caused us to rely on the backup system.

    Original issue:

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

  • Mettre à jour
    UTC
    Mettre à jour

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service. Google Engineering are aware of the issue and are actively looking into it.

    Existing channels tracked by Pingcord have now been moved to a backup system until the issue is resolved. Newly-added channels are also now being tracked by the backup system. Pings may be delayed by up to 10 minutes as a result of this.

    We will provide further updates when we receive them from Google.

  • Mettre à jour
    UTC
    Mettre à jour

    Current estimated impact: 5% of YouTube channels affected

    While we await updates from Google, we are continuing to identify and setup mitigations to reduce any impact to notifications. Any affected existing YouTube channel trackers are being moved to a temporary system. Once this is complete, we will be able to support new YouTube channel registrations.

  • Identifié
    UTC
    Identifié

    We have identified an issue relating to trackers for YouTube channels. The issue is caused by an internal Google service and has been reported to Google Engineering. We are awaiting their response.

    Trackers for new YouTube channels will fail to create and will be stuck as "Creating tracker..."

    Existing channels will be unaffected until their trackers expire.

    We are exploring any mitigations we can implement to minimise the impact.