24th October 2018

Production: Instant Payment Notifications (IPNs) BlueSnap Inceident Notification - October 23, 2018 to October 24, 2018 - IPN Failures - RESOLVED

We experienced network interruptions that prevented some IPNs from being generated and delivered.

This issue is now resolved.

Impacted Systems:

[X] Production

[ ] Sandbox

[ ] No Imapct

Impacted Environments:

[ ] BuyNow Pages

[ ] Web Services (API)

[ ] SnapConsole

[X] IPNs

[ ] Reports

[ ] Subscriptions

Time-frame: October 23, 2018 04:45 to October 24, 2018 03:49 PST.

Notes:

  • During the incident's time-frame, part of the Instant Payment Notifications (IPNs) were not generated.
  • These failures were caused as a result of a network routing issue limited to the US data center.
  • Restarting the service cluster seem to have solved the problem, but the root cause is still being investigated.
  • While working on this issue, we re-generated and delivered the main IPN types: CHARGE, RECURRING,CHARGEBACK, REFUND and CANCELLATION.
  • Other details can be found in the reports section of the BlueSnap control panel (SnapConsole).

Subscribe to our mailing list and get status notifications directly to your inbox: