tag:status.affirm.com,2005:/historyAffirm Status - Incident History2024-03-28T22:23:32-07:00Affirmtag:status.affirm.com,2005:Incident/202974182024-03-18T20:30:59-07:002024-03-18T20:30:59-07:00Intermittent 5xx Failures on Affirm Sign In Page<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>20:30</var> PDT</small><br><strong>Resolved</strong> - Between 7:20 PM MDT and 8:32 PM MDT we observed intermittent login failures for customers on the Affirm sign in page, which have now resolved.</p>tag:status.affirm.com,2005:Incident/199426032024-02-29T00:00:56-08:002024-02-29T00:00:56-08:00Affirm US Database Infrastructure<p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>00:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>23:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>12:46</var> PST</small><br><strong>Scheduled</strong> - On February 28th, 2024, Affirm will be performing updates to its database infrastructure in the US. All US services will be subject to an estimated downtime of 10 minutes. <br /><br />This includes Affirm checkout flow, virtual card integrations, loan authorization and capture, all e-commerce platform integrations, promotional messaging, and the sandbox environment. <br /><br />The maintenance will begin at 11:00 PM PT on 2/28/2024 and end at 12:00 AM PT on 2/29/2024. The expected downtime is estimated to be, at most, 10 minutes within this 1 hour window.</p>tag:status.affirm.com,2005:Incident/201013202024-02-28T20:04:39-08:002024-02-28T20:04:39-08:00Service Disruption<p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>20:04</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>16:55</var> PST</small><br><strong>Monitoring</strong> - We have identified the root cause of the problem and issued a fix.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>15:29</var> PST</small><br><strong>Investigating</strong> - We are starting to see a partial disruption to our services again. We are continuing to investigate and will provide updates.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>15:12</var> PST</small><br><strong>Update</strong> - Services continue to be stable. We are monitoring minor latency increases on some services.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>14:52</var> PST</small><br><strong>Monitoring</strong> - We are now seeing recovery for our services. We will continue to monitor for stability.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>14:35</var> PST</small><br><strong>Update</strong> - We are seeing minor recovery in our services and are continuing to investigate.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>14:20</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue to our services. We will provide more updates as we investigate.</p>tag:status.affirm.com,2005:Incident/200824352024-02-26T20:12:17-08:002024-02-26T20:12:17-08:00Minor Checkout Disruption<p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>20:12</var> PST</small><br><strong>Resolved</strong> - The incident has been resolved.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>15:25</var> PST</small><br><strong>Monitoring</strong> - We are seeing full recovery across our services. Customers should now be able to checkout with Affirm successfully. We are now monitoring for stability.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>14:56</var> PST</small><br><strong>Identified</strong> - Checkouts in the US are now at less than 5% disruption after restarting several of our services. Checkouts in Canada should be affected at around 5% and we are working through our remediation steps.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>14:21</var> PST</small><br><strong>Update</strong> - The issue is currently at around 5 - 10% disruption. Some customers should be able retry if they run into an issue during checkout. We are working on a few different fixes to mitigate the the issue. We are seeing minor recovery and are still looking towards full resolution.</p><p><small>Feb <var data-var='date'>26</var>, <var data-var='time'>13:48</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing a minor disruption to our checkout service. We are investigating the issue with our engineering teams and will continue to provide updates.</p>tag:status.affirm.com,2005:Incident/200010132024-02-16T16:26:55-08:002024-02-16T16:27:45-08:00A small number of user loans incorrectly charged<p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>16:26</var> PST</small><br><strong>Resolved</strong> - This incident only affected a small handful of loans and was due to an issue that the payment processor has resolved</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>16:21</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>15:23</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>10:42</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>08:49</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>08:22</var> PST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.affirm.com,2005:Incident/198096182024-01-23T12:36:33-08:002024-01-23T12:36:33-08:00Partial Checkout Outage in Canada<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>12:36</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>12:11</var> PST</small><br><strong>Identified</strong> - We are still seeing a small amount of errors at checkout for customers and are looking for a solution to have full resolution.</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>11:54</var> PST</small><br><strong>Monitoring</strong> - Checkout errors are starting to subside and we will be continuing to monitor for resolution</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>11:46</var> PST</small><br><strong>Identified</strong> - We are currently experiencing a minor partial disruption to our checkout service in Canada. We have identified the issue and are investigating how to fix the issue. We'll provide another update soon.</p>tag:status.affirm.com,2005:Incident/197706842024-01-19T16:01:51-08:002024-01-19T16:01:51-08:00Increased errors on multiple endpoints<p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>16:01</var> PST</small><br><strong>Resolved</strong> - Errors have decreased to their normal levels</p><p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>15:41</var> PST</small><br><strong>Monitoring</strong> - This has been mitigated, we will continue to monitor</p><p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>15:02</var> PST</small><br><strong>Investigating</strong> - We are currently investigating this issue</p>tag:status.affirm.com,2005:Incident/196488122024-01-08T10:47:56-08:002024-01-08T10:47:56-08:00Identified Issue Affecting customer application in Canada.<p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>10:47</var> PST</small><br><strong>Resolved</strong> - Our team has deployed a fix and have seen the errors subside. All services are now functioning as expected.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>10:30</var> PST</small><br><strong>Update</strong> - We have identified the cause of the disruption to our checkout as due to deploy on production and are currently attempting to fix the issue.</p><p><small>Jan <var data-var='date'> 8</var>, <var data-var='time'>10:17</var> PST</small><br><strong>Identified</strong> - We have identified the cause of the disruption to our application flow as due to a feature flag and are currently attempting to fix the issue. Issue only affecting customers in Canada.</p>tag:status.affirm.com,2005:Incident/194300472023-12-14T22:02:21-08:002023-12-14T22:02:21-08:00Prequalification Flow Degraded for Some Shopify Merchants<p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>22:02</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>12:35</var> PST</small><br><strong>Monitoring</strong> - The fix to ensure this issue does not occur again has been deployed. The process to remediate this issue for impacted merchants is in process and will be completed by the end of the day.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>10:46</var> PST</small><br><strong>Update</strong> - Our teams are working on deploying a fix to stop this from occurring again and to remediate any merchants impacted. We will update as soon as the fix is deployed.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>10:09</var> PST</small><br><strong>Update</strong> - This impacts Shopify merchants that have been onboarded after September 27th. This issue did not break the prequalification functionality for existing merchants onboarded before then.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>09:59</var> PST</small><br><strong>Identified</strong> - We are aware of an issue where the Prequalification flow is degraded for some Shopify merchants causing users to see an error when attempting to prequalify. Our team has identified the source of the issue and we are working on implementing a fix to resolve the degraded performance. This only impacts users attempting to prequalify and does not impact their ability to checkout with Affirm.</p>tag:status.affirm.com,2005:Incident/192521652023-12-14T00:00:04-08:002023-12-14T00:00:04-08:00Affirm CA Database Maintenance<p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>00:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>23:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>10:45</var> PST</small><br><strong>Scheduled</strong> - Affirm will be conducting some maintenance on production databases in Canada. CA merchants should expect no more than 2 minutes of potential downtime during the 45 minute window.</p>tag:status.affirm.com,2005:Incident/193797052023-12-08T11:50:54-08:002023-12-08T11:50:54-08:00Affirm Mobile Application Degradation for US Users<p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>11:50</var> PST</small><br><strong>Resolved</strong> - We have identified that this issue was isolated to Android users and we have seen our services return to their usual performance.</p><p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>11:41</var> PST</small><br><strong>Monitoring</strong> - We have rerouted traffic from the impacted cluster and we have started seeing the affected services recover. We will continue to monitor the situation to ensure that degradation does not resume.</p><p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>11:27</var> PST</small><br><strong>Investigating</strong> - We are aware of an issue affecting the Affirm Mobile Application for users in the US. Our team is currently investigating, and we will provide additional updates as soon as possible.</p>tag:status.affirm.com,2005:Incident/193577742023-12-06T13:38:23-08:002023-12-06T13:38:23-08:00Elevated errors for checkout through Shopify Payments by Affirm CA<p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>13:38</var> PST</small><br><strong>Resolved</strong> - Our team has deployed a fix and have seen the errors subside. All services are now functioning as expected.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>12:52</var> PST</small><br><strong>Identified</strong> - We have identified the cause and are continuing to work on a fix for the Shopify Payments by Affirm checkout disruption in CA. We will provide more updates as they come along.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>12:40</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing elevated level of errors that are affecting Loan services, and we are investigating the issue. We will provide additional updates as we know more. Only affecting CA merchants.</p>tag:status.affirm.com,2005:Incident/193459122023-12-05T22:33:51-08:002023-12-05T22:33:51-08:00T-Mobile SMS failures impacting Affirm user authentication for their customers<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>22:33</var> PST</small><br><strong>Resolved</strong> - Metrics indicating that T-Mobile users are been unable to receive SMS pins have returned to normal levels. This incident has been declared resolved</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>22:02</var> PST</small><br><strong>Identified</strong> - We have observed a drop in end-to-end conversion for US Affirm users using T-mobile as their mobile carrier. Affected users are not receiving their SMS pins at checkout. We are monitoring this 3rd party incident and will update as the situation progresses</p>tag:status.affirm.com,2005:Incident/193382432023-12-05T11:33:55-08:002023-12-05T11:33:55-08:00Affirm US and CA Checkout Disruption<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>11:33</var> PST</small><br><strong>Resolved</strong> - Our team has deployed a fix and have seen the errors subside. All services are now functioning as expected.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>11:26</var> PST</small><br><strong>Identified</strong> - We have identified the cause of the disruption to our Checkout service due to a code bug and are currently attempting to fix the issue.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>11:12</var> PST</small><br><strong>Investigating</strong> - We are investigating a disruption to our Checkout service and are currently attempting to locate the root cause and fix the issue. This is impacting checkouts for merchants in the US and CA.</p>tag:status.affirm.com,2005:Incident/193363952023-12-05T09:29:46-08:002023-12-05T09:29:46-08:00Affirm US Checkout Disruption<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>09:29</var> PST</small><br><strong>Resolved</strong> - We have resolved the issue and have seen our services return to their usual performance.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>09:06</var> PST</small><br><strong>Monitoring</strong> - We have identified the source of the issue. The checkout service is now working as expected. We are continuing to monitor the situation.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>09:00</var> PST</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>08:58</var> PST</small><br><strong>Identified</strong> - We are investigating a disruption to our Checkout service and are currently attempting to locate the root cause and fix the issue. This is impacting checkouts for merchants in the US.</p>tag:status.affirm.com,2005:Incident/192512312023-11-30T08:47:09-08:002023-11-30T08:47:09-08:00Affirm Sandbox in CA is down.<p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>08:47</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>08:43</var> PST</small><br><strong>Monitoring</strong> - We have implemented a domain level fix for sandbox.affirm.ca and are verifying mitigation.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>08:22</var> PST</small><br><strong>Investigating</strong> - We are currently investigating errors occurring when trying to access Affirm's sandbox environment in Canada.</p>tag:status.affirm.com,2005:Incident/192406362023-11-29T02:01:47-08:002023-11-29T02:01:47-08:00Degraded checkout performance with identity verification<p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>02:01</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>01:31</var> PST</small><br><strong>Identified</strong> - We're currently experiencing an issue with our identity verification systems impacting our checkout flows slightly degrading performance. We've already identified the issue and are proactively working on a fix.</p>tag:status.affirm.com,2005:Incident/192403972023-11-29T00:51:19-08:002023-11-29T00:51:19-08:00Degraded checkout performance with identity verification<p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>00:51</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>00:49</var> PST</small><br><strong>Identified</strong> - We're currently experiencing an issue with our identity verification systems impacting our checkout flows slightly degrading performance. We've already identified the issue and are proactively working on a fix.</p>tag:status.affirm.com,2005:Incident/192122882023-11-24T15:34:51-08:002023-11-24T15:34:51-08:00Elevated Errors for Shop Pay Installments<p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>15:34</var> PST</small><br><strong>Resolved</strong> - The incident has been resolved.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>15:02</var> PST</small><br><strong>Monitoring</strong> - We have identified increased down payment errors associated with certain credit cards, and we’ve confirmed that the issue is not within our system. We will keep closely monitoring the incident and will keep providing updates as they occur.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>13:23</var> PST</small><br><strong>Identified</strong> - We have identified the cause of the SPI service disruption as a broader issue with Visa cards. We are closely monitoring the incident and will provide updates as they occur.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>12:19</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>12:18</var> PST</small><br><strong>Investigating</strong> - We are currently experiencing elevated level of errors that are affecting Shop Pay Installments, and we are investigating the issue. We will provide additional updates as we know more.</p>tag:status.affirm.com,2005:Incident/191317852023-11-15T21:30:35-08:002023-11-15T21:30:35-08:00Sandbox CA Database Maintenance<p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>21:30</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>21:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>15</var>, <var data-var='time'>15:21</var> PST</small><br><strong>Scheduled</strong> - We will be resizing our database for Canada Sandbox systems at 9pm PST until 9:30pm PST as part of routine maintenance. During this time, we expect approximately 5 minutes of downtime across all of our Canada Sandbox systems. Our live production services will NOT be affected.</p>tag:status.affirm.com,2005:Incident/189369672023-11-08T23:30:04-08:002023-11-08T23:30:04-08:00Virtual Card Database Maintenance<p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>23:30</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 8</var>, <var data-var='time'>23:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>26</var>, <var data-var='time'>10:30</var> PDT</small><br><strong>Scheduled</strong> - Affirm will be conducting some maintenance on databases related to the management of US virtual cards. <br /><br />US Merchants using a virtual card integration should expect no more than 2 minutes of potential downtime during the 30 minute window.</p>tag:status.affirm.com,2005:Incident/188291662023-11-02T00:02:43-07:002023-11-02T00:02:43-07:00Affirm Maintenance: CA Prod Databases<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>00:02</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>23:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>09:57</var> PDT</small><br><strong>Scheduled</strong> - Affirm will be performing maintenance work that may result in up to 2 minutes downtime disrupting Affirm CA services during the following time windows:<br />November 1st from 11:00 PM PT to November 2nd 12:02 AM PT<br /><br />If you have any questions or concerns, please reach out to your Affirm contact and we will be happy to assist!</p>tag:status.affirm.com,2005:Incident/189905942023-11-01T09:01:51-07:002023-11-01T09:01:51-07:00Batch infrastructure issue impacting public facing endpoints<p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>09:01</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>08:51</var> PDT</small><br><strong>Monitoring</strong> - We are seeing recovery on previously impacted metrics. Continuing to monitor.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>08:44</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating an internal infrastructure issue impacting merchant's ability to authorize loans and overall latencies in US.</p>tag:status.affirm.com,2005:Incident/189840762023-10-31T17:31:35-07:002023-10-31T17:31:35-07:00Affirm Service Degradation<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>17:31</var> PDT</small><br><strong>Resolved</strong> - This incident has been fully resolved. All Affirm services are operational.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>17:07</var> PDT</small><br><strong>Monitoring</strong> - We have implemented a fix for multiple Affirm services and have seen our services return to their usual performance.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>17:01</var> PDT</small><br><strong>Update</strong> - We have started to see recovery across all Affirm services. We will continue to monitor the situation to ensure that our systems are fully operational.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>16:47</var> PDT</small><br><strong>Identified</strong> - We have identified the root cause of the issue and are working on a fix. We will provide more updates as they come along.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>16:41</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>16:37</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>16:36</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing elevated level of errors across multiple Affirm services and we are investigating the issue. We will provide additional updates as we know more.</p>tag:status.affirm.com,2005:Incident/187809792023-10-31T07:00:19-07:002023-10-31T07:00:20-07:00Affirm Maintenance<p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>07:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>31</var>, <var data-var='time'>05:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>08:47</var> PDT</small><br><strong>Scheduled</strong> - We will be making security updates that will cause increased latency of our services for 2 hours.</p>