tag:opsgenie.status.atlassian.com,2005:/historyOpsgenie Status - Incident History2024-03-29T05:23:53ZOpsgenietag:opsgenie.status.atlassian.com,2005:Incident/201024172024-02-29T02:53:17Z2024-02-29T03:59:17ZInvestigating new product purchasing<p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>02:53</var> UTC</small><br><strong>Resolved</strong> - Between 28th Feb 2024 23:15 UTC to 29th Feb 2024 00:05 UTC, we experienced issue with new product purchasing for all products. All new sign up products have been successfully provision and confirmed issue has been resolved and the service is operating normally.</p><p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>01:27</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with new product purchasing that is impacting for all products. Customers adding new cloud products may have experienced a long waiting page or an error page after attempting to add a product. We have mitigated the root cause and are working to resolve impact for customers who attempted to add a product during the impact period. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/200882452024-02-27T14:58:57Z2024-02-27T17:44:30ZOpsgenie SAML login at eu region is not working<p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>14:58</var> UTC</small><br><strong>Resolved</strong> - We fixed the problem and verified that there are no more login issues.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>14:42</var> UTC</small><br><strong>Monitoring</strong> - The team has identified the issue causing the signature validation error at EU SAML Login. The fix has been started to deploy and SAML login activities are being monitored by team currently</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>14:25</var> UTC</small><br><strong>Investigating</strong> - Opsgenie SAML Login functionality is not working at only EU region due to signature verification error at login certificates. Already logged in customers haven't been affected by the error.</p>tag:opsgenie.status.atlassian.com,2005:Incident/199871702024-02-14T23:32:18Z2024-02-27T05:45:33ZService Disruptions Affecting Atlassian Products<p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>23:32</var> UTC</small><br><strong>Resolved</strong> - We experienced increased errors on Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Align, Jira Product Discovery, Atlas, Compass, and Atlassian Analytics. The issue has been resolved and the services are operating normally.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>22:55</var> UTC</small><br><strong>Monitoring</strong> - We have identified the root cause of the Service Disruptions affecting all Atlassian products and have mitigated the problem. We are now monitoring this closely.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>22:31</var> UTC</small><br><strong>Identified</strong> - We have identified the root cause of the increased errors and have mitigated the problem. We continue to work on resolving the issue and monitoring this closely.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>21:57</var> UTC</small><br><strong>Investigating</strong> - We are investigating reports of intermittent errors for all Cloud Customers across all Atlassian products. We will provide more details once we identify the root cause.</p>tag:opsgenie.status.atlassian.com,2005:Incident/198585222024-01-29T15:29:45Z2024-01-29T15:39:48ZMajor outages in heartbeat services pinging via email and email integration in EU region<p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>15:29</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>15:14</var> UTC</small><br><strong>Monitoring</strong> - The team has reverted the changes and identified that corresponding heartbeat and email integration start working now</p><p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>15:08</var> UTC</small><br><strong>Identified</strong> - Due to faulty domain configurations, heartbeats updates via email and incoming email services have been rejected starting from 13:45 UTC. The team has been working on the fix. Except for email updates and email integrations, heartbeat feature and integrations are still fully functional.</p>tag:opsgenie.status.atlassian.com,2005:Incident/194276522023-12-13T14:37:29Z2023-12-13T14:37:29ZIOS based Alert Notifications delivered as non-critical<p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>14:37</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>14:26</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>13:18</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Dec <var data-var='date'>13</var>, <var data-var='time'>13:18</var> UTC</small><br><strong>Investigating</strong> - As of 12.12.2023 14:46 UTC, we have observed that some alert notifications are not being delivered to IOS-based devices as critical. We are currently investigating the issue.</p>tag:opsgenie.status.atlassian.com,2005:Incident/193898122023-12-10T03:52:07Z2023-12-10T03:52:07ZWe observe increased error rates due to the cloud provider<p><small>Dec <var data-var='date'>10</var>, <var data-var='time'>03:52</var> UTC</small><br><strong>Resolved</strong> - Our engineers have been closely monitoring the platform and are declaring this incident resolved. Thank you for your patience.</p><p><small>Dec <var data-var='date'>10</var>, <var data-var='time'>03:40</var> UTC</small><br><strong>Monitoring</strong> - We observe increased error rates due to the cloud provider. It caused notification delays and elevated API errors for our customers. All systems are recovering now, we are monitoring.</p>tag:opsgenie.status.atlassian.com,2005:Incident/193161702023-12-04T17:15:04Z2023-12-04T17:15:04ZEgress connectivity timing out<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>17:15</var> UTC</small><br><strong>Resolved</strong> - The systems are stable after the fix and monitoring for a specified duration</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>16:59</var> UTC</small><br><strong>Monitoring</strong> - The issue was identified and a fix implemented. We are monitoring currently.</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>16:54</var> UTC</small><br><strong>Update</strong> - We are currently investigating an incident that result in outbound connections from Atlassian cloud in us-east-1 intermittently timing out. This affects Jira, Trello, Confluence, Ecosystem products. The features affected for these products are those that require opening a connection from Atlassian Cloud to public endpoints on the Internet</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>16:43</var> UTC</small><br><strong>Update</strong> - Including Atlassian Developer</p><p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>16:33</var> UTC</small><br><strong>Identified</strong> - We are currently investigating an incident that result in connection time outs on service egress proxy. This affects Jira, JSM, Confluence, BitBucket, Trello, Ecosystem products. The features affected for these products are those that require a connection to service egress.</p>tag:opsgenie.status.atlassian.com,2005:Incident/191610182023-11-24T14:23:24Z2023-11-24T14:23:24ZScheduled report functionality is disabled<p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>14:23</var> UTC</small><br><strong>Resolved</strong> - We're excited to inform you that we've shipped upgrades to our production environment, enabling scheduled reports once again.<br /><br />What's Changed: To continuously improve and ensure the security of our services, we've implemented additional controls including domain restrictions and a limitation on the number of recipients per email. This is specifically for mitigation purposes. From now on, users will start receiving emails for the reports they've scheduled for themselves, and they will also have the ability to create new tasks.<br /><br />Impact: Please note that any existing scheduled jobs with external recipients will no longer be editable. However, users can delete these and create new jobs using their email IDs.<br /><br />Thank you for your patience during these changes. We want to assure you that future updates and communications will be shared promptly to keep you informed. We appreciate your understanding and continued support.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>08:32</var> UTC</small><br><strong>Monitoring</strong> - The changes have been shipped to production, and scheduled reports are enabled now.</p><p><small>Nov <var data-var='date'>23</var>, <var data-var='time'>15:05</var> UTC</small><br><strong>Update</strong> - We have implemented additional controls and are introducing domain restrictions as well as limitations to the number of recipients for mitigation purposes. <br /><br />Scheduled reports will be enabled for all customers on November 24th, PST. Users will begin receiving emails for the reports they have scheduled for themselves and they will also have the ability to create new tasks.<br /><br />We will share more updates when the changes are fully implemented.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>18:53</var> UTC</small><br><strong>Update</strong> - The root cause is identified and the spam activity is mitigated.<br />The team is working on adding more controls to prevent further spam activities. <br />The scheduled report feature will be kept disabled for a while until the further controls implemented. <br />However, the reporting service is fully available and the reports can be downloaded manually via the reporting page.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>15:52</var> UTC</small><br><strong>Identified</strong> - The cause of the issue is identified, and the team is working on the fix.</p><p><small>Nov <var data-var='date'>18</var>, <var data-var='time'>11:41</var> UTC</small><br><strong>Investigating</strong> - Scheduled report functionality is disabled as we suspect a possible spam activity. <br />Only the reports with a custom schedules are disabled, periodic emails are not impacted. <br />The team is investigating the issue and will provide more update.</p>tag:opsgenie.status.atlassian.com,2005:Incident/187282512023-10-09T10:30:01Z2023-10-09T10:47:43ZOpsgenie Reporting & Analytics is under maintenance in US<p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>10:47</var> UTC</small><br><strong>Update</strong> - Changes completed and verified</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>10:30</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>08:57</var> UTC</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>08:55</var> UTC</small><br><strong>Update</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>08:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>04:55</var> UTC</small><br><strong>Scheduled</strong> - Scheduled - We will be undergoing a scheduled maintenance of Opsgenie Analytics in US region</p>tag:opsgenie.status.atlassian.com,2005:Incident/184907092023-09-13T19:32:02Z2023-09-22T20:04:36ZAtlassian Account login issues<p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>19:32</var> UTC</small><br><strong>Resolved</strong> - Between 12:45 UTC to 15:30 UTC, we experienced login and signup issues for Atlassian Accounts. The issue has been resolved and the service is operating normally.<br /><br />We will publish a post-incident review with the details of the incident and the actions we are taking to prevent similar problem in the future.</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>17:36</var> UTC</small><br><strong>Update</strong> - We are no longer seeing occurrences of the Atlassian Accounts login errors, all clients should be able to successfully login now. We will continue to monitor.</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>16:30</var> UTC</small><br><strong>Update</strong> - We can see a reduction in the Atlassian Accounts login issues after the mitigation actions were taken. We are still monitoring closely and will continue to provide updates.</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>15:21</var> UTC</small><br><strong>Monitoring</strong> - We have identified the root cause of the Atlassian Accounts login issues impacting Cloud Customers and have mitigated the problem. We are now monitoring this closely.</p><p><small>Sep <var data-var='date'>13</var>, <var data-var='time'>14:08</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with Atlassian Accounts login that is impacting some Cloud customers. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/184600792023-09-10T19:17:28Z2023-09-10T19:17:28ZOpsgenie has experienced delay on Android Notifications<p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>19:17</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>19:15</var> UTC</small><br><strong>Monitoring</strong> - No delay on Android Notification is experienced now. All Android Notification delay has return to normal.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>18:37</var> UTC</small><br><strong>Identified</strong> - We are seeing delays with Android notifications. We have identified the cause and are currently working on mitigation of this issue</p>tag:opsgenie.status.atlassian.com,2005:Incident/183162892023-08-30T06:17:15Z2023-09-18T01:00:18ZMultiple product logins<p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>06:17</var> UTC</small><br><strong>Resolved</strong> - Between 4:30AM UTC to 6:00AM UTC, we experienced issues for users attempting to login for Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Jira Product Discovery, Compass, and Atlassian Analytics. The issue has been resolved and the service is operating normally.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>05:19</var> UTC</small><br><strong>Investigating</strong> - We are investigating reports of intermittent errors for login to Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Jira Product Discovery, Compass, and Atlassian Analytics Cloud customers. We will provide more details once we identify the root cause.</p>tag:opsgenie.status.atlassian.com,2005:Incident/182964522023-08-28T19:30:09Z2023-08-28T19:30:09ZWe observe degraded performance on incident timeline functionality<p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>19:30</var> UTC</small><br><strong>Resolved</strong> - The issue has been resolved completely and all the functionality is fully working now. <br />The customers experienced some latencies for the entries added to the incident timeline during the incident. However, there is not data loss and all the messages processed successfully.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>19:10</var> UTC</small><br><strong>Monitoring</strong> - The rollback completed successfully and we observed the remediation. <br />The functionality is fully working now, and we are closely monitoring the system.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>19:03</var> UTC</small><br><strong>Identified</strong> - Some misconfiguration caused the incident. <br />We identified the root cause and reverting the change.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>17:57</var> UTC</small><br><strong>Investigating</strong> - We observe degraded performance on incident timeline functionality. <br />We are investigating the issue and we will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/180314442023-08-02T15:59:20Z2023-08-02T15:59:20ZSign-ups, Product Activation, and Billing not working<p><small>Aug <var data-var='date'> 2</var>, <var data-var='time'>15:59</var> UTC</small><br><strong>Resolved</strong> - We mitigated the issue with Sign-ups, Product Activation, and Billing, and the systems are back to BAU, and all functionality is restored.</p><p><small>Aug <var data-var='date'> 2</var>, <var data-var='time'>14:25</var> UTC</small><br><strong>Monitoring</strong> - We have identified the root cause of the Sign-ups, Product Activation, and Billing not working and have mitigated the problem. We are now monitoring closely.</p><p><small>Aug <var data-var='date'> 2</var>, <var data-var='time'>13:41</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with Sign-ups, Product Activation, and Billing that is impacting all of our Cloud Customers. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/177793772023-07-06T15:37:19Z2023-07-14T05:07:00ZPerformance issues and outages with Cloud products<p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>15:37</var> UTC</small><br><strong>Resolved</strong> - We experienced performance issues and outages for several Atlassian Cloud Products. The issue has been resolved and the service is operating normally.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>13:55</var> UTC</small><br><strong>Monitoring</strong> - We have identified the root cause of an issue with an internal infrastructure component that has been impacting multiple Cloud products - including Jira Software, Jira Service Management and Confluence - and customers. This issue had lead to a performance impact and, in some cases, outages.<br /><br />We have implemented a fix to resolve the issue and recovery is in progress.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>11:18</var> UTC</small><br><strong>Identified</strong> - We are investigating an issue with an internal infrastructure component that is impacting multiple Cloud products, including Jira Software, Bitbucket, Jira Service Management and Confluence, and customers. These issues include performance impact and, in some cases, outages.<br /><br />Users may experience slow loading and uploading of attachments, login issues or inability for new customers to sign up. We have identified the root cause and are actively working on the service recovery.</p>tag:opsgenie.status.atlassian.com,2005:Incident/177787122023-07-06T13:32:52Z2023-07-06T13:32:52ZIntermittent errors during login for some customers<p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>13:32</var> UTC</small><br><strong>Resolved</strong> - Between 07:31 UTC to 12:32 UTC, we experienced errors during login for Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Product Discovery, Compass, and Atlassian Analytics. The issue has been resolved and the service is operating normally.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>12:56</var> UTC</small><br><strong>Monitoring</strong> - We have identified the root cause of the errors during login and have mitigated the problem. We are now monitoring closely.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>11:00</var> UTC</small><br><strong>Identified</strong> - We are investigating reports of errors during login that is impacting some Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Product Discovery, Compass, and Atlassian Analytics. We have identified the root cause and expect recovery shortly.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>09:39</var> UTC</small><br><strong>Update</strong> - We are investigating reports of errors during login for some customers that is impacting some Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Product Discovery, and Atlassian Analytics Cloud customers. We will provide more details within the next hour.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>09:34</var> UTC</small><br><strong>Update</strong> - We are investigating reports of errors during login for some customers that is impacting some Atlassian Support, Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Product Discovery, and Atlassian Analytics Cloud customers. We will provide more details within the next hour.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>09:03</var> UTC</small><br><strong>Investigating</strong> - We are investigating reports of errors during login for some customers that is impacting some Confluence, Jira Work Management, Jira Service Management, Jira Software, Opsgenie, Trello, Atlassian Bitbucket, Atlassian Access, Jira Product Discovery, and Atlassian Analytics Cloud customers. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/176848772023-06-26T12:36:55Z2023-06-26T12:36:55ZIncreased delays on all flows in EU region<p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>12:36</var> UTC</small><br><strong>Resolved</strong> - Our engineers have been closely monitoring the platform and are declaring this incident resolved. Thank you for your patience.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>12:33</var> UTC</small><br><strong>Monitoring</strong> - Our engineering team has implemented fixes. We are monitoring all systems. Thank you for your patience.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>11:49</var> UTC</small><br><strong>Update</strong> - Due to extreme load, we are experiencing problem in cache layer. Our team is actively addressing the problem and working on implementing a fix as quickly as possible. We appreciate your patience.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>09:44</var> UTC</small><br><strong>Update</strong> - We detected delays in login flow. We identified the problem and working on fix.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>07:42</var> UTC</small><br><strong>Update</strong> - We are continuing on a fix for the issue.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>06:30</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>06:30</var> UTC</small><br><strong>Update</strong> - The team has identified the cause of the problem and actively working on it to mitigate the delays.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>06:25</var> UTC</small><br><strong>Investigating</strong> - Our platform is experiencing some delays for all system in EU region. Team is actively working on it to mitigate the delays.<br /><br />We'll keep you posted with further updates.</p>tag:opsgenie.status.atlassian.com,2005:Incident/174917152023-06-06T17:24:57Z2023-06-06T17:32:27ZPartial Outage in Schedule API<p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>17:24</var> UTC</small><br><strong>Resolved</strong> - Our engineering team has fixed the problem and we are closely monitoring the platform. Thank you for your patience.</p><p><small>Jun <var data-var='date'> 6</var>, <var data-var='time'>17:06</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with Schedule API that is impacting some Opsgenie US Cloud customers. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/167707622023-04-06T15:07:51Z2023-04-06T15:07:51ZPartial outage in ICC sessions due to network problem<p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>15:07</var> UTC</small><br><strong>Resolved</strong> - Our engineers have been closely monitoring the platform and are declaring this incident resolved. Thank you for your patience.</p><p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>14:45</var> UTC</small><br><strong>Identified</strong> - The problem is related to a misconfiguration on our network causing ICC sessions to fail. We are working on a fix and adjusting our network. Incident flow is continue to work without a problem and there is no data loss. We appreciate your patience as our teams continue with our investigations into the service interruption</p>tag:opsgenie.status.atlassian.com,2005:Incident/167501382023-04-04T18:16:20Z2023-04-26T06:43:45ZDelays in Android push notifications<p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>18:16</var> UTC</small><br><strong>Resolved</strong> - This incident on Firebase has been resolved. Android push notifications are operational.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>18:13</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>15:23</var> UTC</small><br><strong>Update</strong> - Android push notification delivery is fully operational for now, but we are still monitoring the Firebase outage (https://status.firebase.google.com/incidents/9ZPv9faHLen8bzLVSaft).</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>14:34</var> UTC</small><br><strong>Monitoring</strong> - The issue has been identified as caused by an error on Firebase (https://status.firebase.google.com/incidents/9ZPv9faHLen8bzLVSaft). We continue to monitor the situation and send update within the next hour.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>14:30</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue with our Android push notifications that is impacting some of our notifications for Android. We will provide more details within the next hour.</p>tag:opsgenie.status.atlassian.com,2005:Incident/167394322023-04-03T17:34:11Z2023-04-13T07:16:59ZIncreased delays on Jira Cloud and Jira Service Management Cloud integrations while creating/updating Opsgenie alerts in US region<p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>17:34</var> UTC</small><br><strong>Resolved</strong> - We observed some delays while creating/updating alerts from Jira Cloud and Jira Service Management Cloud integrations in US region. <br />The problem is resolved now.</p>tag:opsgenie.status.atlassian.com,2005:Incident/165558092023-03-19T11:00:18Z2023-03-19T11:00:18ZOpsgenie Reporting & Analytics is under maintenance in US<p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>11:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>11:31</var> UTC</small><br><strong>Scheduled</strong> - Scheduled - We will be undergoing a scheduled maintenance of Opsgenie Analytics in US region</p>tag:opsgenie.status.atlassian.com,2005:Incident/162897842023-03-04T18:22:25Z2023-03-04T18:22:25ZOpsgenie On Call analytics dashboards are not showing data<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>18:22</var> UTC</small><br><strong>Resolved</strong> - For the 3 impacted dashboards, we have made data accessible for upto 1 year. For date ranges longer than 1 year, please reach out to the customer support. We will continue to monitor the system.</p><p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>13:27</var> UTC</small><br><strong>Update</strong> - The team is still working to increase the data accessibility for the 3 impacted dashboards. We will keep you posted on further updates.</p><p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>12:19</var> UTC</small><br><strong>Update</strong> - While we continue to increase the data accessibility for the 3 impacted dashboards, customers can continue to use them for the last 6 months of data. Rest of the reporting dashboards are working as expected. We will keep you posted on further updates.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>07:04</var> UTC</small><br><strong>Update</strong> - While we continue to fix the data, we have observed latency in data shown for a few of the other analytics dashboards. We will continue to work to fix the rest of the data and will update you once we have more information.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>15:14</var> UTC</small><br><strong>Update</strong> - Data is fixed for last six months and impacted dashboards can be generated with last six month of data. We will continue to work on fixing rest of the data and will update once we have more information.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>19:37</var> UTC</small><br><strong>Update</strong> - Job triggered to fix rest of the data is taking more time then expected, we are actively monitoring it and will update once we have more information.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>10:39</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>10:37</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>10:28</var> UTC</small><br><strong>Update</strong> - We have identified the root cause and rolled out a fix for the last month of data. All data generated in the last month should be accessible. We have triggered the fix for the rest of the data and will update once the data is fully accessible.</p><p><small>Feb <var data-var='date'>27</var>, <var data-var='time'>08:49</var> UTC</small><br><strong>Investigating</strong> - Opsgenie "On Call Reports", "On Call Time Analytics" & "Total On Call Time per User" Analytics dashboards are not showing data. We are working to identify the root cause and we'll keep you posted with further updates.</p>tag:opsgenie.status.atlassian.com,2005:Incident/158354872023-01-17T06:18:30Z2023-01-17T06:18:30Z"_incomingData" and "_actionSource" fields are missing in Opsgenie Debug logs<p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>06:18</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>14:59</var> UTC</small><br><strong>Monitoring</strong> - "_incomingData" and "_actionSource" fields are visible in debug logs generated after January 13, 2023 1:55:39 PM UTC</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>13:07</var> UTC</small><br><strong>Identified</strong> - We have identified the problem and worked on the solution to fix debug logs now.</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>11:52</var> UTC</small><br><strong>Investigating</strong> - We have identified that "_incomingData" and "_actionSource" fields are missing in Opsgenie Debug Logs due to internal issues.</p>tag:opsgenie.status.atlassian.com,2005:Incident/141878502022-12-02T19:51:20Z2022-12-02T19:51:20ZObserving delays in incoming webhook integration processing in EU region<p><small>Dec <var data-var='date'> 2</var>, <var data-var='time'>19:51</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 2</var>, <var data-var='time'>19:23</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'> 2</var>, <var data-var='time'>19:09</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>