Punchh
All Systems Operational

About This Site

Status Page for Punchh

Uptime over the past 90 days. View historical uptime.
Management Portal
Operational
90 days ago
99.77 % uptime
Today
Dashboard
Operational
90 days ago
99.77 % uptime
Today
Mobile API
Operational
90 days ago
99.77 % uptime
Today
API
Operational
90 days ago
99.77 % uptime
Today
POS DataSink
Operational
90 days ago
99.77 % uptime
Today
Background Workers Operational
90 days ago
99.77 % uptime
Today
Data Pipeline Operational
90 days ago
99.77 % uptime
Today
Data Export Operational
90 days ago
99.77 % uptime
Today
Webhooks Operational
90 days ago
99.77 % uptime
Today
Cloudinary Operational
Cloudinary Image CDN Delivery
Operational
Cloudinary Upload API Operational
Sendgrid Operational
SendGrid SMTP
Operational
SendGrid Event Webhook Operational
SendGrid API Operational
Pusher notifications Operational
Pusher Channels WebSocket client API Operational
Pusher Channels Webhooks Operational
Pusher Channels REST API Operational
Mailchimp Mandrill Operational
Mandrill Global
Operational
AWS elasticsearch-us-east-1 Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

System Metrics Month Week Day
Mobile API
Fetching
POS Service
Fetching
Auth Service
Fetching
Iframe Service
Fetching
Engagement
Fetching
Dashboard
Fetching
Past Incidents
Oct 2, 2023

No incidents reported today.

Oct 1, 2023

No incidents reported.

Sep 30, 2023

No incidents reported.

Sep 29, 2023

No incidents reported.

Sep 28, 2023
Punchh Platform Elevated API Response Time Caused by High Database Usage
Resolved - This incident has been resolved.
Sep 28, 03:07 PDT
Identified - We are experiencing API Service performance issues caused by heavy database usage. We are investigation the issue and hope to resolved this problem in a timely manner.

Impacted Service
API Services (Mobile, POS, ISL, API.punchh.com)
Dashboard Services
Sep 28, 02:32 PDT
Punchh Platform Hotfix Release Deployment - No Downtime
Completed - The scheduled maintenance has been completed.
Sep 28, 01:31 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 28, 00:30 PDT
Scheduled - Punchh Ops team will be deploying a new Hotfix release that will address functional and stability issues. This release will not cause any downtime during deployment.
Sep 27, 16:04 PDT
Sep 27, 2023
Planned Database Maintenance - Downtime Expected
Completed - The scheduled maintenance has been completed.
Sep 27, 02:47 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 27, 01:00 PDT
Scheduled - We will be restarting some database to enabled better performance monitoring during this reboot the system will not be available.

Additionally, we will be upgrading our main backend Data Lake MySQL Database to version 8. During this time all downstream Data Pipelines and Data Exports for Dashboard reporting will be delayed. This upgrade will not impact API Service or Dashboard access.
Sep 25, 16:05 PDT
Sep 26, 2023

No incidents reported.

Sep 25, 2023

No incidents reported.

Sep 24, 2023
Planned Database Maintenance - Downtime Expected
Completed - The scheduled maintenance has been completed.
Sep 24, 03:20 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 24, 01:02 PDT
Scheduled - We will be conducting a RDS MySQL version upgrade during this time. We apologize for this inconvenience but this effort to help make our platform more stable and reliable.

Service Impacted
API Services
Campaign Processing
Data Pipelines
Core Systems
Sep 22, 09:09 PDT
Sep 23, 2023

No incidents reported.

Sep 22, 2023
Punchh ISL Service is Reporting High Error Rates
Resolved - This incident has been resolved.
Sep 22, 01:49 PDT
Investigating - We are experiencing higher than normal error rates from our ISL service. We will be conducting a maintenance cycle to increase resources for a specific database.
Sep 21, 20:03 PDT
Planned Database Maintenance - Limited Downtime Expected
Completed - The scheduled maintenance has been completed.
Sep 22, 01:49 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 22, 01:00 PDT
Scheduled - We will be conducting and upscale of resources for one of our database to address a specific incident. The Punchh system should be accessible except for the ISL service for POS receipt uploads.

Service Impacted
ISL Service
Sep 21, 20:05 PDT
Sep 21, 2023
Planned Database Maintenance - Downtime Expected
Completed - The scheduled maintenance has been completed.
Sep 21, 03:02 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 21, 01:00 PDT
Update - We are moving this planned maintenance period to Sept 21st 1:00AM PDT.
Sep 20, 10:35 PDT
Scheduled - We will be conducting new increased resources allocations on several database for better stability and reliability. During this period the system will not be available.
Sep 19, 13:21 PDT
Sep 20, 2023
New Release Hotfix Rollout - No Dowtime
Completed - The scheduled maintenance has been completed.
Sep 20, 01:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 20, 00:00 PDT
Scheduled - We will be undergoing scheduled maintenance during this time.
Sep 19, 22:52 PDT
Sep 19, 2023
Cloud Provider Service interruption
Resolved - This incident has been resolved.
Sep 19, 06:58 PDT
Update - The Punchh Systems seems to be operating at this time but we are still tracking an AWS Incident that is still being addressed.
Sep 18, 14:45 PDT
Identified - We are experiencing intermittent API latency and downtime due to an ongoing AWS network infrastructure issue.
Sep 18, 12:58 PDT
Sep 18, 2023
← Incident History Powered by Atlassian Statuspage