📋 Workflow Guides

Incident Response Workflow

Handle production incidents systematically.

Severity Levels

LevelNameResponse TimeExamples
SEV-1Critical< 15 minFull outage, data breach
SEV-2Major< 1 hourPartial outage, degraded
SEV-3Minor< 4 hoursNon-critical bug, slow perf
SEV-4LowNext businessCosmetic issue, minor bug

Incident Lifecycle

Diagram; its source is available below
Diagram source
stateDiagram-v2
    [*] --> Detected: Alert/Report
    Detected --> Acknowledged: Team notified
    Acknowledged --> Investigating: Root cause analysis
    Investigating --> Mitigating: Temporary fix
    Mitigating --> Resolved: Permanent fix deployed
    Resolved --> PostMortem: Review
    PostMortem --> [*]: Closed

Response Steps

1. Detection & Acknowledgment

  • Monitor alerts (Prometheus, Sentry, Uptime)
  • Acknowledge in incident channel
  • Assign incident commander

2. Communication

  • Notify stakeholders
  • Update status page
  • Set expectations for resolution

3. Investigation

# Check API health
curl https://api.example.com/api/health

# Check logs
kubectl logs -f deployment/gauzy-api --tail=100

# Check metrics
# Grafana dashboard → API Overview

4. Mitigation

  • Rollback if deployment-related
  • Scale up if load-related
  • Block traffic if security-related

5. Resolution & Post-Mortem

SectionContent
TimelineWhen things happened
Root CauseWhy it happened
ImpactUsers/revenue affected
Fix AppliedWhat was done
Action ItemsPrevent recurrence

Edit this page

Copyright © 2023-Present Ever Co. LTD.Docs by Sourcey