2026년에는 아무도 온콜을 서지 않아야 합니다.
코드를 읽고, 인프라를 지켜보고, 여러분이 깨기 전에 프로덕션을 고치는 에이전트.
대기자 명단 등록
또는
· 현재 얼리 액세스를 순차적으로 제공하고 있습니다.
Polylane은 앱의 이슈를 찾아 자동으로 고쳐 줍니다.
여러분이 운영하는 모든 것을 학습합니다. 모든 클라우드, 모든 리포지토리, 모든 의존성이 하나의 실시간 그래프에.
Topology Share
Search your cloud resources...
Filter Galaxy Flow Table
checkout-edge Worker Critical Critical to your architecture.
Issue hotspot: 4 issues in the last 7 days
Change hotspot: 12 changes in the last 7 days
Cloudflare · coreplane · earth · Compute
hd-prod Hyperdrive Critical Critical to your architecture.
Change hotspot: 7 changes in the last 7 days
Cloudflare · coreplane · earth · Databases
ingest-events Lambda function Standard Important to your architecture.
Issue hotspot: 2 issues in the last 7 days
AWS · coreplane-prod · us-east-1 · Compute
payments-db Database Critical Critical to your architecture.
Issue hotspot: 1 issue in the last 7 days
Change hotspot: 3 changes in the last 7 days
PlanetScale · coreplane · us-east · Databases
문제를 찾는 일을 멈추지 않습니다. 이슈가 스스로 드러납니다. 누구도 경보를 걸 생각을 못 한 것까지.
Issues Critical latency degradation in checkout-edge worker Overview
Critical latency degradation in checkout-edge worker
Incident critical Polylane ·Detected 3 hours ago ·Last seen 4 minutes ago ·2 occurrences
OverviewInvestigationMetricsTimelineProperties
checkout-edge › Cloudflare Worker Critical latency degradation detected in checkout-edge worker: 18x+ P99 latency spikes sustained for 12 minutes
Causal metrics All metrics
Request Duration
414 ms ▲ 43.1σ
Wall Time
416 ms ▲ 43.0σ
CPU Time
14 ms ▲ 2.6σ
Blast radius edge-gateway Cloudflare Worker ··· checkout-edge Cloudflare Worker ··· hd-prod Hyperdrive ··· payments-db PlanetScale ··· cart-svc Cloudflare Worker ···
Search your cloud resources...
5 resources Graph Table
edge-gateway Cloudflare Worker ··· checkout-edge Cloudflare Worker ··· hd-prod Hyperdrive ··· payments-db PlanetScale ··· cart-svc Cloudflare Worker ··· Analysis Copy
Deploy 9f3c2a1 shrank the Hyperdrive pool
hd-prod from 50 connections to 5. Under checkout load,
requests queue on connection checkout and P99 rises 18× against the 30-minute baseline. Restoring the pool size restores latency.
Tags
service · checkout-edgeprovider · cloudflaredeploy · 9f3c2a1signal · wall_time_p99
이미 있는 모든 경보를 듣습니다. 모든 경보가 트리아지되고, 진짜인 것은 조사되고 수정됩니다.
Issues
Issues
Problems detected by Polylane and alerts from your monitoring tools, triaged automatically.
IncidentsNo incidentAll Search issues... Filter
Title Detected by Impact Severity Status Occurrences
Critical latency degradation in checkout-edge worker 
Polylane checkout-edge Cloudflare Worker critical Incident 2
Polylane checkout-edge Cloudflare Worker critical Incident 2 checkout-edge P99 latency above 2s for 5m 
Datadog checkout-edge Cloudflare Worker critical Incident 118
Datadog checkout-edge Cloudflare Worker critical Incident 118 TypeError: cannot read 'region' of undefined in checkout handler 
Sentry 
cart-svc Deployment medium Triaging 41
Sentry cart-svc Deployment medium Triaging 41 edge-gateway 5xx ratio above 1% for 5m 
Grafana Cloud 
edge-gateway Fly Machine medium No incident 6
Grafana Cloud edge-gateway Fly Machine medium No incident 6 orders-db CPUUtilization above 80% 
CloudWatch 
orders-db Aurora cluster low No incident 1
CloudWatch orders-db Aurora cluster low No incident 1 payments-api webhook retry queue depth above 5,000 Datadog payments-api Cloudflare Worker high Resolved 3
Datadog payments-api Cloudflare Worker high Resolved 3 증상이 아니라 문제를 고칩니다. 감지한 모든 이슈의 근본 원인을 찾고 수정 PR을 제출합니다.
github.com/coreplane/payments-api/pull/491
Cap retries on the checkout webhook worker #491
polylane Open polylane wants to merge 1 commit into
main from polylane/autofix/chat/k3x9f2-4e7d21a Conversation 1 Commits 1 Checks 1 Files changed 2
polylane bot commented 6 minutes ago ···
Retries on the checkout webhook worker were unbounded: a failing delivery re-queued itself forever and amplified load on payments-api. This caps delivery at 5 attempts with exponential backoff and dead-letters the payload after the last one.
What changed
worker/deliver.ts gains MAX_DELIVERY_ATTEMPTS = 5 and backoff between attempts; exhausted payloads land in checkout-webhooks-dlq instead of re-queueing.
Validation
npm test — 214 passed. A forced failing delivery stopped after 5 attempts and appeared in the dead-letter queue.
Root cause · Why it's safe · Out of scope
polylane added commit 4e7d21a Verified
Review required At least 1 approving review is required
ci / test Successful in 3m 12s Details
Review required Waiting on your review: Polylane never merges on its own
Merging is blocked
온콜이 받는 질문에 답합니다. 담당자는 누구인지, 무엇이 바뀌었는지, 우리 문제인지. 스레드에서 증거와 함께 답합니다.
# incidents
Messages
Add canvas
Files & links
Polylane Agent 2:14 AM
Critical latency regression on checkout-edge: Wall Time P99 is 18× baseline, sustained since 2:02 AM, and checkout requests are queuing. I'm investigating.
boris 2:15 AM
probably the Hyperdrive change in tonight's deploy?
👀 1 Polylane Agent 2:16 AM
Working on it
- ✓ Pulled the last 30 minutes of checkout-edge metrics
- ✓ Correlated with the change records
- ◐ Testing the Hyperdrive pool hypothesis
- ○ Draft the fix
status as of 2:17 AM UTC
Polylane Agent 2:19 AM
You're right. Deploy 9f3c2a1 shrank the
hd-prod connection pool from 50 to 5,
and checkout requests queue behind connections. Confirmed against the pool metrics and the change record.
Fix is drafted, coreplane/checkout-edge#142 restores the pool.
CI is running; I'll report back here.
Open in Polylane Configure
프로덕션을 터미널로 가져옵니다. 코딩 에이전트가 무엇을 바꾸기 전에 지금 무엇이 돌아가는지 봅니다.
claude — ~/checkout-edge
> make region a required field on the checkout request schema
●polylane · searchcallers of POST /checkout
●polylane · runToolqueryLogs · request shapes
⏺ Hold on: cart-svc and edge-gateway still send region-less requests, 41,200 in the last 24h. Requiring it now would 400 them both. Safer: default it, migrate the two callers, then require. Are you okay with this plan?
Waiting for your reply…
모든 인시던트를 기억합니다. 다음 인시던트는 절대 처음부터 시작하지 않습니다.
Settings Memories
Memories
Institutional knowledge from investigations and observations.
All Mine Search memories... Filter 7 memories
Name Source Created by Created
hd-prod must keep 50 connections: at 5, checkout-edge requests queue and P99 rises 18x Investigation P System 3 hours ago
Deploys that touch checkout-edge's Hyperdrive binding need the pool size checked in review Change analysis P System 3 hours ago
cart-svc and edge-gateway still send region-less checkout requests; region stays optional until they migrate Investigation P System yesterday
payments-api webhook retries are capped at 5 with backoff since #491; dead-letters land in checkout-webhooks-dlq Change analysis P System 2 days ago
payments-db connection spikes follow cart-svc retries, not checkout traffic Observation P System 6 days ago
checkout-edge P99 sits at 1.4-1.8s on weekday evenings; the Sunday 02:00 UTC bump is the analytics backfill Observation P System 2 weeks ago
edge-gateway returns 502 for 40s after every deploy while its Fly machines drain; not an incident Change analysis P System 3 weeks ago
