ID: f903d71e2d ago

QueueLeaseLost

FW-JOBS-5E

nightly-rate-refresh lease lost after 90s

workers/rates/refresh.go in (*Worker).Run

Unhandledescalatingfernway-jobsproduction
event 24/24

Stack Trace

  • workers/rates/refresh.goin withTelemetry at line 40:11In App
  • workers/rates/refresh.goin (*Worker).Run at line 62:25In App
    60  const hold = await inventory.reserve(rateId, guests);
    61  if (!hold) return fail('hold_unavailable');
    62  return await gateway.capture(hold.token, { timeoutMs: 8000 });
    63}
    64

Highlights

release
ea424d8
rate_plan
flexible
url
/search
handled
no

Trace preview

View full trace →
http.server — GET /api/v3/availability990ms
function — applyAccrual36ms
render — PropertyGallery137ms
function — nightsBetween103ms
db.query — UPDATE bookings SET status = $1118ms
cache — GET rates:3391:2026-0893ms
db.query — SELECT * FROM room_holds WHERE token = $189ms
queue — enqueue loyalty-accrual40ms

17 hidden spans · root 990ms

Context

browser
Safari 18.3
os
Windows 11
url
/search
rate_plan
flexible
device
tablet
release
ea424d8
environment
production
handled
no
sdk
vigil-js/4.2.1

Activity

  • V

    Vigil detected this issue in fernway@2.10.2

    22 Sept, 08:50

  • AL

    Ana Lindqvist marked this as high priority

    22 Sept, 09:30

  • RK

    Rhea Kapoor Partner confirmed their p99 moved to 9.4s last Tuesday. Raising our budget is a stopgap, not the fix.

    22 Sept, 11:50

  • V

    Vigil escalated — event rate up 575% over the 7d baseline

    04 Oct, 23:52