Tags

Monitoring

Monitoring

0 lessons
1 system design
1 behavioral interview
3 AI Engineering questions
5 community items

monitoring

AI Engineering

3 questions
AI Engineering

Separate retrieval, packing, and generation failures

Use a request trace to tell retrieval, context-packing, and generation failures apart, and report answer quality with a named denominator next to operational signals.

ai-engineering
llm-evaluation
observability
monitoring
rag

7

Easy
AI Engineering
Premium

Design a release gate with slices and uncertainty

Decide whether a candidate with better aggregate success but a regressed protected slice can ship, and design a release gate with calibrated graders, traces, and stated uncertainty.

ai-engineering
llm-evaluation
experimentation
monitoring
observability

0

Hard
AI Engineering
Premium

Design time-aware evaluation and drift response

Design rolling-origin backtests, capacity-bound metrics, label-delay handling, and drift monitoring for a synthetic card-fraud model whose chargebacks arrive weeks late, then decide whether to promote, shadow, or hold a retrained candidate.

ai-engineering
machine-learning
mlops
monitoring

0

Hard

Community

5 items
Article

Metrics, Logs, and Traces: The Three Pillars Without the Marketing

What each pillar actually does, when reaching for it pays off, and the budget I follow so I am not paying observability vendors more than I am paying for compute.

monitoring
logging
tracing
alerting
reliability

323

6

4.4 (9)

May 17, 2026

by @zarakamau

Interview Experience

Datadog Onsite: Five Hours of System Design

A Datadog senior backend onsite where four of the five rounds were system design, anchored on real telemetry-shaped problems.

system-design
interview-prep
distributed-systems
monitoring
reliability

744

9

4.3 (11)

Apr 30, 2026

by @chloesaeed

Interview Experience

DevOps / SRE Interview: The Production Postmortem Round

An SRE loop at a Series D infra company, anchored on the round where they handed me a real-feeling postmortem and asked me to find what was missing.

monitoring
interview-prep
leadership
system-design-interview
behavioral-interview

871

28

4.3 (14)

Apr 28, 2026

by @arjunrivera

Question Bundle
Free

SRE Incident Drill Questions From Our On-Call

Four incident-shaped questions our on-call rotation uses to interview SREs. Each one starts with a symptom, asks you to write the smallest diagnostic snippet, and the discussion is more important than the code.

Python
reliability
on-call
monitoring
interview-prep

833

26

4.3 (14)

Mar 30, 2026

by @alexsaeed

Article

Core Web Vitals Without the Buzzwords

LCP, CLS, INP measure three real user-felt experiences: load, stability, responsiveness. Treat them as field truth, not Lighthouse scores to game.

performance
frontend
monitoring
html-elements

1k

17

4.3 (11)

Mar 14, 2026

by @sarahgarcia