AWS Community Day · Beirut
AI wrote
this service.
All tests are green.
It will break
in production.
Dukkan is an ordering platform for forty Beirut merchants. It launches Monday. The suite passes, CI is green, and it reads like a competent team shipped it. It is also carrying defects that will cost real money in week one.
Bring any tool you like, including AI. AI alone will not get you far — some of what is wrong is not visible from the code at all.
Closes Sat 26 Sept, 17:00 Beirut
Three levels. Each one assumes you cleared the last.
Level 1 · 15 minutes
Three things in one folder fail a pre-release security review.
Three things in this folder fail the SE² pre-release security checklist. Find them.
6
points
up to 3 findings
no penalties
Level 2 · up to 3 hours
The tests are green. That is the problem.
The tests are green. Read them against the spec.
25
points
up to 8 findings
wrong answers cost 3
Level 3 · the rest of the day
Nothing here is wrong until you know something the code does not.
Nothing in this code is wrong until you know something the code does not. You have five questions. Choose them.
41
points
up to 10 findings
wrong answers cost 3
Severity × your explanation
A root cause with evidence and a working fix scores full marks. A symptom or a file path scores a quarter.
Precision over volume
On levels 2 and 3, flagging something that is not a defect costs you three points. Some of this code is correct on purpose, and can be defended.
Fewer slots than defects
You cannot report everything. Choosing what matters, and ranking it, is the exercise.