All ideasMore in Hobbies
Hobbies

We audited Datasette with AI and shipped two security releases

He ran an extensive audit of his Datasette software using AI Fable 5.1, GPT-5.6 Sol and GPT-6 Astra, then fixed a range of bugs the audit found. The fixes went out as the Datasette 1.0a39 and 0.65.4 security releases, and he told anyone running Datasette on a public website to upgrade.

How it works

  1. Runs an extensive audit with AI Fable 5.1, GPT-5.6 Sol and GPT-6 Astra
  2. Fixes a range of bugs the audit found
  3. Publishes Datasette 1.0a39 and 0.65.4 as security releases

Why it’s worth knowing

Three rival models audited the same codebase together, and the result was not a report. It was two shipped security releases that other people were told to install.

Where it’s from

Summarized from a public post on bsky.app. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be
2The prompt, with the steps
3The check when it’s done
Upgraded prompts are coming soon.

Try next

HobbiesSpark Learned a Writer's Voice From Sent Emails and Saved It as a Reusable SkillHobbiesThe AI searched five years of email and listed my forgotten accountsHobbiesThe AI built its own mail app in 23 minutesHobbiesI cut my bots' wakeups from about 300 a week to about 140

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.