All ideasMore in Work

He scraped 5.9 million jobs from company sites and built a job board

Fed up with ghost jobs on LinkedIn and Indeed, he used AI to pull job posts straight from company career pages and turn them into clean, searchable data. The result is a public job board holding 5.9 million jobs, including over 220,000 remote ones.

How it works

  1. Collect company domains
  2. Have the AI find each career page and scrape the postings
  3. Extract salary, years of experience and other fields into JSON
  4. Build filters for title, industry, seniority and remote work
  5. Publish as a public job board

Why it’s worth knowing

One person pulled millions of live job posts out of thousands of differently built career pages, a job that used to need a data team.

Where it’s from

Summarized from a public post on reddit.com. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be
2The prompt, with the steps
3The check when it’s done
Upgraded prompts are coming soon.

Try next

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.