Use case · 7 recipes

Developers and open source

Repos, files, issues, packages and questions. 7 recipes, one API call each.

Every recipe for developers and open source

github-repoverifiedOne GitHub repository's facts, then its latest releases: the first row is the repository (stars, forks, open issues, language, license, topics, homepage…api.github.com · 3 units · 17 fields github-trendingverifiedThe repositories trending on GitHub today: name, description, language, stars and stars gained today.github.com · 2 units · 7 fields package-infoverifiedOne row of facts about a package from its registry's public JSON: latest version and when it was published, description, license, homepage, repository…registry.npmjs.org · 2 units · 11 fields stackoverflow-questionsverifiedQuestions on Stack Overflow with a tag, from the Stack Exchange API: title, link, score, answer count, views, whether an answer is accepted, time, tags…api.stackexchange.com · 2 units · 11 fields app-store-searchstagedThe iPhone/iPad apps Apple's App Store returns for a search, one row per app, in Apple's order: name, developer, price and currency, rating and rating count…itunes.apple.com · 2 units · 27 fields github-filestagedFiles of a public GitHub repository, one row per file: one file, or every file under a folder (sub-folders included, in path order).raw.githubusercontent.com · 2-4 units, +1 per text file in a folder · 11 fields github-issuesstagedThe issues of one GitHub repository, one row per issue: number, title, url, state, author, labels, comment count, created and updated times, the first 300…api.github.com · 2 units · 11 fields

github-repoGitHub

verified

One GitHub repository's facts, then its latest releases: the first row is the repository (stars, forks, open issues, language, license…

Startup and investor intel17 fields

3 units · fresh 10 minTry it →

github-trendingGitHub

verified

The repositories trending on GitHub today: name, description, language, stars and stars gained today.

Startup and investor intel7 fields

2 units · fresh 30 minTry it →

package-infonpm and PyPI

verified

One row of facts about a package from its registry's public JSON: latest version and when it was published, description, license, homepage…

Developers and open source11 fields

2 units · fresh 1 hTry it →

stackoverflow-questionsStack Overflow

verified

Questions on Stack Overflow with a tag, from the Stack Exchange API: title, link, score, answer count, views, whether an answer is…

Developers and open source11 fields

2 units · fresh 5 minTry it →

app-store-searchApp Store

staged

The iPhone/iPad apps Apple's App Store returns for a search, one row per app, in Apple's order: name, developer, price and currency, rating…

Developers and open source27 fields

2 units · fresh 1 hTry it →

github-fileGitHub

staged

Files of a public GitHub repository, one row per file: one file, or every file under a folder (sub-folders included, in path order).

Developers and open source11 fields

2-4 units, +1 per text file in a folder · fresh 5 minTry it →

github-issuesGitHub

staged

The issues of one GitHub repository, one row per issue: number, title, url, state, author, labels, comment count, created and updated…

Developers and open source11 fields

2 units · fresh 5 minTry it →

Other use cases

Lead generation · 8 Competitor intelligence · 8 Market research · 9 Hiring and talent · 7 E-commerce and catalogs · 12 Social listening · 24 Startup and investor intel · 9 Travel and real estate · 5 Local and maps · 6 Video and creators · 8 Research and knowledge · 5 News and content · 7

For developers

Get a free API key and run your first crawl.

1,000 credits every month. No credit card. Your self-hosted setup keeps working.

Get a free API key

For teams

Talk to us about volume, regions and an SLA.

A 30-minute call with the team that writes the crawler. DPA on request, invoice billing, your choice of US, EU or Singapore.

Book a call hello@crawl4ai.com