github-trending-scrape

Github Unofficial Trending API

:octocat: A simple API that returns number of Github trending repositories and developers.

Credits: Illustration by unDraw

---

Table of Contents

Expand Table of Contents

• Projects using github-trending-api
• Backers
• API Status
• REST API
• Tutorial
  • Trending Repositories
  • Trending Developers
  • List Languages
  • List Spoken Languages
• NPM Package
  • Install
  • Browser usage (Calls an API hosted by @huchenme)
  • Server side usage (Scrape the data yourself)
  • API
    • languages
    • spokenLanguages
    • fetchRepositories(params)
    • fetchDevelopers(params)
• Contributors
  • Code Contributors
  • Financial Contributors
    • Individuals
    • Organizations
• License

Projects using github-trending-api

• Hacker Tab (Chrome Store): Chrome extension to view GitHub trending projects on new tab.
• github-trending-plus (Live): ✨ Experimental Github trending UI.
• HitUp (Chrome Store) (Website): Help you find top things, including GitHub Trending Repositories.
• Gitter: Gitter for GitHub - 可能是目前颜值最高的 GitHub 小程序客户端.
• flutter_wanandroid: Flutter 完整项目，WanAndroid 客户端，BLoC、RxDart 、国际化、主题色、启动页、引导页，拥有较好的项目结构&比较规范的代码！
• vsc-github-trending: (VS Code Marketplace): Explore Github Trending repositories directly from Visual Studio Code
• GiTiny(AppStore): iOS app for GitHub with exploring trending.
• SwiftHub: GitHub iOS client written in RxSwift and MVVM clean architecture.
• GitNews: Trending repositories from GitHub, HackerNews & Reddit (Mobile & Desktop).
• mini-github: GitHub WeChat Mini Program (可能是全网功能最全的 GitHub 微信小程序).
• StarGit (Website): Find trending repositories from GitHub. Built with Angular.
• GitTouch (App Store, Google Play): Open source GitHub App built with Flutter.
• lazyhub: :octocat: lazyhub - Terminal UI Client for GitHub using gocui.
• Gitrepos (Website): :octocat: A simple PWA app that returns Trending Repositories & Developers from GitHub, Gitlab & HackerNews.
• Trendzz (Website): Github trending PWA focusing on usability.
• Ceelog Github trending in WeChat Official Account Platform.

Backers

Thank you to all our backers! 🙏 [Become a backer]

API Status

API status is available at uptimerobot.

REST API

See the full API documentation in Apiary.

Tutorial

How to scrape any website and build an API using cheerio.js

Trending Repositories

Receive an array of trending repositories.

URL Endpoint:

https://ghapi.huchen.dev/repositories?language=javascript&since=weekly

Parameters:

• language: optional, list trending repositories of certain programming languages, possible values are listed here.
• since: optional, default to daily, possible values: daily, weekly and monthly.
• spoken_language_code: optional, list trending repositories of certain spoken languages (e.g English, Chinese), possible values are listed here.

Response:

[
  ...
  {
    "author": "google",
    "name": "gvisor",
    "avatar": "https://github.com/google.png",
    "url": "https://github.com/google/gvisor",
    "description": "Container Runtime Sandbox",
    "language": "Go",
    "languageColor": "#3572A5",
    "stars": 3320,
    "forks": 118,
    "currentPeriodStars": 1624,
    "builtBy": [
      {
        "href": "https://github.com/viatsko",
        "avatar": "https://avatars0.githubusercontent.com/u/376065",
        "username": "viatsko"
      }
    ]
  }
  ...
]

Note that GitHub trending page sometimes is empty, in that case this API returns [] in response, your application should be able to handle it or read from previous cache.

Trending Developers

Receive an array of trending developers.

URL Endpoint:

https://ghapi.huchen.dev/developers?language=javascript&since=weekly

Parameters:

• language: optional, list trending repositories of certain programming languages, possible values are listed here.
• since: optional, default to daily, possible values: daily, weekly and monthly.

Response:

[
  {
    "username": "google",
    "name": "Google",
    "type": "organization",
    "url": "https://github.com/google",
    "avatar": "https://avatars0.githubusercontent.com/u/1342004",
    "repo": {
      "name": "traceur-compiler",
      "description": "Traceur is a JavaScript.next-to-JavaScript-of-today compiler",
      "url": "https://github.com/google/traceur-compiler"
    }
  }
]

type could be organization or user.

List Languages

URL Endpoint:

https://ghapi.huchen.dev/languages

Response:

[
  {
    "urlParam": "1c-enterprise",
    "name": "1C Enterprise"
  },
  {
    "urlParam": "abap",
    "name": "ABAP"
  },
  {
    "urlParam": "abnf",
    "name": "ABNF"
  },
  {
    "urlParam": "actionscript",
    "name": "ActionScript"
  }
]

List Spoken Languages

URL Endpoint:

https://ghapi.huchen.dev/spoken_languages

Response:

[
  {
    "urlParam": "ab",
    "name": "Abkhazian"
  },
  {
    "urlParam": "aa",
    "name": "Afar"
  },
  {
    "urlParam": "af",
    "name": "Afrikaans"
  },
  {
    "urlParam": "ak",
    "name": "Akan"
  }
]

NPM Package

You could also use the API as a NPM package.

Install

$ npm install --save @huchenme/github-trending

Browser usage (Calls an API hosted by @huchenme)

import {
  languages,
  spokenLanguages,
  fetchRepositories,
  fetchDevelopers,
} from '@huchenme/github-trending';

fetchRepositories({ language: 'ruby', since: 'monthly' }).then(
  (repositories) => {
    console.log(repositories);
  }
);

fetchDevelopers({ language: 'javascript' }).then((developers) => {
  console.log(developers);
});

console.log(languages);
console.log(spokenLanguages);

Server side usage (Scrape the data yourself)

import {
  fetchRepositories,
  fetchDevelopers,
} from '@huchenme/github-trending/lib/scrape';

fetchRepositories({ language: 'ruby', since: 'monthly' }).then(
  (repositories) => {
    console.log(repositories);
  }
);

fetchDevelopers({ language: 'javascript' }).then((developers) => {
  console.log(developers);
});

console.log(languages);
console.log(spokenLanguages);

API

languages

List all languages

[
  {
    urlParam: '1c-enterprise',
    name: '1C Enterprise',
  },
  {
    urlParam: 'abap',
    name: 'ABAP',
  },
  {
    urlParam: 'abnf',
    name: 'ABNF',
  },
  {
    urlParam: 'actionscript',
    name: 'ActionScript',
  },
];

spokenLanguages

List all spoken languages

[
  {
    urlParam: 'ab',
    name: 'Abkhazian',
  },
  {
    urlParam: 'aa',
    name: 'Afar',
  },
  {
    urlParam: 'af',
    name: 'Afrikaans',
  },
  {
    urlParam: 'ak',
    name: 'Akan',
  },
];

fetchRepositories(params)

Receive an array of trending repositories.

params:

• language: possible values are the the ones from languages or just find here.
• since: daily, weekly or monthly, default to daily.
• spokenLanguageCode: possible values are the the ones from spokenLanguages or just find here.

[
  ...
  {
    author: 'google',
    name: 'gvisor',
    avatar: 'https://github.com/google.png',
    url: 'https://github.com/google/gvisor',
    description: 'Container Runtime Sandbox',
    language: 'Go',
    languageColor: '#3572A5',
    stars: 3320,
    forks: 118,
    currentPeriodStars: 1624,
    "builtBy": [
      {
        "href": "https://github.com/viatsko",
        "avatar": "https://avatars0.githubusercontent.com/u/376065",
        "username": "viatsko"
      }
    ]
  }
  ...
]

fetchDevelopers(params)

Receive an array of trending developers.

params:

• language: possible values are the the ones from languages or just find here.
• since: daily, weekly or monthly, default to daily.

[
  ...
  {
    username: 'google',
    name: 'Google',
    type: 'organization',
    url: 'https://github.com/google',
    avatar: 'https://avatars0.githubusercontent.com/u/1342004',
    repo: {
      name: 'traceur-compiler',
      description:
        'Traceur is a JavaScript.next-to-JavaScript-of-today compiler',
      url: 'https://github.com/google/traceur-compiler'
    }
  }
  ...
]

Contributors

Code Contributors

This project exists thanks to all the people who contribute. [Contribute].

Financial Contributors

Become a financial contributor and help us sustain our community. [Contribute]

Individuals

Organizations

Support this project with your organization. Your logo will show up here with a link to your website. [Contribute]

License

MIT