Turn webpages into LLM-ready data at scale with a simple API call

Learn More
Contact Sales
Login

GitHub Scraper API

Collect repository names and descriptions, contributors, commit history, and more from GitHub to discover development and tech trends, spot potential candidates for open roles, and build a database of code snippets and libraries to train your ML models.

  • Visual scheduler to speed up development
  • Advanced anti-bot detection bypassing
  • Dedicated Slack channel and account manager
Contact Sales

We’ll customize your concurrency, speed, and trial — for high-volume scraping.

ScraperAPI GitHub scraper details
Scrape GitHub with ScraperAPI

Join the 10,000+ data-focused companies using ScraperAPI

Scrape Thousands of GitHub Repos and Profiles

More GitHub Data, Less Hassle

ScraperAPI will return the HTML of any GitHub page you send through our Scraping API. Just send a get() request with the URL and your API key, and let us handle the rest.

  • JS rendering
  • CAPTCHA handling
  • Pool of +40M proxies
check our documentation
Auto Parsing​
json export
Search or jump to...

# Search code, repositories, users, issues, pull requests...

Search

Clear

[Search syntax tips](https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax)

#  Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Cancel  Submit feedback

#  Saved searches

## Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our [documentation](https://docs.github.com/search-github/github-code-search/understanding-github-code-search-syntax).

Cancel  Create saved search

[ Sign in](/login?return%5Fto=https%3A%2F%2Fgithub.com%2Flllyasviel%2FFramePack)

[ Sign up](/signup?ref%5Fcta=Sign+up&ref%5Floc=header+logged+out&ref%5Fpage=%2F%3Cuser-name%3E%2F%3Crepo-name%3E&source=header-repo&source%5Frepo=lllyasviel%2FFramePack) Reseting focus

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert

{{ message }}

[ lllyasviel](/lllyasviel) / **[FramePack](/lllyasviel/FramePack)** Public

* [ Notifications](/login?return%5Fto=%2Flllyasviel%2FFramePack) You must be signed in to change notification settings
* [ Fork198 ](/login?return%5Fto=%2Flllyasviel%2FFramePack)
* [  Star 4.5k ](/login?return%5Fto=%2Flllyasviel%2FFramePack)

Lets make video diffusion practical!

### License

[  Apache-2.0 license](/lllyasviel/FramePack/blob/main/LICENSE)

[ 4.5k stars](/lllyasviel/FramePack/stargazers) [ 198 forks](/lllyasviel/FramePack/forks) [ Branches ](/lllyasviel/FramePack/branches) [ Tags ](/lllyasviel/FramePack/tags) [ Activity ](/lllyasviel/FramePack/activity)

[  Star ](/login?return%5Fto=%2Flllyasviel%2FFramePack)

[ Notifications](/login?return%5Fto=%2Flllyasviel%2FFramePack) You must be signed in to change notification settings

* [ Code ](/lllyasviel/FramePack)
* [ Issues 90 ](/lllyasviel/FramePack/issues)
* [ Pull requests 5 ](/lllyasviel/FramePack/pulls)
* [ Discussions ](/lllyasviel/FramePack/discussions)
* [ Actions ](/lllyasviel/FramePack/actions)
* [ Security ](/lllyasviel/FramePack/security)
* [ Insights ](/lllyasviel/FramePack/pulse)

Additional navigation options

* [  Code ](/lllyasviel/FramePack)
* [  Issues ](/lllyasviel/FramePack/issues)
* [  Pull requests ](/lllyasviel/FramePack/pulls)
* [  Discussions ](/lllyasviel/FramePack/discussions)
* [  Actions ](/lllyasviel/FramePack/actions)
* [  Security ](/lllyasviel/FramePack/security)
* [  Insights ](/lllyasviel/FramePack/pulse)

# lllyasviel/FramePack

main

[Branches](/lllyasviel/FramePack/branches)[Tags](/lllyasviel/FramePack/tags)

Go to file

Code

## Folders and files

| Name                                                                                       | Name                                                                                       | Last commit message | Last commit date |

| Latest commit History[9 Commits](/lllyasviel/FramePack/commits/main/)                      |                                                                                            |                     |                  |
| [diffusers\_helper](/lllyasviel/FramePack/tree/main/diffusers%5Fhelper "diffusers_helper") | [diffusers\_helper](/lllyasviel/FramePack/tree/main/diffusers%5Fhelper "diffusers_helper") |                     |                  |
| [.gitignore](/lllyasviel/FramePack/blob/main/.gitignore ".gitignore")                      | [.gitignore](/lllyasviel/FramePack/blob/main/.gitignore ".gitignore")                      |                     |                  |
| [LICENSE](/lllyasviel/FramePack/blob/main/LICENSE "LICENSE")                               | [LICENSE](/lllyasviel/FramePack/blob/main/LICENSE "LICENSE")                               |                     |                  |
| [README.md](/lllyasviel/FramePack/blob/main/README.md "README.md")                         | [README.md](/lllyasviel/FramePack/blob/main/README.md "README.md")                         |                     |                  |
| [demo\_gradio.py](/lllyasviel/FramePack/blob/main/demo%5Fgradio.py "demo_gradio.py")       | [demo\_gradio.py](/lllyasviel/FramePack/blob/main/demo%5Fgradio.py "demo_gradio.py")       |                     |                  |
| [requirements.txt](/lllyasviel/FramePack/blob/main/requirements.txt "requirements.txt")    | [requirements.txt](/lllyasviel/FramePack/blob/main/requirements.txt "requirements.txt")    |                     |                  |
| View all files                                                                             |                                                                                            |                     |                  |

## Repository files navigation

* [README](#)
* [Apache-2.0 license](#)

[![](https://private-user-images.githubusercontent.com/19834515/434466232-2cc030b4-87e1-40a0-b5bf-1b7d6b62820b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NDUwODA2MTMsIm5iZiI6MTc0NTA4MDMxMywicGF0aCI6Ii8xOTgzNDUxNS80MzQ0NjYyMzItMmNjMDMwYjQtODdlMS00MGEwLWI1YmYtMWI3ZDZiNjI4MjBiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA0MTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNDE5VDE2MzE1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTgxNWNhNDYyNzI0ODUzZjk0ZTI2ZmVhYTdmNWZiOTE1NDBjMWYyYWNiOGY2YjU4NDRiNDJlM2I4ZTFlZjQ4NTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.wuBtqO9aWQWm6Xlz1X7E8DAVGB9I7IwzdH-7JSSX2S4)](https://private-user-images.githubusercontent.com/19834515/434466232-2cc030b4-87e1-40a0-b5bf-1b7d6b62820b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NDUwODA2MTMsIm5iZiI6MTc0NTA4MDMxMywicGF0aCI6Ii8xOTgzNDUxNS80MzQ0NjYyMzItMmNjMDMwYjQtODdlMS00MGEwLWI1YmYtMWI3ZDZiNjI4MjBiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA0MTklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNDE5VDE2MzE1M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTgxNWNhNDYyNzI0ODUzZjk0ZTI2ZmVhYTdmNWZiOTE1NDBjMWYyYWNiOGY2YjU4NDRiNDJlM2I4ZTFlZjQ4NTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.wuBtqO9aWQWm6Xlz1X7E8DAVGB9I7IwzdH-7JSSX2S4)

# FramePack

Official implementation and desktop software for ["Packing Input Frame Context in Next-Frame Prediction Models for Video Generation"](https://lllyasviel.github.io/frame%5Fpack%5Fgitpage/).

Links: [**Paper**](https://lllyasviel.github.io/frame%5Fpack%5Fgitpage/pack.pdf), [**Project Page**](https://lllyasviel.github.io/frame%5Fpack%5Fgitpage/)

[TRUNCATED]
python snippet
import requests

payload = {
   'api_key': 'YOUR_API_KEY',  
   'url': 'https://github.com/lllyasviel/FramePack',  
   'country': 'us',               'output_format': 'markdown' }

response = requests.get('https://api.scraperapi.com/', params=payload)
github_data = response.text

with open('github-repository.md', 'w', encoding='utf-8') as f:
   f.write(github_data)

Turn GitHub Pages into LLM-Ready Data

Just by setting the output parameter to text or markdown, ScraperAPI will return any GitHub web page data including repository names, descriptions, contributors, commit history and more in an LLM-ready format – no parsing or extra steps needed.
  • Feed your models with localized data
  • Reduce data cleaning workloads
  • Better contextual understanding of data for your Language models

Train or fine-tune your Large Language Models using data from any GitHub domain, for tasks like AI code generation, semantic repository search and more.

CHECK OUTPUT DOCUMENTATION

Speed Up Turnaround on Large GitHub Scraping Projects

Achieve higher scraping speed with our Async Scraper:

  • Increase success rates on enterprise-level sites
  • Send millions of requests simultaneously
  • Receive your data to your application directly with webhooks

Let us manage timeouts, retries, anti-scraping mechanisms, and any other complexity, and focus on getting the insights you need.

Learn about async
Async Scraper Service
Data Pipeline

Automate GitHub Scraping in a Couple of Clicks

DataPipeline lets you build and schedule complete GitHub scraping projects without writing a single line of code.

 

Just submit a list of GitHub URLs, select your preferred method to receive the data, and let us do the rest.

LEARN ABOUT DATAPIPELINE

Geotargeting for +50 Countries

Quickly set specific countries you want your request to come from to extract accurate, localized data.


Geotargeting is included in all plans.

discover all locations
ScraperAPI geotargeting
IP locatations

40M IPs Around
the World

geolocation

50+
Geolocations

Uptime guarantee

99.9%
Uptime Guarantee

Unlimited bandwith

Unlimited
Bandwidth

Professional support

Professional
Support

Use the Right Tool — Power Up Your Infrastructure or Go Low-Code

No matter the level of complexity, ScraperAPI is designed to fit any use case.

Residential Proxies

API

Integrate ScraperAPI to your existing infrastructure to improve the performance of your scrapers, achieve higher success rates, and increase scraping speed.

datapipeline.svg

DataPipeline

Automate your entire data pipeline at scale without writing a single line of code. Save on maintaining costly coding infrastructures and managing complex scrapers.

async-scraper-icon.svg

Async Scraper

Handle millions of requests at a near 100% success rate with a simple Post() request. Scale your data collection for even the toughest domains.

Scrape Millions of GitHub Repositories

Handling large projects is easier with ScraperAPI

Get in touch with our team of experts to build a plan that fits your goals, including +100 concurrent threads, an account manager, and premium support

talk to an expert

GitHub Scraping Tutorials

Learn how to scrape GitHub with our step-by-step guides

Tutorial on how to scrape GitHub with ScraperApi

👉 How to Scrape GitHub Repositories

Build a GitHub scraper to collect code snippets, repo details, and more with Python and ScraperAPI.

discover more use cases

Find the Right Scraper for You

Get accurate, actionable business insights from the world’s biggest websites.

Use our structured data endpoints (SDEs) to turn raw HTML into ready-to-analyze JSON or CSV data.

Amazon products

Amazon offers

Amazon search

eBay product

Google search

Google jobs

Google shopping

Google news

Google maps

Walmart search

Walmart category

Walmart product
Test Our SDEs

What Our Customers
Are Saying

One of the most frustrating parts of automated web scraping is constantly dealing with IP blocks and CAPTCHAs. ScraperAPI gets this task off of your shoulders.

Capterra Badge

based on 50+ reviews

The team at ScraperAPI was so patient in helping us debug our first scraper. Thanks for being super passionate and awesome!
Cristina Saavedra
Cristina SaavedraOptimization Director at SquareTrade
A dead simple API plus a generous free tier are hard to beat. ScraperAPI is a good example of how developer experience can make a difference in a crowded category.
Ilya Sukhar
Ilya SukharFounder of Parse, Partner at YCombinator
I researched a lot of scraping tools and am glad I found ScraperAPI. It has low cost and great tech support. They always respond within 24 hours when I need any help with the product.
Alexander Zharkov
Alexander ZharkovFullstack Javascript Developer
BigCommerce

Simplify GitHub Scraping with ScraperAPI

Test It Free For 7 Days

Hobby

Ideal for small projects or personal use.

Hobby

$49

/ month

$44

/ month, billed annually

  • 100,000 API Credits
  • 20 Concurrent Threads
  • US & EU Geotargeting
Start Trial

Startup

Great for small teams and advanced users.

Startup

$149

/ month

$134

/ month, billed annually

  • 1,000,000 API Credits
  • 50 Concurrent Threads
  • US & EU Geotargeting
Start Trial

Business

Perfect for small-medium businesses.

Business

$299

/ month

$269

/ month, billed annually

  • 3,000,000 API Credits
  • 100 Concurrent Threads
  • All Geotargeting
Start Trial

Scaling

Most popular

Perfect for teams looking to scale their operations.

Business

$475

/ month

$427

/ month, billed annually

  • 5,000,000 API Credits
  • 200 Concurrent Threads
  • All Geotargeting
Start Trial

Enterprise

Need more than 5,000,000 API Credits with all premium features, premium support and an account manager?

  • 5,000,000+ API credits and 200+ Concurrent Threads
  • Dedicated Account Manager
  • Slack Support
Contact Sales

Working on large projects and want to test longer?

Get a free consultation from our web scraping experts.

Contact Sales