name: github-trending description: Track GitHub trending repositories by language, topic, or keyword. Use for discovering popular projects, monitoring data engineering trends (Databricks, Spark), or finding learning resources.
GitHub Trending
Discover trending repositories on GitHub filtered by language, date range, or topic.
Quick Start
Method 1: Web Scraping (No API needed)
# Fetch trending page
web_fetch "https://github.com/trending/python?since=daily"
# Parse with browser tool for better extraction
browser.open("https://github.com/trending")
browser.snapshot()
Method 2: GitHub CLI (if authenticated)
# Search trending repos
gh search repos --sort stars --order desc --limit 10
# Filter by topic
gh search repos --topic databricks --sort stars --order desc
# Filter by language and recent updates
gh search repos --language python --sort updated --limit 10
Method 3: GitHub API (requires token)
# Search by stars (proxy for trending)
curl "https://api.github.com/search/repositories?q=created:>$(date -v-7d +%Y-%m-%d)&sort=stars&order=desc"
Trending Time Ranges
?since=daily- Today's trending?since=weekly- This week's trending?since=monthly- This month's trending
Popular Languages
Data Engineering:
python- Data science, ML, ETLscala- Spark, big datajupyter-notebook- Analysis notebooks
General:
javascript,typescript,go,rust
Filtering Strategies
For Databricks/Data Engineering
# GitHub search query
site:github.com databricks OR "delta lake" OR spark stars:>100
# Topic-based search (gh CLI)
gh search repos --topic databricks --sort stars
gh search repos --topic spark --sort stars
gh search repos --topic mlflow --sort stars
Extract Key Info
From trending page, capture:
- Repository name (owner/repo)
- Description
- Stars (total)
- Stars today/week (if shown)
- Primary language
- Topics/tags
Output Format
## 🔥 GitHub Trending - [Language/Topic] - [Date]
1. **owner/repo-name** (⭐ 12.3K | +234 today)
Description of the project
Topics: #databricks #spark #python
https://github.com/owner/repo-name
2. **owner/another-repo** (⭐ 5.6K | +89 today)
Brief description
Topics: #data-engineering #etl
https://github.com/owner/another-repo
Common Use Cases
Daily Data Engineering Trends
Track Databricks, Spark, Delta Lake projects:
1. Fetch https://github.com/trending/python?since=daily
2. Filter for keywords: databricks, spark, delta, mlflow
3. Return top 3-5 matches
Weekly Learning Resources
Find popular educational repos:
1. Search repos with topic "data-engineering" or "databricks"
2. Sort by stars (last 7 days)
3. Filter for tutorials, examples, courses
Interview Prep Projects
Discover real-world implementations:
1. Search: "databricks" OR "lakehouse" language:python
2. Filter: stars >100, updated recently
3. Look for: example projects, best practices
Tips
- Browser tool preferred for visual parsing (stars, trends)
- GitHub CLI fastest for authenticated searches
- Web scraping simplest for trending pages (no auth)
- Cache results - trending changes slowly (safe to cache 1-2 hours)
Example Script
See scripts/github-trending.sh for automated trending fetch with keyword filtering.