DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
-
Updated
Jun 17, 2025 - C#
#
Crawler
A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing (web spidering).
Here are 214 public repositories matching this topic...
Headless Chrome .NET API
-
Updated
Mar 24, 2026 - C#
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
c-sharp unit-testing crawler spider csharp parsing cross-platform web-crawler netcore pluggable spiders csharp-library abot netcore2 netstandard20 netcore3 javascript-renderer netstandard21 abot-nuget netsta
-
Updated
Sep 9, 2024 - C#
A Tumblr Blog Backup Application
windows crawler downloader backup internationalization csharp tumblr wpf mvvm mef tumblr-blog tumblr-likes hidden-tumblr password-protected-tumblr tumblr-search tumblr-tags safe-mode-tumblr
-
Updated
Mar 7, 2021 - C#
A Tumblr and Twitter Blog Backup Application
windows c-sharp crawler downloader backup twitter csharp dotnet tumblr wpf mvvm tumblr-blog tumblr-like tumblr-search tumblr-backup twitter-backup blog-backup tumblr-backup-application twitter-blog twitter-backup-application
-
Updated
Feb 28, 2026 - C#
基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。
-
Updated
Oct 25, 2019 - C#
A simple but powerful web crawler library for .NET
-
Updated
Dec 15, 2023 - C#
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-w…
crawler csharp dotnetcore scraping crawling webscraper scrapy entity-framework-core webcrawler webscraping scrapy-crawler ddd-architecture htmlagilitypack webcrawling webcrawler-htmlagilitypack
-
Updated
Dec 20, 2022 - C#
简单、易用、高效 一个有态度的开源.Net Http请求框架!可以用制作爬虫，api请求等等。
-
Updated
Dec 13, 2018 - C#
An online tool (crawler) to analyze users performance in online judges (coding competition websites). Supported OJ: POJ, HDU, HYSBZ, CodeForces, UVA, ICPC Live Archive, FZU, SPOJ, Timus (URAL), LeetCode_CN, CSU, LibreOJ, 洛谷, 牛客OJ, Lutece (UESTC), AtCoder, AIZU, CodeChef, El Judge, BNUOJ, Codewars, UOJ, NBUT, 51Nod, DMOJ, VJudge
-
Updated
Feb 14, 2026 - C#
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
parser crawler scraper parsing scraping webcrawler webscraping scraping-websites datamining scraping-api scraping-tool scraping-web scraping-data
-
Updated
Oct 29, 2024 - C#
A self-hosted, extensible manga reader and download tool with plug-in support.
crawler downloader csharp dotnet manga manga-downloader manga-scraper konga kavita kamiyomu crawler-agents
-
Updated
Mar 16, 2026 - C#
Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates with Selenium, Playwright, and Puppeteer via SDKs in Python, JavaScript, and C#.
bot firefox crawler chrome scraper automation webdriver scraping selenium proxies anti-bot browser-fingerprint stealth webscraping puppeteer playwright kameleo antidetect-browser
-
Updated
Mar 23, 2026 - C#
TumblTwo, an Improved Fork of TumblOne, a Tumblr Downloader.
-
Updated
Sep 9, 2017 - C#
🌌 High productivity semi-automatic crawler generator 🛠️🧰
-
Updated
Oct 5, 2023 - C#
Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.
-
Updated
Jul 2, 2019 - C#
- Followers
- 550 followers
- Website
- github.com/topics/crawler
- Wikipedia
- Wikipedia