This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" malformed HTML. The object model is very similar to what proposes System.Xml, but for HTML documents (or streams). --------------------------------------- This library is sponsored by ZZZ Projects: https://entityframework-extensions.net/ https://eval-expression.net/ https://dapper-plus.net/ --------------------------------------- HAP is trusted by companies worldwide with over 150 million downloads.
Crawler-Lib Concurrency Testing allows to write unit tests with multiple threads to test the concurrency behavior of components. It has synchronization mechanisms to control the workflow of the threads and to record the execution steps. It is also possible to use it for client/server tests. It can be used in conjunction with any unit test framework or with handwritten tests.
ASP.NET Core Detection Crawler resolver components
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to structure and parallelize even complex kind of work. Please visit the project page for the complete view of the Crawler-Lib Engine. A license for the Anonymous Edition is included in the package. A license for the more powerful free Community Edition can be generated on the project page. A unrestricted license is available too.
A .net standard port of JayBizzle's CrawlerDetect project (https://github.com/JayBizzle/Crawler-Detect).
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks.
ShapeCrawler is a .NET library for manipulating PowerPoint presentations. It provides fluent APIs to process slides without having Microsoft Office installed. This library provides a simplified object model on top of the Open XML SDK for manipulating PowerPoint documents without any COM+ or COM interop layers.
Introducing `Detection` – your gateway to understanding your users' interactions with your ASP.NET Core application. With over 10 million downloads, `Detection` offers invaluable insights into your client's device, browser, engine, and platform, even identifying crawlers. Tailor your application to your users' needs, enhance the user experience, and optimize for SEO. Discover the power of `Detection` and let's create seamless, personalized experiences for all users.
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Core platform. This NuGet package supports can be used with Universal Windows Platform, ASP.NET 5 (using .NET Core) and full .NET Framework 4.6. Original description: This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" malformed HTML. The object model is very similar to what proposes System.Xml, but for HTML documents (or streams).
Aspose.HTML for .NET is a cross-platform class library that works as a headless browser, seamlessly integrating with .NET, C#, VB.NET, and ASP.NET applications. It supports HTML5, CSS3, SVG, and Canvas while building a Document Object Model (DOM) based on the WHATWG standard. Developers can navigate and manipulate HTML documents using DOM traversal, XPath, CSS selectors, or JavaScript. Along with a wide range of functions for programmatic work with HTML content, the library allows users to load, read, convert, and render SVG, MHTML, Markdown, and EPUB documents. Aspose.HTML for .NET provides robust data extraction capabilities, enabling you to parse and extract information from HTML documents. It also supports binding data from XML or JSON sources to HTML templates, making it ideal for generating dynamic content. Additional features include CSS extraction, document sandboxing, SVG file management, support for asynchronous operations, custom output stream handling, real-time DOM observation using MutationObserver, an HTML form editor, comprehensive web accessibility testing, and more. Aspose.HTML for .NET provides comprehensive format conversion support, enabling your applications to convert from HTML, XHTML, SVG, EPUB, MHTML, and Markdown documents to various formats, including PDF, XPS, DOCX, images, etc. It is optimized for handling complex and large-scale documents, making it ideal for web automation, content creation and management.
Aspose.Total for .NET is the most complete package of all .NET file format APIs offered by Aspose. It empowers developers to create, edit, render, print and convert between a wide range of popular document formats within any .NET, C#, ASP.NET and VB.NET applications.
Crawler-Lib NHunspell is a spell check, hyphenation, word stemming and thesaurus library based on the Open Office spell check library Hunspell. NHunspell can use the vast amount of OpenOffice dictionaries. It is an alternative to NetSpell, GNU Aspell, ISpell, PSpell and Enchant. It wraps the native libraries for Hunspell and Hyphen and contains a fully managed version of MyThes. NHunspell is licensed under: GPL/LGPL/MPL. Free use in commercial applications is permitted according to the LGPL and MPL licenses. Your commercial application can link against the NHunspell DLLs. IMPORTANT: Please visit the Project Site to get informations about Installation, Samples and Directories.
Device Detection and User-Agent parser for .NET and C#. Detects the device, browser, operating system, and crawlers from the User-Agent and User-Agent Client Hints, using the 51Degrees cloud service with a Resource Key. This package is the cloud engine for the 51Degrees Pipeline API. An alternative to UAParser.js, DeviceAtlas, and WURFL.
Device Detection and User-Agent parser for .NET and C#. Detects the device, browser, operating system, and crawlers from the User-Agent and User-Agent Client Hints. This package contains shared classes used by the cloud and on-premise engines for the 51Degrees Pipeline API. An alternative to UAParser.js, DeviceAtlas, and WURFL.
HTTP, HTTPS, FTP, S3, Azure, Kvpbase, and filesystem crawlers for Komodo. Please either install Komodo.Daemon to integrate search within your application, or Komodo.Server to run a standalone server. Komodo is an information search, metadata, storage, and retrieval platform.
Device Detection and User-Agent parser for .NET and C#. Detects the device, browser, operating system, and crawlers from the User-Agent and User-Agent Client Hints, reading a data file on your server. This package is the on-premise Hash engine for the 51Degrees Pipeline API. CMake is used to build the native binaries. An alternative to UAParser.js, DeviceAtlas, and WURFL.
Contains shared CDK construct for provision crawler
Provides a Logger and an ITestSink to pass through application and make sure all logs are ok.
The Crawler-Lib Service Base is a foundation for the development of Windows Services, Cloud Services and Linux Daemons.
Device Detection and User-Agent parser for .NET and C#. Detects the device, browser, operating system, and crawlers from the User-Agent and User-Agent Client Hints, on-premise with a data file or in the cloud. This package holds the builders that set up an on-premise or cloud pipeline with the 51Degrees Pipeline API. An alternative to UAParser.js, DeviceAtlas, and WURFL.
The Crawler-Lib Service Testing configures a testing environment for the development of Windows Services, Cloud Services and Linux Daemons.
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to take complete control over the crawl process.
The Crawler-Lib Service WinForms Testing Host allows to run Services with a WinForm testing GUI.
The Crawler-Lib Testing Base for Service Hosts provides basic functionality for service hosts with testing capabilities.
A configurable Playwright crawler with rich stealth and control options.
The Crawler-Lib Service Console Host allows to run Windows Services and Linux Daemons as a console program.
The Crawler-Lib Windows Service Host runs a Crawler-Lib Service as a Windows Service.
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" malformed HTML. The object model is very similar to what proposes System.Xml, but for HTML documents (or streams).
A fluent wrapper for Selenium and many usefull tools to web crawlers
Contains shared CDK construct for provision crawler