Class TokenizerExtensions
- Namespace
- AngleSharp.Html.Parser
- Assembly
- AngleSharp.dll
Extensions to access the underying tokenizer.
public static class TokenizerExtensions
- Inheritance
-
TokenizerExtensions
- Inherited Members
Methods
Tokenize(TextSource, IEntityProvider?, EventHandler<HtmlErrorEvent>?)
Performs the tokenization on the given text source.
public static IEnumerable<HtmlToken> Tokenize(this TextSource source, IEntityProvider? provider = null, EventHandler<HtmlErrorEvent>? errorHandler = null)
Parameters
source
TextSourceThe source of the tokenization.
provider
IEntityProviderThe custom entity provider, if any.
errorHandler
EventHandler<HtmlErrorEvent>The error handler to be used, if any.
Returns
- IEnumerable<HtmlToken>
A stream of consumed tokens.