FTS5WrapperTokenizer

A type that implements a custom tokenizer for the FTS5 full-text engine by wrapping another tokenizer.

protocol FTS5WrapperTokenizer : FTS5CustomTokenizer

Mangled symbol

s4GRDB20FTS5WrapperTokenizerP What are these?

See FTS5 Tokenizers for more information.

Tokenizing Text

func accept(token: String, flags: FTS5TokenFlags, for: FTS5Tokenization, tokenCallback: FTS5WrapperTokenCallback) throws
Given a token produced by the wrapped tokenizer, notifies customized tokens to the tokenCallback function.
typealias FTS5WrapperTokenCallback
A function that lets FTS5WrapperTokenizer notify tokens.