packages only

Type Aliasswift-transformers 0.1.17Tokenizers

ToolSpec

Tokenizer.swift:13

typealias ToolSpec = [String : Any]

Mangled symbol

s10Tokenizers8ToolSpeca What are these?

FNV24 hash: KI4T

String AutoTokenizer BertTokenizer ChatTemplateArgument Decoder LeavesWithCommonPrefixIterator Normalizer PostProcessor PreTokenizer PreTokenizerOption PreTrainedTokenizer PreTrainedTokenizerModel SplitDelimiterBehavior TokenLattice Tokenizer TokenizerError TokenizingModel Trie TrieNode

import Tokenizers

@frozen struct String

A Unicode string value that is a collection of characters.