CodeTokenizer

type · packages/richtext/src/code.ts:23

type CodeTokenizer = (text: string) => ReadonlyArray<CodeToken>

A pure read of one code block's text. A tokenizer that needs to load first is Shiki's case.

In the guides

• DecorationsRich text / foldkit-richtext
• foldkit-richtext-codeRich text / foldkit-richtext-code