5 Commits

Author	SHA1	Message	Date
jeanpaul	df9521ff8e	fix(core): Prevent race condition in tiktoken encoding cache (no-changelog) (#18780) ... Co-authored-by: Claude <noreply@anthropic.com>	2025-08-26 13:47:42 +02:00
jeanpaul	e233dfa4a2	refactor(core): Convert tiktoken file loading to async (#18756)	2025-08-25 20:33:38 +02:00
oleg	2402926573	fix(Token Splitter Node): Cache tokenizer JSONs in memory (#17201)	2025-07-10 19:08:29 +02:00
oleg	c5ec056eb5	fix(Token Splitter Node): Prevent tiktoken blocking on repetitive content (#16769)	2025-06-27 16:08:14 +02:00
oleg	2d638023be	feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548)	2025-06-20 16:08:16 +02:00