The number of tokens that overlap between chunks. The default value is 400.
Note that the overlap must not exceed half of max_chunk_size_tokens.
MaxChunkSizeTokens int64
The maximum number of tokens in each chunk. The default value is 800. The minimum value is 100 and the maximum value is 4096.
minimum100
maximum4096
Type Static
Always static.
type OtherFileChunkingStrategyObject struct{…}
This is returned when the chunking strategy is unknown. Typically, this is because the file was indexed before the chunking_strategy concept was introduced in the API.