Improve chunking long posts by ensuring we break the text on sentence
boundaries, and targeting a number of tokens we put in each chunk instead of targeting a character count.
Loading
Please sign in to comment
boundaries, and targeting a number of tokens we put in each chunk instead of targeting a character count.