• adderaline@beehaw.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    6 months ago

    it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.