ilSrSSKJr SSKJr SSKJr SSKrSr"SS \5r g!\ a SrNf=f) zNLTK text splitter.) annotations)Any) TextSplitterNTFc\^\rSrSrSrSSS.S U4SjjjjrS SjrSrU=r$) NLTKTextSplitterz"Splitting text using NLTK package.F)use_span_tokenizec >[TU]"S0UD6 XlX lX0lUR(aUR(a Sn[ U5e[ (d Sn[U5eUR(a/[RRUR5Ul g[RRUl g)zInitialize the NLTK splitter.z6When use_span_tokenize is True, separator should be ''zANLTK is not installed, please install it with `pip install nltk`.N) super__init__ _separator _language_use_span_tokenize ValueError _HAS_NLTK ImportErrornltktokenize_get_punkt_tokenizer _tokenizer sent_tokenize)self separatorlanguager kwargsmsg __class__s m/home/dmtnaga/Documents/work/airagagent/rag_env/lib/python3.13/site-packages/langchain_text_splitters/nltk.pyr NLTKTextSplitter.__init__s "6"#!"3  " "tJCS/ !yUCc" "  " ""mm@@PDO"mm99DOcfUR(am[URRU55n/n[ U5H7unupVUS:aX$S- SnXUXU-nOXUnUR U5 M9 OURXR S9nURX0R5$)z&Split incoming text and return chunks.r)r) rlistr span_tokenize enumerateappendr _merge_splitsr) rtextspanssplitsistartendprev_endsentences r split_textNLTKTextSplitter.split_text,s  " "66t<=EF#,U#3rBs@"6I *;|*; Is (33