summaryrefslogtreecommitdiff
path: root/textproc/ruby-buftok/DESCR
blob: 14ba7c68995ab584099f90a775186db2f5475089 (plain)
1
2
BufferedTokenizer extracts token delimited entities from a sequence of
arbitrary inputs.