punkt alternatives and similar packages

Based on the "Natural Language Processing" category.
Alternatively, view punkt alternatives based on common mentions on social networks and blogs.

chatter

9.0 1.2 punkt VS chatter

A library of Natural Language Processing algorithms for Haskell.
mecab

8.0 0.0 punkt VS mecab

A Haskell binding to MeCab

Run Linux Software Faster and Safer than Linux with Unikernels

Promo github.com/nanovms

numerals

7.9 0.0 punkt VS numerals

Convert numbers to number words
nerf

6.6 0.0 punkt VS nerf

Named entity recognition tool based on linear-chain CRFs
cndict

6.6 0.0 punkt VS cndict

Chinese/Mandarin <-> English dictionary, Chinese lexer.
concraft-pl

6.1 0.3 punkt VS concraft-pl

A morphosyntactic tagger for Polish based on conditional random fields
hext

5.8 0.7 punkt VS hext

a text classification library
concraft

5.2 0.0 punkt VS concraft

A morphosyntactic disambiguation library based on constrained conditional random fields
partage

4.6 0.0 punkt VS partage

A* parser for tree adjoining grammars
tsuntsun

4.6 0.0 punkt VS tsuntsun

Interacts with tesseract to ease reading of RAW Japanese manga.
minimorph

4.2 0.0 punkt VS minimorph

English spelling functions with an emphasis on simplicity. Originally by https://github.com/kowey.
PTQ

4.1 0.0 punkt VS PTQ

An implementation of Montague's PTQ (Proper Treatment of Quantification).
numerals-base

3.9 0.0 punkt VS numerals-base

Convert numbers to number words
haskell-postal

3.5 0.0 punkt VS haskell-postal

Haskell binding for the libpostal library
corenlp-parser

3.3 0.0 punkt VS corenlp-parser

Launches CoreNLP and parses the JSON output
hist-pl

3.0 0.0 punkt VS hist-pl

Programs and libraries related to the historical dictionary of Polish
polh-lexicon

3.0 0.0 punkt VS polh-lexicon

Programs and libraries related to the historical dictionary of Polish
sentiwordnet-parser

3.0 0.0 punkt VS sentiwordnet-parser

Parser for the [SentiWordNet](http://sentiwordnet.isti.cnr.it/) tab-separated file
crf-chain2-tiers

2.6 0.0 punkt VS crf-chain2-tiers

Second-order, tiered, constrained, linear conditional random fields
adict

2.4 0.0 punkt VS adict

Approximate dictionary searching Haskell library
phonetic-code

2.4 0.0 punkt VS phonetic-code

phonetic codes in Haskell
data-named

2.3 0.0 punkt VS data-named

Named entity data layer
penntreebank-megaparsec

1.0 0.0 punkt VS penntreebank-megaparsec

Megaparsec parsers for trees in the Penn Treebank format
moan

0.9 0.0 punkt VS moan

Language-agnostic analyzer for positional morphosyntactic tags
ENIG

0.9 0.0 punkt VS ENIG

Korean postposition particle selector
concraft-hr

0.9 0.0 punkt VS concraft-hr

A part-of-speech tagger for Croatian based on the concraft library.
arpa

- - punkt VS arpa

Library for reading ARPA n-gram models

Do you think we are missing an alternative of punkt or a related project?

Add another 'Natural Language Processing' Package

README

punkt

Multilingual unsupervised sentence tokenization with Punkt.

Usage

Note that abbreviations are detected at run time without the aid of a pre-built abbreviation list:

import Data.Text (Text, pack)
import NLP.Punkt (split_sentences)

corpus :: Text
corpus = pack "Look, Ma! The quick brown Mr. T. rex swallowed the lazy dog. \
              \It really did!"

main :: IO ()
main = mapM_ print (split_sentences corpus)

yields:

"Look, Ma!"
"The quick brown Mr. T. rex swallowed the lazy dog."
"It really did!"

References

Kiss, Tibor, and Jan Strunk. "Unsupervised multilingual sentence boundary detection." Computational Linguistics 32.4 (2006): 485-525.

TODO

parallelize
modularize tokenization
- custom tokenization rules
needs to go fasterer

punkt

Unsupervised multilingual sentence segmentation.

punkt alternatives and similar packages

README

punkt

Usage

References

TODO