penntreebank-megaparsec

Megaparsec parsers for trees in the Penn Treebank format

Monthly Downloads: 0

Programming language: Haskell

License: BSD 3-clause "New" or "Revised" License

Tags: Natural Language Processing     Parsing    

Latest version: v0.2.0

README

penntreebank-megaparsec :: Megaparsec parsers for trees in the Penn Treebank format

This Haskell package provides parsers for syntactic trees annotated in the Penn Treebank format, powered by Megaparsec.

It supports vertical composition of custom label parsers with tree parsers, which means you can customize your label parsers and use these parsers to perform parsing of labels at the same time as that of trees. For the following example of categorial grammar trees,

(A/B (B He)
     (B\<A/B> thinks))

the result of tree parsing is:

Node "A/B" [
    Node "B" [
        Node "He" []
    ], 
    Node "B\<A/B>" [
        Node "thinks" []
    ]
] 

which you can make followed by a secondary parsing of labels (= categories):

Node (CatRight (Atom B) (Atom A)) [
    Node (Atom B) [
        Node (Lex "He") []
    ], 
    Node (CatLeft (Atom B) (CatRight (Atom B) (Atom A))) [
        Node (Lex "thinks") []
    ]
] 

Usage

{-# LANGUAGE OverloadedStrings #-}
{-# LANGUAGE MultiParamTypeClasses #-}

import Data.Tree.Parser.Penn.Megaparsec.Char as TC
import Data.Text (Text)
import Text.Megaparsec as MegaP

-- define the node type
data PennNode = NonTerm Text | Term Text deriving (Show)

-- define the node parsers
instance {-# OVERLAPS #-} TC.ParsableAsTerm Text PennNode where
    pNonTerm = NonTerm <$> MegaP.takeRest
    pTerm = Term <$> MegaP.takeRest

-- specify and disambiguate the type of the input stream 
parser :: (Monad m) => TC.PennTreeParserT Text m PennNode
parser = TC.pTree

main :: IO ()
main = MegaP.parseTest parser "(A (B C (D E)))"