Design and analysis of a lean interface for Sanskrit corpus annotation

Authors

  • Pawan Goyal IIT Kharagpur
  • Gerard Huet Inria

Keywords:

Sanskrit, text segmentation, annotation, linguistic interfaces

Abstract

We describe an innovative computer interface designed to assist annotators in the efficient selection of segmentation solutions for proper tagging of Sanskrit corpora. The proposed solution uses a compact representation of the shared forest of all segmentations. The main idea is to represent the union of all segmentations, abstracting from the sandhi rules used, and aligning with the input sentence. We show that this representation provides an exponential saving, in both space and time.


The segmentation methodology is lexicon-directed. When the lexicon does not have full coverage of the corpus vocabulary, some chunks of the input may fail to be recognized. We designed a lexicon-acquisition facility, which remedies this incompleteness and makes the interface more robust.


This interface has been implemented, and is currently being applied to the annotation of the Sanskrit Library corpus. Evaluation over 1,500 sentences from the Pañcatantra text shows the effectiveness of the proposed interface on real corpus data.

DOI:

https://doi.org/10.15398/jlm.v4i2.108

Full article

Published

2016-10-18

How to Cite

Goyal, P., & Huet, G. (2016). Design and analysis of a lean interface for Sanskrit corpus annotation. Journal of Language Modelling, 4(2), 145–182. https://doi.org/10.15398/jlm.v4i2.108

Issue

Section

Tools and Resources