Data model for analysis of scholarly documents in the MapReduce paradigm
Loading...
synat2012_submission_7.pdf (321.86 KB)
Date
2013
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Using this material is possible in accordance with the relevant provisions of fair use or other exceptions provided by law. Other use requires the consent of the holder.
Abstract
At CEON ICM UW we are in possession of a large collection of scholarly documents that we store and process using MapReduce paradigm. One of the main challenges is to design a simple, but effective data model that fits various data access patterns and allows us to perform diverse analysis efficiently. In this paper, we will describe the organization of our data and explain how this data is accessed and processed by open-source tools from Apache Hadoop Ecosystem.
Description
Citation
A. Kawa, Ć. Bolikowski, A. Czeczko, P. J. Dendek, and D. Tkaczyk, âData model for analysis of scholarly documents in the MapReduce paradigm,â in Intelligent Tools for Building a Scientific Information Platform, R. Bembenik, L. Skonieczny, H. Rybinski, M. Kryszkiewicz, and M. Niezgodka, Eds. Springer, 2013, pp. 155â169.