Counting types for massive JSON datasets
Baazizi, Mohamed-Amine; Colazzo, Dario; Ghelli, Giorgio; Sartiani, Carlo (2017), Counting types for massive JSON datasets, DBPL '17: Proceedings of The 16th International Symposium on Database Programming Languages, ACM - Association for Computing Machinery : New York, NY, p. 1-12. 10.1145/3122831.3122837
TypeCommunication / Conférence
External document linkhttps://hal.science/hal-01674279/
Conference titleDBPL 2017: The 16th International Symposium on Database Programming Languages
Book titleDBPL '17: Proceedings of The 16th International Symposium on Database Programming Languages
MetadataShow full item record
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Dipartimento di Informatica [Pisa] [DI]
Dipartimento di Matematica Informatica ed Economia [DiMIE]
Abstract (EN)Type systems express structural information about data, are human readable and hence crucial for understanding code, and are endowed with a formal definition that makes them a fundamental tool when proving program properties. Internal data structures of a database store quantitative information about data, information that is essential for optimization purposes, but is not used for documentation or for correctness proofs. In this paper we propose a new idea: raising a part of the quantitative information from the system-level structures to the type level.Our proposal is motivated by the problem of schema inference for massive collections of JSON data, which are nowadays often collected from external sources and stored in NoSQL systems without an a-priori schema, which makes a-posteriori schema inference extremely useful. NoSQL systems are oriented towards the management of heterogeneous data, and in this context we claim that quantitative information is important in order to assess the relative weight of different variants.We propose a type system where the same collection can be described at different levels of abstraction. Different abstraction levels are useful for different purposes, hence we describe a parametric inference mechanism, where a single parameter specifies the chosen trade-off between succinctness and precision for the inferred type. This algorithm is designed for massive JSON collection, and hence admits a simple and efficient map-reduce implementation.
Subjects / KeywordsMap-reduce; Descriptive schemas; Schema inference; JSON; Type systems
Showing items related by title and author.