Comparing Databases for Inserting and Querying Jsons for Big Data

Abstract

This paper tackles the topic of performance in Big Data data ingestion, data querying and data analytics. We test the import of the Last.fm Million Song Dataset in Cassandra, Mongo, PostgreSQL, CockroachDB, Mariadb and Elasticsearch. We also test three types of queries over the JSON documents and present the test results for unique visibility in the direct comparison of the performance of the selected databases. We conclude that by using a combination of state of the art scalable database, for which we recommend Cassandra, and Elasticsearch for search and analytics, we can get a unique tool for efficiently storing and querying data which can schema easily along the way.