uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
NoSQL: Moving from MapReduce Batch Jobs to Event-Driven Data Collection
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
2015 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Collecting and analysing data of analytical value is important for many service providers today. Many make use of NoSQL databases for their larger software systems, what is less known is how to effectively analyse and gather business intelligence from the data in these systems. This paper suggests a method of separating the most valuable analytical data from the rest in real time and at the same time providing an effective traditional database for the analyser. In this paper we analyse our given data sets to decide whether big data tools are required and then traditional databases are compared to see how well they fit the context. A technique that makes use of an asynchronous log- ging system is used to insert the data from the main system to the dedicated analytical database. The tests show that our technique can efficiently be used with a tra- ditional database even on large data sets (>1000000 insertions/hour per database node) and still provide both historical data and aggregate func- tions for the analyser.

Place, publisher, year, edition, pages
2015. , 34 p.
IT, 15025
National Category
Engineering and Technology
URN: urn:nbn:se:uu:diva-260394OAI: oai:DiVA.org:uu-260394DiVA: diva2:846989
Educational program
Bachelor Programme in Computer Science
Available from: 2015-08-18 Created: 2015-08-18 Last updated: 2015-08-18Bibliographically approved

Open Access in DiVA

fulltext(728 kB)303 downloads
File information
File name FULLTEXT01.pdfFile size 728 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
Department of Information Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 303 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 2344 hits
ReferencesLink to record
Permanent link

Direct link