uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
Automatic Log Analysis using Machine Learning: Awesome Automatic Log Analysis version 2.0
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
2013 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Many problems exist in the testing of a large scale system. The automated testing results are not reliable enough and manual log analysis is indispensable when automated testing cannot figure out the problems. However, it requires much expert knowledge, costs too much and is time consuming to do manual log analysis for alarge scale system. In this project, we propose to apply machine learning techniques to do automated log analysis as they are effective and efficient to big data problems. Features from the contents of the logs are extracted and clustering algorithms are leveraged to detect abnormal logs. This research investigates multiple kinds offeatures in natural language processing and information retrieval. Several variants of basic clustering and artificial neural network algorithms are developed. Data preprocessing is experimented before feature extraction as well. In order to select a suitable model for our problem, cross validation and F-score are used to evaluate different learning models compared to automated test system verdicts. Finally, the influences of factors that may affect the prediction results such as single or mixed test cases, single or mixed track types and single or mixed configuration types are verified based on different learning models.

Place, publisher, year, edition, pages
IT, 13 080
National Category
Engineering and Technology
URN: urn:nbn:se:uu:diva-211626OAI: oai:DiVA.org:uu-211626DiVA: diva2:667650
Educational program
Master Programme in Computer Science
Available from: 2013-11-27 Created: 2013-11-27 Last updated: 2013-12-02Bibliographically approved

Open Access in DiVA

fulltext(1100 kB)8930 downloads
File information
File name FULLTEXT01.pdfFile size 1100 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
Department of Information Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 8930 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 1057 hits
ReferencesLink to record
Permanent link

Direct link