As a mean to monitor the rapid expansion of the highly decentralized PV market, identifying solar energy systems in aerial imagery by deep machine learning, is a research field that is getting increasing interest. One general challenge in the field is to create testing data of high quality that are representative of the end-use application. In this study we use the open source convolutional neural network developed within the DeepSolar project and apply it in the country of Sweden, for the purpose of generating market statistics, by scanning three complete municipalities for small decentralized photovoltaic and solar thermal systems. The evaluation of the performance is done against a highly accurate ground truth, which was created by cross-checking the classification results with the inventory of the local distribution system operators and the database of photovoltaic systems that have received a capital subsidy in Sweden, and combining that with physical onsite inspections. A process of generate additional training data and re-training the algorithm after each municipality scan was developed, which successively improved the accuracy, resulting in that 95% of all detectable photovoltaic, excluding building integrated and vertical systems, and 80% of all detectable solar thermal systems were correctly identified in the last municipality scan. The accurate ground truth allowed a quantification of why some systems are not detected. The generated dataset of solar energy systems could be connected to existing building and property inventories, which allowed creation of market segment statistics with remarkably high detail information.