uu.seUppsala University Publications
Change search
ReferencesLink to record
Permanent link

Direct link
Integrating Visual Data Flow Programming with Data Stream Management
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computing Science. Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Computing Science. (UDBL)
2016 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

Data stream management and data flow programming have many things in common. In both cases one wants to transfer possibly infinite sequences of data items from one place to another, while performing transformations to the data. This Thesis focuses on the integration of a visual programming language with a data stream management system (DSMS) to support the construction, configuration, and visualization of data stream applications. In the approach, analyses of data streams are expressed as continuous queries (CQs) that emit data in real-time. The LabVIEW visual programming platform has been adapted to support easy specification of continuous visualization of CQ results. LabVIEW has been integrated with the DSMS SVALI through a stream-oriented client-server API. Query programming is declarative, and it is desirable to make the stream visualization declarative as well, in order to raise the abstraction level and make programming more intuitive. This has been achieved by adding a set of visual data flow components (VDFCs) to LabVIEW, based on the LabVIEW actor framework. With actor-based data flows, visualization of data stream output becomes more manageable, avoiding the procedural control structures used in conventional LabVIEW programming while still utilizing the comprehensive, built-in LabVIEW visualization tools.

The VDFCs are part of the Visual Data stream Monitor (VisDM), which is a client-server based platform for handling real-time data stream applications and visualizing stream output. VDFCs are based on a data flow framework that is constructed from the actor framework, and are divided into producers, operators, consumers, and controls. They allow a user to set up the interface environment, customize the visualization, and convert the streaming data to a format suitable for visualization.

Furthermore, it is shown how LabVIEW can be used to graphically define interfaces to data streams and dynamically load them in SVALI through a general wrapper handler. As an illustration, an interface has been defined in LabVIEW for accessing data streams from a digital 3D antenna.

VisDM has successfully been tested in two real-world applications, one at Sandvik Coromant and one at the Ångström Laboratory, Uppsala University. For the first case, VisDM was deployed as a portable system to provide direct visualization of machining data streams. The data streams can differ in many ways as do the various visualization tasks. For the second case, data streams are homogenous, high-rate, and query operations are much more computation-demanding. For both applications, data is visualized in real-time, and VisDM is capable of sufficiently high update frequencies for processing and visualizing the streaming data without obstructions.

The uniqueness of VisDM is the combination of a powerful and versatile DSMS with visually programmed and completely customizable visualization, while maintaining the complete extensibility of both.

Place, publisher, year, edition, pages
Uppsala: Department of Information Technology, Uppsala University , 2016. , 122 p.
Keyword [en]
data stream management; data stream visualization; visual data flow programming; LabVIEW
National Category
Computer Science
Research subject
Computer Science with specialization in Database Technology
URN: urn:nbn:se:uu:diva-286536ISBN: 978-91-506-2583-7OAI: oai:DiVA.org:uu-286536DiVA: diva2:941680
Public defence
2016-10-06, 2446, ITC, Lägerhyddsvägen 2, Uppsala, 13:00 (English)
eSSENCE - An eScience Collaboration, RIT08-0041EU, FP7, Seventh Framework Programme, Smart Vortex
Available from: 2016-09-06 Created: 2016-04-20 Last updated: 2016-09-08

Open Access in DiVA

fulltext(2540 kB)98 downloads
File information
File name FULLTEXT02.pdfFile size 2540 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Melander, Lars
By organisation
Computing ScienceDivision of Computing Science
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 98 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 687 hits
ReferencesLink to record
Permanent link

Direct link