Reshape your layouts, not your programs: A safe language extension for better cache localityShow others and affiliations
2020 (English)In: Science of Computer Programming, ISSN 0167-6423, E-ISSN 1872-7964, Vol. 197, article id 102481Article in journal (Refereed) Published
Abstract [en]
The vast divide between the speed of CPU and RAM means that effective use of CPU caches is often a prerequisite for high performance on modern architectures. Hence, developers need to consider how to place data in memory so as to exploit spatial locality and achieve high memory bandwidth. Such manual memory optimisations are common in unmanaged languages (e.g. C, C++), but they sacrifice readability, maintainability, memory safety, and object abstraction. In managed languages, such as Java and C#, where the runtime abstracts away the memory from the developer, such optimisations are almost impossible. We present a language extension called SHAPES, which aims to offer developers more fine-grained control over the placement of data, without sacrificing memory safety or object abstraction. In SHAPES, programmers group related objects into pools, and specify how objects are laid out in these pools. Classes and types are annotated by pool parameters, which allow placement aspects to be changed orthogonally to the code that operates on the objects in the pool. These design decisions disentangle business logic and memory concerns. We give a formal model of SHAPES, present its type and memory safety model, and present its translation to a low-level language. We argue why we expect this translation to be efficient in terms of runtime representation of objects and access to their fields. We argue that SHAPES can be incorporated into existing managed and unmanaged language runtimes and fit well with garbage collection.
Place, publisher, year, edition, pages
2020. Vol. 197, article id 102481
Keywords [en]
Type systems, Cache utilisation, Data representation, Memory safety
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:uu:diva-423133DOI: 10.1016/j.scico.2020.102481ISI: 000572347300003OAI: oai:DiVA.org:uu-423133DiVA, id: diva2:1480857
Conference
European Conference on Object-Oriented Programming (ECOOP), NOV 15-17, 2020, ELECTR NETWORK
2020-10-272020-10-272020-10-27Bibliographically approved