This poster provides an update on the work of the Maestro project. This project has the ambition of developing a middleware that enables data- and memory-aware use of High Performance Computing (HPC) and High Performance Data Analytics (HPDA) systems in the presence of complex memory and storage hierarchies. Maestro is based on the generic abstraction of Core Data Objects (CDOs) that are managed efficiently by a core middleware layer. CDOs comprise a flexible list of attributes that can be used to steer the middleware as well as the interaction between different application components and the Maestro pool that holds the set of available CDOs.
We provide an overview of the low-level core middleware and the protocol for CDO exchange between different components through a centrally managed pool. Furthermore, different middleware components are introduced together with their use by applications and workflows.
Publication Type: Project Poster
Conference: ISC High Performance 2021 (ISC21)
Year of Publication: 2021
Authors: Prof. Dirk Pleiter (Jülich Supercomputing Centre), Prof. Adrian Tate (Cray), Utz-Uwe Haus (HPE EMEA), Dr. Manuel Arenaz (Appentra)
Keywords: Exascale Systems, HPC workflows, System Software & Runtime Systems
Publication link: https://www.isc-hpc.com/download/poster/proj1080
Event link: https://app.swapcard.com/event/isc-high-performance-2021-digital/planning/UGxhbm5pbmdfNDQ2MDQ1
Slides of the presentation: https://www.isc-hpc.com/download/slides/proj1080