september, 2021

27sep(sep 27)9:0030(sep 30)15:305th ZIB-RIKEN-IMI-ISM MODAL Workshop on Optimization, Data Analysis and HPC in AIBridging gaps: The Maestro Data-Aware Middleware

more

Event Details

Presentation: Bridging gaps: The Maestro Data-Aware Middleware
Description:
Description: We will introduce the Maestro middleware framework, a data- and memory-aware abstraction for workflow coupling, inter- and intra-application data exchange and redistribution. A central design goal was to enable modelling of memory and storage hierarchies to allow for reasoning about data movement and placement based on costs of moving data objects. At the same time, data objects can carry user-defined metadata as it is typical in meteorological production workflows, allowing workflow management software to reason about the data without inspecting it, at scale. We will also present an outlook on future requirements for such frameworks in the context of federated data handling and cross-site workflow coupling.
Speaker:
Utz-Uwe Haus (HPE HPC EMEA Research Lab)
Location:
Virtual Event
More information:
http://optimizationworkshop2020.zib.de/

Time

27 (Monday) 9:00 - 30 (Thursday) 15:30

Location

Online

X