As high-performance computing systems push toward exascale and future zettascale capabilities, their unprecedented architectural complexity, featuring massive core counts, deep memory hierarchies, and heterogeneous components, poses significant challenges to performance modeling. Traditional performance models, often relying on decoupled computation and communication models or additive cost models that assume an idealized bulk synchronous parallel pattern, fail to capture the emergent process overlap dynamics observed in large-scale, distributed-memory programs. Disturbances can trigger large-scale, nonlinear effects that profoundly impact performance. This dissertation introduces a holistic, white-box modeling framework grounded in first principles to capture the coupled effects of noise, bandwidth bottlenecks, code execution, the message passing library, and the network in parallel applications. The work systematically formulates several fundamental challenges across three interconnected domains: (i) performance modeling, (ii) performance engineering, and (iii) performance simulation and physical modeling. It reveals how localized delays can propagate through inter-process dependencies, amplify system-wide variability, and invalidate additive- or max-based time-to-solution predictions. Through analytical derivations, controlled experiments, and large-scale validation, the work identifies critical performance phenomena, such as idle wave propagation, memory bandwidth-sharing interference, and spontaneous communication-computation overlap, as key drivers of performance variability. These effects arise not from algorithmic flaws but from fundamental hardware\u2013software interactions under shared bottlenecks. These models are validated using both synthetic and real applications, exploring whether noise, traditionally seen as detrimental, can potentially be leveraged for beneficial purposes. The dissertation develops new analytical models: one that explains desynchronization in scalable programs via idle wave dynamics; another that models bandwidth-sharing among overlapping computational kernels and computation-communication overlap. To support controlled experimentation and reproducible simulation, two novel tools are introduced: DisCostiC, a white-box MPI performance simulator that emulates MPI applications via system-aware skeletons without requiring execution on real hardware; and OsciLite, a Kuramoto-inspired oscillator framework that captures the synchronization dynamics of parallel programs using coupled differential equations. By combining theoretical insights, simulation, and empirical validation, this dissertation provides a new lens through which the behavior of parallel programs can be understood, predicted, and optimized. Its insights and tools lay the foundation for building performance-aware software, guiding hardware co-design, and redefining performance modeling in the zettascale era.<\/p>","protected":false},"excerpt":{"rendered":"
Die schnellsten Hochleistungsrechner erreichen heute das Exascale- und zuk\u00fcnftig das Zettascale-Niveau. Die beispiellose Komplexit\u00e4t ihrer Architektur zeigt sich in einer enormen Anzahl von Rechenkernen, tiefen Speicherhierarchien und heterogenen Komponenten und stellt eine erhebliche Herausforderung f\u00fcr die Leistungsmodellierung dar. Herk\u00f6mmliche Leistungsmodelle basieren h\u00e4ufig auf entkoppelten, additiven Modellen f\u00fcr Codeausf\u00fchrung und Kommunikation und setzen ein idealisiertes synchrones […]<\/p>\n","protected":false},"featured_media":6618,"comment_status":"open","ping_status":"closed","template":"","meta":{"_acf_changed":false},"product_brand":[],"product_cat":[54],"product_tag":[],"class_list":{"0":"post-6617","1":"product","2":"type-product","3":"status-publish","4":"has-post-thumbnail","6":"product_cat-fau-studien-aus-der-informatik","7":"has-post-title","8":"has-post-date","9":"has-post-category","10":"has-post-tag","11":"has-post-comment","12":"has-post-author","13":"","15":"first","16":"instock","17":"taxable","18":"shipping-taxable","19":"purchasable","20":"product-type-simple"},"acf":{"autor":"Afzal, Ayesha","orcid":"0000-0001-5061-0438 ","ror":"00f7hpc57","herausgeber":"","orcid_hrsg":"","rorhrsg":"","bearbeiter":"","sonstige_beteiligte_personen":"","untertitel":"","zusatz":"","jahr":"2026","zeitschrift":"","serie":"","serie_name":false,"serie_band":"","serie_jahr":"","serie_titel_band":"","vortrage":"","issn":"","isbn":"9783961479399","isbn13":"","seiten":"xxxviii, 347","sonstiges":"","band":22,"auflage":"","opus":"","dspace":"40254","e-isbn_pdf":"9783961479405","doi":"https:\/\/doi.org\/10.25593\/978-3-96147-940-5","epub":"","e-isbn_epub":"","doi_epub":"","html":"","e-isbn_html":"","doi_html":"","e-isbn_reader":"","doi_reader":"","digibib":"","urn":"","supplementary_material":"","sprache":["Englisch"],"ausgabe":"Softcover","suche":"9783961479399 9783961479405 ","lizenz":"BY-4","bemerkung":"1\tFAU Press\r\n1\tHB\r\n4\tBSB \/ DNB\r\n1\tTNZB\r\n1\tTIB\r\n"},"builder_content":"","_links":{"self":[{"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/product\/6617","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/product"}],"about":[{"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/types\/product"}],"replies":[{"embeddable":true,"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/comments?post=6617"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/media\/6618"}],"wp:attachment":[{"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/media?parent=6617"}],"wp:term":[{"taxonomy":"product_brand","embeddable":true,"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/product_brand?post=6617"},{"taxonomy":"product_cat","embeddable":true,"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/product_cat?post=6617"},{"taxonomy":"product_tag","embeddable":true,"href":"https:\/\/www.university-press.fau.de\/en\/wp-json\/wp\/v2\/product_tag?post=6617"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}