"Towards Scalable Distributed Applications and Systems: The P* Model of Pilot-Abstractions"
Professor Shantenu Jha, Department of Electrical & Computer Engineering,
CoRE Building Lecture Hall
Many scientifically important questions require the efficient use of high-performance and distributed computing in order to provide answers with the accuracy needed at the length and time-scales required. We begin by analyzing how and why it has been necessary to develop "effective abstractions" in order to successfully utilize production high-performance distributed cyber-infrastructure, such as NSF's TeraGrid/XSEDE. For example, pilot-jobs are arguably one of the most widely-used distributed computing abstractions, and have been shown to support scalable and dynamic utilization of distributed resource.
However, there does not exist a well-defined, unifying conceptual model of pilot-jobs which can be used to define, compare and reason across different implementations of pilot-jobs; this presents a barrier to extensibility and interoperability. We introduce the P* Model the first known conceptual model of pilot-jobs, validate its implementation via the Pilot-API -- by concurrently using multiple distinct pilot-job frameworks on distinct production distributed cyber-infrastructures, and propose extensions of the P* Model to data.
We will discuss the application of the pilot-abstraction to support the infrastructural and algorithmic requirements of several Grand Challenge problems facing the Computational Biology community, for example data-analytics for next-generation gene sequencing, enhanced sampling molecular algorithms, and in-silico personalized and predictive health-care.
For Graduate students looking for research opportunities, we will conclude by providing a brief overview of the Radical group and some research topics currently of interest.
Prof. Shantenu Jha is an Assistant Professor at Rutgers University, a member of the Graduate Faculty in the School of Informatics at the University of Edinburgh (UK), and a Visiting Scientist at University College London. Before moving to Rutgers, he was the lead for Cyberinfrastructure Research and Development at the CCT at Louisiana State University. His research interests lie at the triple point of Computer Science, Cyberinfrastructure Development and Computational Science.
Shantenu is the lead investigator of the SAGA project (