10.6084/m9.figshare.4491629.v2
Pankaj Saha
Pankaj
Saha
Madhusudhan Govindaraju
Madhusudhan
Govindaraju
Suresh Marru
Suresh
Marru
Marlon Pierce
Marlon
Pierce
MultiCloud Resource Management using Apache Mesos with Apache Airavata
figshare
2017
Gateways 2016
SGCI
Science Gateways
Distributed Computing
Distributed and Grid Systems
Applied Computer Science
Computer Software
Web Technologies (excl. Web Search)
2017-01-27 19:07:12
Dataset
https://figshare.com/articles/dataset/MultiCloud_Resource_Management_using_Apache_Mesos_with_Apache_Airavata/4491629
We discuss initial results and our planned approach for incorporating Apache Mesos based resource management that will enable design and development of scheduling strategies for Apache Airavata jobs so that they can be launched on multiple clouds, wherein several VMs do not have Public IP addresses. We present initial work and next steps on the design of a meta-scheduler for Apache Airavata, which uses Apache Mesos to present a unified view of resources available across several clouds and clusters. This meta-scheduler can potentially examine and identify the cases where multiple small jobs have been submitted by the same scientists and then redirect job from the same community account or user to different clusters. Our approach uses a NAT firewall to make cloud VMs, without a Public IP, visible to Mesos for the unified view.