HTC scientific computing in a distributed cloud environment

DOIResolve DOI:
AuthorSearch for: ; Search for: ; Search for: ; Search for: ; Search for: ; Search for: ; Search for: ; Search for: ; Search for:
Proceedings titleScienceCloud 2013 - Proceedings of the 4th ACM Workshop on Scientific Cloud Computing
Conference4th ACM Workshop on Scientific Cloud Computing, ScienceCloud 2013, 17 June 2013 through 17 June 2013, New York, NY
Pages4551; # of pages: 7
SubjectComputing capacity; Computing system; Design and implementations; Distributed clouds; High-throughput computing; Scientific applications; Cloud computing; Infrastructure as a service (IaaS); Distributed computer systems
AbstractThis paper describes the use of a distributed cloud computing system for high-throughput computing (HTC) scientific applications. The distributed cloud computing system is composed of a number of separate Infrastructure-as-a-Service (IaaS) clouds that are utilized in a unified infrastructure. The distributed cloud has been in production-quality operation for two years with approximately 500,000 completed jobs where a typical workload has 500 simultaneous embarrassingly-parallel jobs that run for approximately 12 hours. We review the design and implementation of the system which is based on pre-existing components and a number of custom components. We discuss the operation of the system, and describe our plans for the expansion to more sites and increased computing capacity. © 2013 ACM.
Publication date
AffiliationNational Research Council Canada (NRC-CNRC)
Peer reviewedYes
NPARC number21270719
Export citationExport as RIS
Report a correctionReport a correction
Record identifierefd46617-11d9-4231-8e59-55c8f5bf51d0
Record created2014-02-17
Record modified2016-05-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)