student profile: Mr Qingye Jiang


Map

Thesis work

Thesis title: Performing Large-Scale Scientific Computing in Public Clouds

Supervisors: Albert ZOMAYA , Young LEE

Thesis abstract:

�p�In this paper, we present a serverless workflow execution system with Function-as-a-Service (FaaS aka serverless computing) as the target execution environment. DEWE v3 is designed to address problems of (1) execution of large-scale scientific workflows and (2) resource underutilization. At its core is our novel hybrid (FaaS and dedicated/local clusters) job dispatching approach taking into account resource consumption patterns of different phases of workflow execution. In particular, the hybrid approach deals with the maximum execution duration limit, memory limit, and storage space limit. DEWE v3 significantly reduces the efforts needed to execute large-scale scientific workflow applications on public clouds. We have evaluated DEWE v3 on both AWS Lambda and Google Cloud Functions and demonstrate that FaaS offers an ideal solution for scientific workflows with complex precedence constraints. In our large-scale evaluations, the hybrid execution model surpasses the performance of the traditional cluster execution model with significantly less execution cost.�/p�

Selected publications

Download citations: PDF RTF Endnote

Journals

  • Jiang, Q., Lee, Y., Zomaya, A. (2016). Price Elasticity in the Enterprise Computing Resource Market. IEEE Cloud Computing, 3(1), 24-31. [More Information]

Conferences

  • Jiang, Q., Lee, Y., Zomaya, A. (2018). Janus: A Generic QoS Framework for Software-as-a-Service Applications. 2018 IEEE International Conference on Cluster Computing (CLUSTER 2018), Belfast: Institute of Electrical and Electronics Engineers (IEEE). [More Information]
  • Jiang, Q., Lee, Y., Zomaya, A. (2017). Serverless Execution of Scientific Workflows. 15th International Conference on Service Oriented Computing (ICSOC 17), Cham: Springer Nature. [More Information]
  • Leslie, L., Sato, C., Lee, Y., Jiang, Q., Zomaya, A. (2015). DEWE: A framework for distributed elastic scientific workflow execution. 13th Australasian Symposium on Parallel and Distributed Computing (AusPDC 2015), Sydney: Australian Computer Society.
  • Jiang, Q., Lee, Y., Zomaya, A. (2015). Executing Large Scale Scientific Workflow Ensembles in Public Clouds. 2015 International Conference on Parallel Processing The 44th Annual Conference ICPP 2015, Piscataway, New Jersey: Institute of Electrical and Electronics Engineers (IEEE). [More Information]
  • Jiang, Q., Lee, Y., Arenaz, M., Leslie, L., Zomaya, A. (2014). Optimizing scientific workflows in the cloud: A montage example. 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing (UCC 2014), Piscataway, New Jersey: IEEE Computer Society. [More Information]

2018

  • Jiang, Q., Lee, Y., Zomaya, A. (2018). Janus: A Generic QoS Framework for Software-as-a-Service Applications. 2018 IEEE International Conference on Cluster Computing (CLUSTER 2018), Belfast: Institute of Electrical and Electronics Engineers (IEEE). [More Information]

2017

  • Jiang, Q., Lee, Y., Zomaya, A. (2017). Serverless Execution of Scientific Workflows. 15th International Conference on Service Oriented Computing (ICSOC 17), Cham: Springer Nature. [More Information]

2016

  • Jiang, Q., Lee, Y., Zomaya, A. (2016). Price Elasticity in the Enterprise Computing Resource Market. IEEE Cloud Computing, 3(1), 24-31. [More Information]

2015

  • Leslie, L., Sato, C., Lee, Y., Jiang, Q., Zomaya, A. (2015). DEWE: A framework for distributed elastic scientific workflow execution. 13th Australasian Symposium on Parallel and Distributed Computing (AusPDC 2015), Sydney: Australian Computer Society.
  • Jiang, Q., Lee, Y., Zomaya, A. (2015). Executing Large Scale Scientific Workflow Ensembles in Public Clouds. 2015 International Conference on Parallel Processing The 44th Annual Conference ICPP 2015, Piscataway, New Jersey: Institute of Electrical and Electronics Engineers (IEEE). [More Information]

2014

  • Jiang, Q., Lee, Y., Arenaz, M., Leslie, L., Zomaya, A. (2014). Optimizing scientific workflows in the cloud: A montage example. 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing (UCC 2014), Piscataway, New Jersey: IEEE Computer Society. [More Information]

Note: This profile is for a student at the University of Sydney. Views presented here are not necessarily those of the University.