SlideShare a Scribd company logo
IEEE PROJECTS DEVELOPMENTS
WE OFFER IEEE PROJECTS MCA FINAL YEAR STUDENT PROJECTS, ENGINEERING
PROJECTS AND TRAINING, PHP PROJECTS, JAVA AND J2EE PROJECTS, ASP.NET
PROJECTS, NS2 PROJECTS, MATLAB PROJECTS AND IPT TRAINING .
CELL: +91 8870791415
Mail to: finalyearprojects2all@gmail.com
A Data and Task Co-scheduling Algorithm for Scientific Cloud Workflows
Abstract
Cloud computing has emerged as a promising computational infrastructure for cost-efficient
workflow execution by provisioning on-demand resources in a pay-as-you-go manner. While
scientific workflows require accessing community-wide resources,they usually need to be
performed in collaborative cloud environments composed of multiple datacenters. Although such
environments facilitate scientific collaboration, the movements of input and intermediate datasets
across geographically distributed datacenters may cause intolerable latency that would hinder
efficient execution of large-scale data-intensive scientific workflows. To address the problem, in
this article we propose a novel multi-level K-cut graph partitioning algorithm to minimize the
volume of data transfer across datacenters while satisfying load balancing and fixed data
constraints. The algorithm first contracts the fixed input datasets in the same datacenter and their
consuming tasks, and coarsens the contracted graph to a predefined scale in a level-by-level
manner. Then, a K-cut algorithm is used to partition the resulted graph into K parts such that the
cut size is minimized. After that, the partitioned graph is projected back to the original workflow
graph, during which the load balancing constraint is maintained. We evaluate our algorithm
using three real-world workflow applications and the results demonstrate that the proposed
algorithm outperforms other state-of-the-art algorithms.
System Specification
System Requirements:
Hardware Requirements:
• System : Pentium IV 2.4 GHz.
• Hard Disk : 40 GB.
IEEE PROJECTS DEVELOPMENTS
WE OFFER IEEE PROJECTS MCA FINAL YEAR STUDENT PROJECTS, ENGINEERING
PROJECTS AND TRAINING, PHP PROJECTS, JAVA AND J2EE PROJECTS, ASP.NET
PROJECTS, NS2 PROJECTS, MATLAB PROJECTS AND IPT TRAINING .
CELL: +91 8870791415
Mail to: finalyearprojects2all@gmail.com
• Floppy Drive : 1.44 Mb.
• Monitor : 15 VGA Colour.
• Mouse : Logitech.
• Ram : 512 Mb.
Software Requirements:
• Operating system : - Windows 7. 32 bit
• Coding Language : C#.net 4.0
• Data Base : SQL Server 2008

More Related Content

PDF
Willump: Optimizing Feature Computation in ML Inference
PDF
AI on Greenplum Using
 Apache MADlib and MADlib Flow - Greenplum Summit 2019
PDF
Superworkflow of Graph Neural Networks with K8S and Fugue
PPTX
AlexNet and so on...
PDF
Building Custom Machine Learning Algorithms With Apache SystemML
PDF
Spark Summit EU talk by Ahsan Javed Awan
PDF
Filtering vs Enriching Data in Apache Spark
PDF
Simplify Distributed TensorFlow Training for Fast Image Categorization at Sta...
Willump: Optimizing Feature Computation in ML Inference
AI on Greenplum Using
 Apache MADlib and MADlib Flow - Greenplum Summit 2019
Superworkflow of Graph Neural Networks with K8S and Fugue
AlexNet and so on...
Building Custom Machine Learning Algorithms With Apache SystemML
Spark Summit EU talk by Ahsan Javed Awan
Filtering vs Enriching Data in Apache Spark
Simplify Distributed TensorFlow Training for Fast Image Categorization at Sta...

What's hot (20)

PDF
Ray: Enterprise-Grade, Distributed Python
PDF
Spark Summit EU talk by Josef Habdank
PDF
Scalable Deep Learning Platform On Spark In Baidu
PPTX
Narayanan Sundaram, Research Scientist, Intel Labs at MLconf SF - 11/13/15
PDF
Is This Thing On? A Well State Model for the People
PDF
Running Apache Spark Jobs Using Kubernetes
PDF
Experimental Design for Distributed Machine Learning with Myles Baker
PDF
Anomaly Detection at Scale!
PDF
No More Cumbersomeness: Automatic Predictive Modeling on Apache Spark Marcin ...
PDF
Performance modeling and simulation for accumulo applications
PDF
SparkCruise: Automatic Computation Reuse in Apache Spark
PDF
Spark Summit EU talk by Miha Pelko and Til Piffl
PPT
Iygapyisi cause10-slideshare
PPTX
Production ready big ml workflows from zero to hero daniel marcous @ waze
PDF
Spark Summit EU talk by Javier Aguedes
PDF
Advertising Fraud Detection at Scale at T-Mobile
PDF
How Nielsen Utilized Databricks for Large-Scale Research and Development with...
PDF
Advanced Hyperparameter Optimization for Deep Learning with MLflow
PDF
Netflix machine learning
PDF
Intuitive & Scalable Hyperparameter Tuning with Apache Spark + Fugue
Ray: Enterprise-Grade, Distributed Python
Spark Summit EU talk by Josef Habdank
Scalable Deep Learning Platform On Spark In Baidu
Narayanan Sundaram, Research Scientist, Intel Labs at MLconf SF - 11/13/15
Is This Thing On? A Well State Model for the People
Running Apache Spark Jobs Using Kubernetes
Experimental Design for Distributed Machine Learning with Myles Baker
Anomaly Detection at Scale!
No More Cumbersomeness: Automatic Predictive Modeling on Apache Spark Marcin ...
Performance modeling and simulation for accumulo applications
SparkCruise: Automatic Computation Reuse in Apache Spark
Spark Summit EU talk by Miha Pelko and Til Piffl
Iygapyisi cause10-slideshare
Production ready big ml workflows from zero to hero daniel marcous @ waze
Spark Summit EU talk by Javier Aguedes
Advertising Fraud Detection at Scale at T-Mobile
How Nielsen Utilized Databricks for Large-Scale Research and Development with...
Advanced Hyperparameter Optimization for Deep Learning with MLflow
Netflix machine learning
Intuitive & Scalable Hyperparameter Tuning with Apache Spark + Fugue
Ad

Viewers also liked (13)

PPT
The malaria proof mosquito and mosquito laser
PDF
Download 5.08
DOCX
Tesina
PPTX
Knowing my government
PPTX
Shubham
PPTX
PPT
Powerpoint de basket
DOCX
ALIBHIA NASKAR CV
PDF
Profesor german de jesus castro pérez 1
PDF
Mohamed IbrahemTurkish-Arabic Translator
PDF
Lack of mobile connectivity is biggest fear of Indian travelers era wudstay t...
PDF
Video Steganography
PPT
Marketing Financial Services
The malaria proof mosquito and mosquito laser
Download 5.08
Tesina
Knowing my government
Shubham
Powerpoint de basket
ALIBHIA NASKAR CV
Profesor german de jesus castro pérez 1
Mohamed IbrahemTurkish-Arabic Translator
Lack of mobile connectivity is biggest fear of Indian travelers era wudstay t...
Video Steganography
Marketing Financial Services
Ad

Similar to A data and task co scheduling algorithm for scientific cloud workflows (20)

DOCX
Minimizing radio resource usage for machine to-machine communications through...
DOCX
On the performance impact of data access middleware for no sql data stores
DOCX
Follow me cloud-when cloud services follow mobile users
DOCX
Follow me cloud-when cloud services follow mobile users
DOCX
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Adaptive algorithm for minimizing clo...
DOCX
2014 IEEE JAVA CLOUD COMPUTING PROJECT Adaptive algorithm for minimizing clou...
DOCX
A context aware service evaluation approach over big data for cloud applications
DOCX
Providing user security guarantees in public infrastructure clouds
DOCX
Video stream analysis in clouds an object detection and classification frame...
PDF
Automatically partitioning packet processing applications for pipelined archi...
DOCX
Distributed and fair beaconing rate adaptation for congestion control in vehi...
DOCX
A novel statistical cost model and an algorithm for efficient application off...
PPTX
2018 03 25 system ml ai and openpower meetup
PDF
Everything as a Service
PDF
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
DOCX
An optimization framework for mobile data collection in energy harvesting wir...
PDF
Backend.AI Technical Introduction (19.09 / 2019 Autumn)
DOCX
Identity based private matching over outsourced encrypted datasets
PDF
Performance Characterization and Optimization of In-Memory Data Analytics on ...
PDF
Real time machine learning proposers day v3
Minimizing radio resource usage for machine to-machine communications through...
On the performance impact of data access middleware for no sql data stores
Follow me cloud-when cloud services follow mobile users
Follow me cloud-when cloud services follow mobile users
IEEE 2014 JAVA CLOUD COMPUTING PROJECTS Adaptive algorithm for minimizing clo...
2014 IEEE JAVA CLOUD COMPUTING PROJECT Adaptive algorithm for minimizing clou...
A context aware service evaluation approach over big data for cloud applications
Providing user security guarantees in public infrastructure clouds
Video stream analysis in clouds an object detection and classification frame...
Automatically partitioning packet processing applications for pipelined archi...
Distributed and fair beaconing rate adaptation for congestion control in vehi...
A novel statistical cost model and an algorithm for efficient application off...
2018 03 25 system ml ai and openpower meetup
Everything as a Service
FPGA IMPLEMENTATION OF APPROXIMATE SOFTMAX FUNCTION FOR EFFICIENT CNN INFERENCE
An optimization framework for mobile data collection in energy harvesting wir...
Backend.AI Technical Introduction (19.09 / 2019 Autumn)
Identity based private matching over outsourced encrypted datasets
Performance Characterization and Optimization of In-Memory Data Analytics on ...
Real time machine learning proposers day v3

More from Finalyearprojects Toall (7)

DOCX
Ieee 2018 2019 project titiles
DOCX
Unlicensed spectra fusion and interference coordination for lte systems
DOCX
Text mining the contributors to rail accidents
DOCX
Stochastic load balancing for virtual resource management in datacenters
DOCX
Service usage classification with encrypted internet traffic in mobile messag...
DOCX
Identity based proxy-oriented data uploading and remote data integrity checki...
DOCX
Assurance of security and privacy requirements for cloud deployment model
Ieee 2018 2019 project titiles
Unlicensed spectra fusion and interference coordination for lte systems
Text mining the contributors to rail accidents
Stochastic load balancing for virtual resource management in datacenters
Service usage classification with encrypted internet traffic in mobile messag...
Identity based proxy-oriented data uploading and remote data integrity checki...
Assurance of security and privacy requirements for cloud deployment model

Recently uploaded (20)

PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
master seminar digital applications in india
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
RMMM.pdf make it easy to upload and study
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Computing-Curriculum for Schools in Ghana
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
Complications of Minimal Access Surgery at WLH
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PPTX
Institutional Correction lecture only . . .
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PPTX
Microbial diseases, their pathogenesis and prophylaxis
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PDF
102 student loan defaulters named and shamed – Is someone you know on the list?
PPTX
GDM (1) (1).pptx small presentation for students
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
master seminar digital applications in india
Final Presentation General Medicine 03-08-2024.pptx
Supply Chain Operations Speaking Notes -ICLT Program
FourierSeries-QuestionsWithAnswers(Part-A).pdf
Chinmaya Tiranga quiz Grand Finale.pdf
202450812 BayCHI UCSC-SV 20250812 v17.pptx
RMMM.pdf make it easy to upload and study
VCE English Exam - Section C Student Revision Booklet
Computing-Curriculum for Schools in Ghana
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
Complications of Minimal Access Surgery at WLH
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
Institutional Correction lecture only . . .
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Microbial diseases, their pathogenesis and prophylaxis
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
102 student loan defaulters named and shamed – Is someone you know on the list?
GDM (1) (1).pptx small presentation for students

A data and task co scheduling algorithm for scientific cloud workflows

  • 1. IEEE PROJECTS DEVELOPMENTS WE OFFER IEEE PROJECTS MCA FINAL YEAR STUDENT PROJECTS, ENGINEERING PROJECTS AND TRAINING, PHP PROJECTS, JAVA AND J2EE PROJECTS, ASP.NET PROJECTS, NS2 PROJECTS, MATLAB PROJECTS AND IPT TRAINING . CELL: +91 8870791415 Mail to: [email protected] A Data and Task Co-scheduling Algorithm for Scientific Cloud Workflows Abstract Cloud computing has emerged as a promising computational infrastructure for cost-efficient workflow execution by provisioning on-demand resources in a pay-as-you-go manner. While scientific workflows require accessing community-wide resources,they usually need to be performed in collaborative cloud environments composed of multiple datacenters. Although such environments facilitate scientific collaboration, the movements of input and intermediate datasets across geographically distributed datacenters may cause intolerable latency that would hinder efficient execution of large-scale data-intensive scientific workflows. To address the problem, in this article we propose a novel multi-level K-cut graph partitioning algorithm to minimize the volume of data transfer across datacenters while satisfying load balancing and fixed data constraints. The algorithm first contracts the fixed input datasets in the same datacenter and their consuming tasks, and coarsens the contracted graph to a predefined scale in a level-by-level manner. Then, a K-cut algorithm is used to partition the resulted graph into K parts such that the cut size is minimized. After that, the partitioned graph is projected back to the original workflow graph, during which the load balancing constraint is maintained. We evaluate our algorithm using three real-world workflow applications and the results demonstrate that the proposed algorithm outperforms other state-of-the-art algorithms. System Specification System Requirements: Hardware Requirements: • System : Pentium IV 2.4 GHz. • Hard Disk : 40 GB.
  • 2. IEEE PROJECTS DEVELOPMENTS WE OFFER IEEE PROJECTS MCA FINAL YEAR STUDENT PROJECTS, ENGINEERING PROJECTS AND TRAINING, PHP PROJECTS, JAVA AND J2EE PROJECTS, ASP.NET PROJECTS, NS2 PROJECTS, MATLAB PROJECTS AND IPT TRAINING . CELL: +91 8870791415 Mail to: [email protected] • Floppy Drive : 1.44 Mb. • Monitor : 15 VGA Colour. • Mouse : Logitech. • Ram : 512 Mb. Software Requirements: • Operating system : - Windows 7. 32 bit • Coding Language : C#.net 4.0 • Data Base : SQL Server 2008