IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing with Map Reduce
0 likes12 views
This document provides an overview of K-means++ clustering algorithm and how it can be implemented using MapReduce in cloud computing. It first discusses cloud computing and its ability to handle big data through flexibility and scalability. It then explains Hadoop and MapReduce, which provide a framework to parallelize processing of large datasets. The document describes the K-means++ clustering algorithm, which improves upon standard K-means by better initializing cluster centroids. Finally, it outlines how K-means++ can be implemented in MapReduce by splitting data and computing distances across mappers and reducers.
1 of 3
Download to read offline
![International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072
© 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7542
A Review on K-means++ Clustering Algorithm and Cloud Computing
with Map Reduce
1Sweekruth S Badiger, 2Sushmitha N
1PG Student, Dept. of Information Science and Engg., R. V. College of Engineering, Bangalore, Karnataka India
2Assistant Professor, Dept. of Information Science and Engg., R. V. College of Engineering, Bangalore,
Karnataka, India
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - The functionality of cloud computing is to host
the servers in a dispersed network with a aim to deliver access
to the wide range of customers. The core feature of cloud
computing is its flexibility which offer users to perform
upscaling or downscaling of the hardware. The main purpose
for the development of cloud computing is the substantial
increase in the volume of Big data evolved which require to be
examined. Researchers utilize multiple algorithms to gain
useful knowledge from a huge volume of data set. Hadoop has
come up with a new software platform called MapReduce to
carry out the operation parallelly on huge data set. Thereonly
specific unsupervised learning algorithms which are executed
successfully in MapReduce techniqueandaredeployedonhigh
volume of data set. The combination of cloud computing with
parallel processing in MapReduce stand out to be a powerful
approach for the future technologyenhancements. Thissurvey
provides a brief overview of cloud computing and of the most
popular clustering algorithm named k-means++
Key Words: Hadoop, MapReduce, Cloud computing, K-
Means++.
1. INTRODUCTION
Cloud computing is on demand availability of hardware
resources for computing or storage purpose. The term
‘Cloud’ basically means available to all through internet. It
reduces the work for user to either setup or manage the
hardware. Cloud provider take the ownership of providing
and maintaining the hardware infrastructure. Most famous
cloud service providers are Amazon, Google and Microsoft.
World is producing data of 2.5 quintillion bytes per day
at current pace due to internet, and it’s only going to
increase with arrival of internet of things. Data is new ‘oil’ of
our generation and mining it to discover knowledge is
critical to many businesses. Processing such a large amount
of data will pose unique kind of challenges to the data
analyzers. Normal sequential methods of programming are
less efficient and hence the need of parallel processing
gained importance. Cloud provides the ideal infrastructure
and Hadoop MapReduce programming paradigm can make
most use of it.
Many sequential programming algorithms are now
converted to Hadoop MapReduceprogrammingparadigm.It
should be noted here that there may be algorithms that
cannot be parallelized, and hence are of not much use in the
real world today as parallelization is of essence to process
Big Data. Hence some of the conventional algorithms for
clustering or technology can provide a great platform and
advancements to the new emergingtechnologyandalsovery
beneficial to the business enterprise organizations.
classification are now implemented using MapReduce
Programming paradigm.
2. BACKGROUND
A. Cloud computing
Cloud computing has evolved since the inception of
internet. Historically processing and storagewereexpensive,
but due to scientific and technological advancement in
hardware manufacturing industries, hardware has become
much cheaper and smaller insizecomparedtoearlier.Taking
advantage of this fact, industries came up with providing the
hardware infrastructure as service to users and this is how
Cloud computing paradigm was born.
Figure. 1. Cloud computing service types [1]](https://image.slidesharecdn.com/irjet-v6i51092-191024100802/85/IRJET-A-Review-on-K-Means-Clustering-Algorithm-and-Cloud-Computing-with-Map-Reduce-1-320.jpg)
![International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072
© 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7543
Figure. 2. Cloud computing deployment models [1]
As shown in Fig. 1, cloudproviderscanprovideservicesin
three delivery types, that is Software as a Service (SaaS),
Platform as a Service (PaaS) and Infrastructure as a Service
(IaaS). Cloud deployment services comes in the form of
private, hybrid,publicandcommunityasmentionedinFigure
2. Public clouds have many customers compared to other
forms of cloud. Private clouds usually are not cost efficient.
B. Hadoop
Hadoop is considered to be one of the best tools tohandle
big data. It has two major components HDFS and another is
MapReduce. HDFS stores the files in blocks of 64MB. It can
handle the files of varying size from 10 MB to GB, TB.Hadoop
can run withsingle nodeormulti-nodecluster.EveryHadoop
cluster can have five running processes namely. HDFS can be
thought of Data node + Name node + Secondary Name node
and daemon process to manage MapReduce programming
paradigm in HDFS are Job Tracker + Task Tracker.
Figure. 3. Data flow in HDFS [2]
C. Map reduce paradigm
Map Reduce Programming Paradigm of Hadoop is a
model to process huge amount of data. Map phase maps the
input data into <key,value> pairs[3]. The reduce phase
combines the data based on common keys and performs
reduce operation defined by the user. The parallelization
occurs with many mappers created for reading the data and
it is not sequential. Because of this there is high throughput
[4].
3. K-Means++ CLUSTERING ALGORITHM
K-Means++ algorithm is the improved version of most
widely used K-means algorithm in clustering. K-Means
algorithm initializes the centroid randomly, which is where
it could sometimes create less accurate clusters. K-Means++
overcomes initialization part to improve K-Means. K-
Means++ algorithm takes an input k, which refers to the
number of clusters that should be generated and n refers to
set of objects [5].
K-Means++ clustering algorithm works as follows.
1. Select initial centroid X uniformly at random.
2. For each instance X we need to compute D(X) which is
the distance between X andthenearestcentroidthathas
already been chosen.
3. Choose next centroid using a weighted probability
distribution which is proportional to D(X)2.
4. Repeat 2 and 3 until K centroids have been chosen.
5. Assign each record or instance point to a cluster centre
which has least distance.
6. Calculate mean value of all points in the cluster.
7. Replace cluster centroid to this new mean value.
8. Repeat the steps from 6, until thereare nomorechanges
to centroids.
This algorithm can be implemented in map-reduce
pattern as follows.
• Map function: The HDFS stores input data as sequence file
of <key, value> pairs [6]. Every <key, value> pair represents
a record. The map function splits the data acrossall mappers
[7].
• Reduce function: After mapping, reducers are used for
computing Step-2 of the algorithm. Reducer will also
combine intermediate data of same mapper [8]. The
intermediate data can be put in hdfs or stored locally [9].
New centres are generated which can be used for further
iterations.
Figure. 4. K-Means++ Map Reduce [2]](https://image.slidesharecdn.com/irjet-v6i51092-191024100802/85/IRJET-A-Review-on-K-Means-Clustering-Algorithm-and-Cloud-Computing-with-Map-Reduce-2-320.jpg)
![International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072
© 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7544
4. CONCLUSIONS AND FUTURE WORK
The Big Data generated today has demanded more
computing, more storage resources as well as better way to
process the data. Conventional methods were failing tocope
up with such challenges because of which Cloud Computing
and Hadoop MapReduce gained popularity [10].
The K-Means++ algorithm discussed in this survey is
efficient for large set of data but it suffers with outlier issue.
Future work could involve outlier detecting and removal
algorithm merged with K-Means++ to give better and more
accurate results.
REFERENCES
[1] Adem Tepe, GüRay Yilmaz, “A Survey on Cloud
Computing Technology and Its Application to Satellite
Ground Systems”, International Conference on Recent
Advances in Space Technologies (RAST), 2013.
[2] Rajashree Shettar, Bhimasen. V. Purohit, “A Review on
Clustering Algorithms Applicable for Map Reduce”,
International Conference on Computational Systemsfor
Health & Sustainability, pp. 176-178, 2015.
[3] K. Singh and R. Kaur, "Hadoop: Addressing challengesof
Big Data," 2014 IEEE International Advance Computing
Conference (IACC), Gurgaon, 2014, pp. 686-689.
[4] Borthakur. D “The Hadoop Distributed File System:
Architecture and design”, 2007.
[5] Weihzong Zhao, Huifang Ma, Qing He, “Parallel K-Means
clustering BasedonMapReduce”,springer-verlagBerlin,
Heidelberg, 2009.
[6] Sangeeta Ahuja, M.Ester, H. P. Kriegel, J. Sander, X.Xu,“A
Density based algorithm fordiscoveringclustersinlarge
spatial database with noise”, Second international
conference on knowledge discovery and Data
Mining,1996.
[7] B. Dai and I. Lin, "Efficient Map/Reduce-Based DBSCAN
Algorithm with Optimized Data Partition," 2012 IEEE
Fifth International Conference on Cloud Computing,
Honolulu, HI, 2012, pp. 59-66.
[8] V. Gaede, O. G’unther, “Multidimensional access
methods”, ACM comput. Surv., Vol. 30, No. 2, pp. 170-
231, 1998.
[9] Varad Meru “Data clustering: Using MapReduce”,
software Developers Journal, 2013.
[10] Das A.S, Datar M, Garg, and Rajaram S, “Google news
personalization scalable online collaborative filtering”,
pp. 271-280, 2007.](https://image.slidesharecdn.com/irjet-v6i51092-191024100802/85/IRJET-A-Review-on-K-Means-Clustering-Algorithm-and-Cloud-Computing-with-Map-Reduce-3-320.jpg)
Ad
Recommended
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...
IRJET- Comparatively Analysis on K-Means++ and Mini Batch K-Means Clustering ...IRJET Journal This document provides an overview and comparative analysis of the K-Means++ and Mini Batch K-Means clustering algorithms in cloud computing using MapReduce. It first introduces cloud computing and its advantages for processing big data using Hadoop MapReduce. It then discusses the K-Means++ algorithm as an improved version of the standard K-Means algorithm that initializes cluster centroids more intelligently. Finally, it compares the performance of K-Means++ and Mini Batch K-Means when implemented using MapReduce for large-scale clustering in cloud environments.
SURVEY ON BIG DATA PROCESSING USING HADOOP, MAP REDUCE
SURVEY ON BIG DATA PROCESSING USING HADOOP, MAP REDUCEAM Publications,India The document surveys big data processing techniques using Hadoop and MapReduce, highlighting their significance in managing large datasets that exceed traditional database capabilities. It discusses the architecture of Hadoop, its components, and how data processing is handled through the MapReduce model, emphasizing efficiency and fault tolerance. The paper concludes by addressing challenges in integrating cloud computing with big data processing and outlines the tools developed for effective data management.
Paper id 25201498
Paper id 25201498IJRAT This document summarizes a research paper that analyzes and evaluates the performance of processing large data sets using Hadoop. It discusses how Hadoop Distributed File System (HDFS) and MapReduce provide parallel and distributed processing of large structured and unstructured data at scale. The paper also presents the results of experiments conducted on Hadoop to classify and cluster large data sets using machine learning algorithms. The experiments showed that Hadoop can process large data sets more efficiently and reliably compared to processing on a single computer.
Introduction to HADOOP
Introduction to HADOOPShital Kat The document discusses big data and Hadoop as a framework for processing large datasets. It describes how Hadoop uses HDFS for storage and MapReduce for parallel processing. HDFS uses a master/slave architecture with a NameNode and DataNodes. MapReduce jobs are managed by a JobTracker and executed on TaskTrackers. The document provides an example of using MapReduce to find common friends between users. It concludes that Hadoop is capable of solving big data challenges through scalable and fault-tolerant distributed processing.
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...
Performance evaluation of Map-reduce jar pig hive and spark with machine lear...IJECEIAES The document evaluates the performance of big data processing frameworks including MapReduce, Pig, Hive, and Spark, emphasizing the superiority of Spark in terms of processing speed and efficiency when integrated with machine learning. It highlights the increasing demand for big data professionals and the necessity of advanced processing technologies to handle extensive datasets generated from various sources, including industry sensors and social media. Results indicate that utilizing machine learning with Spark significantly enhances performance, surpassing traditional methods like MapReduce and Pig.
Web Oriented FIM for large scale dataset using Hadoop
Web Oriented FIM for large scale dataset using Hadoopdbpublications This document discusses a new parallel mining algorithm utilizing Hadoop's map-reduce framework to enhance frequent itemset mining on large datasets. It proposes a data partitioning technique to improve performance by reducing redundant transactions and balancing computing loads across nodes. The study concludes that this approach can significantly outperform traditional mining algorithms and suggests future exploration with Apache Spark for further performance improvements.
LARGE-SCALE DATA PROCESSING USING MAPREDUCE IN CLOUD COMPUTING ENVIRONMENT
LARGE-SCALE DATA PROCESSING USING MAPREDUCE IN CLOUD COMPUTING ENVIRONMENTijwscjournal This paper discusses the challenges and requirements of large-scale data processing in cloud computing using the MapReduce framework, highlighting its efficiency in handling vast datasets. It provides a systematic review, defines the necessary requirements for MapReduce systems, and presents an implementation on Amazon Web Services. The study concludes that MapReduce enables effective parallel and distributed computation, essential for modern data processing demands.
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame Work
A Big-Data Process Consigned Geographically by Employing Mapreduce Frame WorkIRJET Journal This document discusses frameworks for processing big data that is distributed across geographic locations. It begins by introducing the challenges of geo-distributed big data processing and then describes several MapReduce-based frameworks like G-Hadoop and G-MR that can process pre-located geo-distributed data. It also covers Spark-based systems like Iridium and frameworks that partition data across geographic locations, such as KOALA grid-based systems. The document analyzes key aspects of geo-distributed big data processing systems like data distribution, task scheduling, and fault tolerance.
An optimized scientific workflow scheduling in cloud computing
An optimized scientific workflow scheduling in cloud computingDIGVIJAY SHINDE The document discusses optimizing scientific workflow scheduling in cloud computing. It begins with definitions of workflow and cloud computing. Workflow is a group of repeatable dependent tasks, while cloud computing provides applications and hardware resources over the Internet. There are three cloud service models: SaaS, PaaS, and IaaS. The document explores how to efficiently schedule workflows in the cloud to reduce makespan, cost, and energy consumption. It reviews different scheduling algorithms like FCFS, genetic algorithms, and discusses optimizing objectives like time and cost. The document provides a literature review comparing various workflow scheduling methods and algorithms. It concludes with discussing open issues and directions for future work in optimizing workflow scheduling for cloud computing.
Association Rule Mining using RHadoop
Association Rule Mining using RHadoopIRJET Journal This document discusses using the R programming language and RHadoop libraries to perform association rule mining on big data stored in Hadoop. It first provides background on big data, association rule mining, and integrating R with Hadoop using RHadoop. It then describes setting up an 8-node Hadoop cluster using Ambari and installing RHadoop libraries to enable R scripts to run MapReduce jobs on the cluster. The goal is to use R and RHadoop to analyze a training dataset and discover interesting association rules.
Task Scheduling methodology in cloud computing
Task Scheduling methodology in cloud computing Qutub-ud- Din This document outlines a proposed methodology for developing efficient task scheduling strategies in cloud computing. It begins with introductions to cloud computing and task scheduling. It then reviews several relevant existing task scheduling algorithms from literature that focus on objectives like reducing costs, minimizing completion time, and maximizing resource utilization. The problem statement indicates the goals are to reduce costs, minimize completion time, and maximize resource allocation. An overview of the proposed methodology's flow is then provided, followed by references.
Qo s aware scientific application scheduling algorithm in cloud environment
Qo s aware scientific application scheduling algorithm in cloud environmentAlexander Decker This document summarizes a research paper that proposes a scheduling algorithm for scientific applications in cloud environments. The algorithm aims to schedule tasks in workflows based on user preferences for quality of service (QoS), like time and cost. It ranks tasks and uses an UPFF function to select resources that meet the user's desired QoS. The algorithm is compared to other similar algorithms through scenarios, and results show it has better efficiency. The full paper provides more details on scientific workflows, cloud computing, related work on workflow scheduling algorithms, and defines the problem of scheduling tasks to resources while considering costs and times.
Big Data with Hadoop – For Data Management, Processing and Storing
Big Data with Hadoop – For Data Management, Processing and StoringIRJET Journal This document discusses big data and Hadoop. It begins with defining big data and explaining its characteristics of volume, variety, velocity, and veracity. It then provides an overview of Hadoop, describing its core components of HDFS for storage and MapReduce for processing. Key technologies in Hadoop's ecosystem are also summarized like Hive, Pig, and HBase. The document concludes by outlining some challenges of big data like issues of heterogeneity and incompleteness of data.
IRJET - Weather Log Analysis based on Hadoop Technology
IRJET - Weather Log Analysis based on Hadoop TechnologyIRJET Journal This document discusses using Hadoop technology to analyze large amounts of weather data. It aims to analyze and predict temperature, which can help agriculture and governments respond to disasters. The system collects weather data from various sources, stores it in Hadoop's distributed file system, filters out irrelevant data, uses MapReduce algorithms to extract patterns, and displays the results in graphs. Analyzing huge volumes of weather data on a single system is inefficient, so Hadoop provides a better solution by allowing distributed processing across clustered systems.
Energy Saving by Migrating Virtual Machine to Green Cloud Computing
Energy Saving by Migrating Virtual Machine to Green Cloud Computingijtsrd This document discusses the importance of green computing and its application in cloud computing to enhance energy efficiency and reduce environmental impact. It outlines various strategies such as virtualization, dynamic resource allocation, and the use of green algorithms to manage energy consumption in data centers. The goal is to create an eco-friendly computational system while satisfying the growing demands of online services.
Real-time Energy Data Analytics with Storm
Real-time Energy Data Analytics with StormDataWorks Summit This document summarizes a proof-of-concept (POC) using Apache Storm for real-time energy data analytics. The POC evaluated Storm's capabilities for processing time series data and developing key performance indicators and forecasts. Simulated smart meter data was streamed through Storm topologies that performed simple and complex aggregations, scoring, and next-day forecasting using generalized additive models. The POC found Storm easy to use but noted challenges with debugging R code within topologies and potential bottlenecks from R computations. Overall, the POC demonstrated Storm's viability for real-time energy analytics applications.
A location based least-cost scheduling for data-intensive applications
A location based least-cost scheduling for data-intensive applicationsIAEME Publication This document summarizes a research paper that proposes a location-based least-cost scheduling algorithm for transferring multiple data-intensive files simultaneously to multiple compute nodes in a grid environment. The proposed model includes an optimized meta-scheduler that receives multiple files, predicts the optimal number of parallel TCP streams to use for each file transfer based on sampling, and schedules the files to compute nodes using a greedy algorithm that considers location and cost. Experimental results showed the optimized model achieved better transfer times and throughput compared to non-optimized transfers.
A Review: Metaheuristic Technique in Cloud Computing
A Review: Metaheuristic Technique in Cloud ComputingIRJET Journal This document reviews various meta-heuristic techniques that have been applied to problems in cloud computing, such as task scheduling, load balancing, ant colony optimization (ACO), particle swarm optimization (PSO), and gravitational search algorithm (GSA). It first provides background on cloud computing and defines common cloud computing concepts. It then surveys literature applying meta-heuristics like ACO, GA, PSO, and GSA to solve problems related to load balancing and scheduling in cloud environments. The document concludes that meta-heuristic techniques are effective for optimizing resource utilization and management in cloud computing systems.
Perspective on HPC-enabled AI
Perspective on HPC-enabled AIinside-BigData.com This document discusses how high performance computing (HPC) can help with artificial intelligence (AI) and deep learning problems. It notes that deep learning is a HPC problem due to its need for large amounts of computation and data. HPC techniques like scaling to many processors can help speed up the training of deep learning models, which currently can take days or weeks. The document provides examples of using HPC for deep learning in areas like automotive, manufacturing and financial services. It argues that combining HPC resources and expertise with deep learning can help reduce the total time needed for deep learning workflows.
Hadoop Cluster Analysis and Assessment
Hadoop Cluster Analysis and AssessmentInternational Journal of Modern Research in Engineering and Technology The document discusses the challenges of storing and analyzing large datasets in various fields, highlighting the Hadoop architecture which includes the Hadoop Distributed File System (HDFS) and the MapReduce programming model. A four-node Hadoop cluster setup was created to test the performance of these components using Pi and Grep MapReduce applications, demonstrating improvements in runtime with increased nodes and data sizes. The study concludes that Hadoop effectively addresses big data processing needs and enhances cluster performance through scalable architecture.
Big data processing using - Hadoop Technology
Big data processing using - Hadoop TechnologyShital Kat This document summarizes a report on Hadoop technology as a solution to big data processing. It discusses the big data problem, including defining big data, its characteristics and challenges. It then introduces Hadoop as a solution, describing its components HDFS for storage and MapReduce for parallel processing. Examples of common friend lists and word counting are provided. Finally, it briefly mentions some Hadoop projects and companies that use Hadoop.
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...dbpublications The document discusses improvements to the MapReduce programming model, focusing on reducing network traffic during the shuffle phase essential for performance enhancement in big data applications. It proposes a novel intermediate data partition scheme and an aggregator placement problem, employing both offline and online algorithms to optimize traffic cost. Extensive simulations demonstrate that the proposed methods can significantly lower network traffic costs while enhancing overall system performance.
Performance Improvement of Heterogeneous Hadoop Cluster using Ranking Algorithm
Performance Improvement of Heterogeneous Hadoop Cluster using Ranking AlgorithmIRJET Journal This document proposes using a ranking algorithm and sampling algorithm to improve the performance of a heterogeneous Hadoop cluster. The ranking algorithm prioritizes data distribution based on node frequency, so that higher frequency nodes are processed first. The sampling algorithm randomly selects nodes for data distribution instead of evenly distributing across all nodes. The proposed approach reduces computation time and improves overall cluster performance compared to the existing approach of evenly distributing data across nodes of varying sizes. Results show the proposed approach reduces execution time for various file sizes compared to the existing approach.
HPC + Ai: Machine Learning Models in Scientific Computing
HPC + Ai: Machine Learning Models in Scientific Computinginside-BigData.com The document discusses the integration of AI and high-performance computing (HPC) to address major scientific challenges, such as drug discovery, climate modeling, and understanding complex systems like HIV and lithium-ion battery technologies. It highlights advancements in model training and efficiency gained through deep learning and GPUs, which enable faster data processing and simulation at unprecedented scales. Overall, it emphasizes the transformative potential of combining AI with HPC for improved scientific outcomes and innovation.
IRJET- Optimization of Completion Time through Efficient Resource Allocation ...
IRJET- Optimization of Completion Time through Efficient Resource Allocation ...IRJET Journal This document discusses optimizing task completion time in cloud computing through efficient resource allocation using genetic and differential evolutionary algorithms. It aims to reduce makespan (completion time) by combining a genetic algorithm with differential evolutionary algorithms. The genetic algorithm uses selection, crossover and mutation to allocate tasks to resources. The outputs are then input to the differential evolutionary algorithm, which has the same operations in reverse order. This double process refines the allocation to provide the best allocation minimizing completion time. The document outlines the related work in genetic algorithms for resource allocation and task scheduling in cloud computing.
Qiu bosc2010
Qiu bosc2010BOSC 2010 This document summarizes cloud technologies and their applications in life sciences. It discusses how cloud computing can help address challenges posed by big data through cost-effective data centers, hiding complexity, and parallel computing frameworks like MapReduce. Specific applications highlighted include DNA sequence assembly, metagenomics, and correlating health data with environmental factors. Frameworks like Hadoop, DryadLINQ, and Twister are examined for processing large-scale biological data on clouds.
Effect of countries in performance of hadoop.
Effect of countries in performance of hadoop.Computer Science Journals This document discusses analyzing the performance of Hadoop with different sized datasets and various counters. Experiments were conducted on a Hadoop cluster to analyze how CPU time, number of blocks, heap size, HDFS bytes read, and spilled records are affected by the size of data from 49.7 MB to 71.5 MB. The results showed that CPU time increases slightly as data and number of blocks increase. CPU time also increases as HDFS bytes read and spilled records increase. Tuning the heap size and number of blocks can help optimize performance. Hadoop is concluded to efficiently handle and analyze big data.
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLab
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLabVijay Srinivas Agneeswaran, Ph.D The document presents advancements and frameworks in big data processing beyond Hadoop MapReduce, focusing on technologies like Apache Hadoop YARN, Spark, and Storm for various types of analytics including real-time and machine learning applications. It discusses the architecture of YARN, the Berkeley Data Analytics Stack (BDAS), and predictive modeling using PMML, detailing examples of their application in consumer churn analysis and optimization in data processing. Conclusions emphasize the shift towards real-time computation while leveraging existing analytical tools and algorithms.
A Novel Approach for Clustering Big Data based on MapReduce
A Novel Approach for Clustering Big Data based on MapReduce IJECEIAES This paper presents a novel approach for clustering big data using the k-prototype algorithm implemented on the MapReduce framework. The approach addresses the limitations of traditional clustering methods like k-means, which only works efficiently with numerical data, by allowing for the combination of numerical and categorical data. Experiments show that the proposed method significantly improves performance and reduces execution time when handling large-scale data compared to traditional algorithms.
Survey on MapReduce in Big Data Clustering using Machine Learning Algorithms
Survey on MapReduce in Big Data Clustering using Machine Learning AlgorithmsIRJET Journal This document summarizes research on using MapReduce techniques for big data clustering with machine learning algorithms. It discusses how traditional clustering algorithms do not scale well for large datasets. MapReduce allows distributed processing of large datasets in parallel. The document reviews several studies that implemented clustering algorithms like k-means using MapReduce on Hadoop. It found this improved efficiency and reduced complexity compared to traditional approaches. Faster processing of large datasets enables applications in areas like education and healthcare.
More Related Content
What's hot (20)
An optimized scientific workflow scheduling in cloud computing
An optimized scientific workflow scheduling in cloud computingDIGVIJAY SHINDE The document discusses optimizing scientific workflow scheduling in cloud computing. It begins with definitions of workflow and cloud computing. Workflow is a group of repeatable dependent tasks, while cloud computing provides applications and hardware resources over the Internet. There are three cloud service models: SaaS, PaaS, and IaaS. The document explores how to efficiently schedule workflows in the cloud to reduce makespan, cost, and energy consumption. It reviews different scheduling algorithms like FCFS, genetic algorithms, and discusses optimizing objectives like time and cost. The document provides a literature review comparing various workflow scheduling methods and algorithms. It concludes with discussing open issues and directions for future work in optimizing workflow scheduling for cloud computing.
Association Rule Mining using RHadoop
Association Rule Mining using RHadoopIRJET Journal This document discusses using the R programming language and RHadoop libraries to perform association rule mining on big data stored in Hadoop. It first provides background on big data, association rule mining, and integrating R with Hadoop using RHadoop. It then describes setting up an 8-node Hadoop cluster using Ambari and installing RHadoop libraries to enable R scripts to run MapReduce jobs on the cluster. The goal is to use R and RHadoop to analyze a training dataset and discover interesting association rules.
Task Scheduling methodology in cloud computing
Task Scheduling methodology in cloud computing Qutub-ud- Din This document outlines a proposed methodology for developing efficient task scheduling strategies in cloud computing. It begins with introductions to cloud computing and task scheduling. It then reviews several relevant existing task scheduling algorithms from literature that focus on objectives like reducing costs, minimizing completion time, and maximizing resource utilization. The problem statement indicates the goals are to reduce costs, minimize completion time, and maximize resource allocation. An overview of the proposed methodology's flow is then provided, followed by references.
Qo s aware scientific application scheduling algorithm in cloud environment
Qo s aware scientific application scheduling algorithm in cloud environmentAlexander Decker This document summarizes a research paper that proposes a scheduling algorithm for scientific applications in cloud environments. The algorithm aims to schedule tasks in workflows based on user preferences for quality of service (QoS), like time and cost. It ranks tasks and uses an UPFF function to select resources that meet the user's desired QoS. The algorithm is compared to other similar algorithms through scenarios, and results show it has better efficiency. The full paper provides more details on scientific workflows, cloud computing, related work on workflow scheduling algorithms, and defines the problem of scheduling tasks to resources while considering costs and times.
Big Data with Hadoop – For Data Management, Processing and Storing
Big Data with Hadoop – For Data Management, Processing and StoringIRJET Journal This document discusses big data and Hadoop. It begins with defining big data and explaining its characteristics of volume, variety, velocity, and veracity. It then provides an overview of Hadoop, describing its core components of HDFS for storage and MapReduce for processing. Key technologies in Hadoop's ecosystem are also summarized like Hive, Pig, and HBase. The document concludes by outlining some challenges of big data like issues of heterogeneity and incompleteness of data.
IRJET - Weather Log Analysis based on Hadoop Technology
IRJET - Weather Log Analysis based on Hadoop TechnologyIRJET Journal This document discusses using Hadoop technology to analyze large amounts of weather data. It aims to analyze and predict temperature, which can help agriculture and governments respond to disasters. The system collects weather data from various sources, stores it in Hadoop's distributed file system, filters out irrelevant data, uses MapReduce algorithms to extract patterns, and displays the results in graphs. Analyzing huge volumes of weather data on a single system is inefficient, so Hadoop provides a better solution by allowing distributed processing across clustered systems.
Energy Saving by Migrating Virtual Machine to Green Cloud Computing
Energy Saving by Migrating Virtual Machine to Green Cloud Computingijtsrd This document discusses the importance of green computing and its application in cloud computing to enhance energy efficiency and reduce environmental impact. It outlines various strategies such as virtualization, dynamic resource allocation, and the use of green algorithms to manage energy consumption in data centers. The goal is to create an eco-friendly computational system while satisfying the growing demands of online services.
Real-time Energy Data Analytics with Storm
Real-time Energy Data Analytics with StormDataWorks Summit This document summarizes a proof-of-concept (POC) using Apache Storm for real-time energy data analytics. The POC evaluated Storm's capabilities for processing time series data and developing key performance indicators and forecasts. Simulated smart meter data was streamed through Storm topologies that performed simple and complex aggregations, scoring, and next-day forecasting using generalized additive models. The POC found Storm easy to use but noted challenges with debugging R code within topologies and potential bottlenecks from R computations. Overall, the POC demonstrated Storm's viability for real-time energy analytics applications.
A location based least-cost scheduling for data-intensive applications
A location based least-cost scheduling for data-intensive applicationsIAEME Publication This document summarizes a research paper that proposes a location-based least-cost scheduling algorithm for transferring multiple data-intensive files simultaneously to multiple compute nodes in a grid environment. The proposed model includes an optimized meta-scheduler that receives multiple files, predicts the optimal number of parallel TCP streams to use for each file transfer based on sampling, and schedules the files to compute nodes using a greedy algorithm that considers location and cost. Experimental results showed the optimized model achieved better transfer times and throughput compared to non-optimized transfers.
A Review: Metaheuristic Technique in Cloud Computing
A Review: Metaheuristic Technique in Cloud ComputingIRJET Journal This document reviews various meta-heuristic techniques that have been applied to problems in cloud computing, such as task scheduling, load balancing, ant colony optimization (ACO), particle swarm optimization (PSO), and gravitational search algorithm (GSA). It first provides background on cloud computing and defines common cloud computing concepts. It then surveys literature applying meta-heuristics like ACO, GA, PSO, and GSA to solve problems related to load balancing and scheduling in cloud environments. The document concludes that meta-heuristic techniques are effective for optimizing resource utilization and management in cloud computing systems.
Perspective on HPC-enabled AI
Perspective on HPC-enabled AIinside-BigData.com This document discusses how high performance computing (HPC) can help with artificial intelligence (AI) and deep learning problems. It notes that deep learning is a HPC problem due to its need for large amounts of computation and data. HPC techniques like scaling to many processors can help speed up the training of deep learning models, which currently can take days or weeks. The document provides examples of using HPC for deep learning in areas like automotive, manufacturing and financial services. It argues that combining HPC resources and expertise with deep learning can help reduce the total time needed for deep learning workflows.
Hadoop Cluster Analysis and Assessment
Hadoop Cluster Analysis and AssessmentInternational Journal of Modern Research in Engineering and Technology The document discusses the challenges of storing and analyzing large datasets in various fields, highlighting the Hadoop architecture which includes the Hadoop Distributed File System (HDFS) and the MapReduce programming model. A four-node Hadoop cluster setup was created to test the performance of these components using Pi and Grep MapReduce applications, demonstrating improvements in runtime with increased nodes and data sizes. The study concludes that Hadoop effectively addresses big data processing needs and enhances cluster performance through scalable architecture.
Big data processing using - Hadoop Technology
Big data processing using - Hadoop TechnologyShital Kat This document summarizes a report on Hadoop technology as a solution to big data processing. It discusses the big data problem, including defining big data, its characteristics and challenges. It then introduces Hadoop as a solution, describing its components HDFS for storage and MapReduce for parallel processing. Examples of common friend lists and word counting are provided. Finally, it briefly mentions some Hadoop projects and companies that use Hadoop.
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...
On Traffic-Aware Partition and Aggregation in Map Reduce for Big Data Applica...dbpublications The document discusses improvements to the MapReduce programming model, focusing on reducing network traffic during the shuffle phase essential for performance enhancement in big data applications. It proposes a novel intermediate data partition scheme and an aggregator placement problem, employing both offline and online algorithms to optimize traffic cost. Extensive simulations demonstrate that the proposed methods can significantly lower network traffic costs while enhancing overall system performance.
Performance Improvement of Heterogeneous Hadoop Cluster using Ranking Algorithm
Performance Improvement of Heterogeneous Hadoop Cluster using Ranking AlgorithmIRJET Journal This document proposes using a ranking algorithm and sampling algorithm to improve the performance of a heterogeneous Hadoop cluster. The ranking algorithm prioritizes data distribution based on node frequency, so that higher frequency nodes are processed first. The sampling algorithm randomly selects nodes for data distribution instead of evenly distributing across all nodes. The proposed approach reduces computation time and improves overall cluster performance compared to the existing approach of evenly distributing data across nodes of varying sizes. Results show the proposed approach reduces execution time for various file sizes compared to the existing approach.
HPC + Ai: Machine Learning Models in Scientific Computing
HPC + Ai: Machine Learning Models in Scientific Computinginside-BigData.com The document discusses the integration of AI and high-performance computing (HPC) to address major scientific challenges, such as drug discovery, climate modeling, and understanding complex systems like HIV and lithium-ion battery technologies. It highlights advancements in model training and efficiency gained through deep learning and GPUs, which enable faster data processing and simulation at unprecedented scales. Overall, it emphasizes the transformative potential of combining AI with HPC for improved scientific outcomes and innovation.
IRJET- Optimization of Completion Time through Efficient Resource Allocation ...
IRJET- Optimization of Completion Time through Efficient Resource Allocation ...IRJET Journal This document discusses optimizing task completion time in cloud computing through efficient resource allocation using genetic and differential evolutionary algorithms. It aims to reduce makespan (completion time) by combining a genetic algorithm with differential evolutionary algorithms. The genetic algorithm uses selection, crossover and mutation to allocate tasks to resources. The outputs are then input to the differential evolutionary algorithm, which has the same operations in reverse order. This double process refines the allocation to provide the best allocation minimizing completion time. The document outlines the related work in genetic algorithms for resource allocation and task scheduling in cloud computing.
Qiu bosc2010
Qiu bosc2010BOSC 2010 This document summarizes cloud technologies and their applications in life sciences. It discusses how cloud computing can help address challenges posed by big data through cost-effective data centers, hiding complexity, and parallel computing frameworks like MapReduce. Specific applications highlighted include DNA sequence assembly, metagenomics, and correlating health data with environmental factors. Frameworks like Hadoop, DryadLINQ, and Twister are examined for processing large-scale biological data on clouds.
Effect of countries in performance of hadoop.
Effect of countries in performance of hadoop.Computer Science Journals This document discusses analyzing the performance of Hadoop with different sized datasets and various counters. Experiments were conducted on a Hadoop cluster to analyze how CPU time, number of blocks, heap size, HDFS bytes read, and spilled records are affected by the size of data from 49.7 MB to 71.5 MB. The results showed that CPU time increases slightly as data and number of blocks increase. CPU time also increases as HDFS bytes read and spilled records increase. Tuning the heap size and number of blocks can help optimize performance. Hadoop is concluded to efficiently handle and analyze big data.
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLab
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLabVijay Srinivas Agneeswaran, Ph.D The document presents advancements and frameworks in big data processing beyond Hadoop MapReduce, focusing on technologies like Apache Hadoop YARN, Spark, and Storm for various types of analytics including real-time and machine learning applications. It discusses the architecture of YARN, the Berkeley Data Analytics Stack (BDAS), and predictive modeling using PMML, detailing examples of their application in consumer churn analysis and optimization in data processing. Conclusions emphasize the shift towards real-time computation while leveraging existing analytical tools and algorithms.
Hadoop Cluster Analysis and Assessment
Hadoop Cluster Analysis and AssessmentInternational Journal of Modern Research in Engineering and Technology
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLab
Beyond Hadoop 1.0: A Holistic View of Hadoop YARN, Spark and GraphLabVijay Srinivas Agneeswaran, Ph.D
Similar to IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing with Map Reduce (20)
A Novel Approach for Clustering Big Data based on MapReduce
A Novel Approach for Clustering Big Data based on MapReduce IJECEIAES This paper presents a novel approach for clustering big data using the k-prototype algorithm implemented on the MapReduce framework. The approach addresses the limitations of traditional clustering methods like k-means, which only works efficiently with numerical data, by allowing for the combination of numerical and categorical data. Experiments show that the proposed method significantly improves performance and reduces execution time when handling large-scale data compared to traditional algorithms.
Survey on MapReduce in Big Data Clustering using Machine Learning Algorithms
Survey on MapReduce in Big Data Clustering using Machine Learning AlgorithmsIRJET Journal This document summarizes research on using MapReduce techniques for big data clustering with machine learning algorithms. It discusses how traditional clustering algorithms do not scale well for large datasets. MapReduce allows distributed processing of large datasets in parallel. The document reviews several studies that implemented clustering algorithms like k-means using MapReduce on Hadoop. It found this improved efficiency and reduced complexity compared to traditional approaches. Faster processing of large datasets enables applications in areas like education and healthcare.
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET Journal The document reviews existing methods for the k-means clustering algorithm. It discusses how k-means clustering works and some of its limitations when dealing with large datasets, such as being dependent on the initial choice of centroids. It then proposes using Hadoop to overcome big data challenges and calculate preliminary centroids for k-means clustering in a distributed manner. Finally, it reviews different techniques that have been proposed in other research to improve k-means clustering, such as methods for selecting better initial centroids or determining the optimal number of clusters.
MACHINE LEARNING ON MAPREDUCE FRAMEWORK
MACHINE LEARNING ON MAPREDUCE FRAMEWORKAbhi Jit This document discusses using MapReduce and Apache Hadoop for large-scale data mining and analytics. It describes several Apache Hadoop projects like HDFS, MapReduce, HBase and Mahout. It discusses using Mahout for tasks like clustering, classification and recommendation. The document reviews literature on parallel K-means clustering with MapReduce and using clouds for scalable big data analytics. It outlines a plan to study parallel K-means clustering and implement a solution to handle large datasets.
An Efficient Approach for Clustering High Dimensional Data
An Efficient Approach for Clustering High Dimensional DataIJSTA The document discusses clustering high dimensional data using an efficient approach called "Big Data Clustering using k-Mediods BAT Algorithm" (KMBAT). KMBAT simultaneously considers all data points as potential exemplars and exchanges real-valued messages between data points until a high-quality set of exemplars and corresponding clusters emerges. It is demonstrated on Facebook user profile data stored in an HDInsight Hadoop cluster. KMBAT finds better clustering solutions than other methods in less time for high dimensional big data.
Big Data Analytics Projects - Real World with Pentaho
Big Data Analytics Projects - Real World with PentahoMark Kromer This document discusses big data analytics projects and technologies. It provides an overview of Hadoop, MapReduce, YARN, Spark, SQL Server, and Pentaho tools for big data analytics. Specific scenarios discussed include digital marketing analytics using Hadoop, sentiment analysis using MongoDB and SQL Server, and data refinery using Hadoop, MPP databases, and Pentaho. The document also addresses myths and challenges around big data and provides code examples of MapReduce jobs.
The rise of “Big Data” on cloud computing
The rise of “Big Data” on cloud computingMinhazul Arefin This document provides a comprehensive overview of the intersection between big data and cloud computing, defining big data by its volume, velocity, variety, and veracity. It details characteristics, storage systems, and processing frameworks like Hadoop, along with real-world case studies from various organizations. The document also highlights research challenges and open issues in managing big data within cloud environments, suggesting areas for future exploration.
Big Data in Azure
Big Data in AzureDataWorks Summit/Hadoop Summit Big data is driving transformative changes in traditional data warehousing. Traditional ETL processes and highly structured data schemas are being replaced with schema flexibility to handle all types of data from diverse sources. This allows for real-time experimentation and analysis beyond just operational reporting. Microsoft is applying lessons from its own big data journey to help customers by providing a comprehensive set of Apache big data tools in Azure along with intelligence and analytics services to gain insights from diverse data sources.
Big Data on azure
Big Data on azureDavid Giard The document discusses Big Data on Azure and provides an overview of HDInsight, Microsoft's Apache Hadoop-based data platform on Azure. It describes HDInsight cluster types for Hadoop, HBase, Storm and Spark and how clusters can be automatically provisioned on Azure. Example applications and demos of Storm, HBase, Hive and Spark are also presented. The document highlights key aspects of using HDInsight including storage integration and tools for interactive analysis.
How Partitioning Clustering Technique For Implementing...
How Partitioning Clustering Technique For Implementing...Nicolle Dammann This document discusses and compares different clustering and conjoint analysis techniques. It provides definitions and examples of cluster analysis and conjoint analysis, highlighting their advantages and limitations. Cluster analysis is used to group similar customers and products for market segmentation. Conjoint analysis determines how people value different attributes of a product or service. The document also compares these two techniques and discusses their various applications in business and marketing research.
A premeditated cdm algorithm in cloud computing environment for fpm 2
A premeditated cdm algorithm in cloud computing environment for fpm 2IAEME Publication This document discusses applying data mining techniques in a cloud computing environment. It begins with an introduction to cloud computing, describing its key characteristics including on-demand self-service, broad network access, resource pooling, rapid elasticity, and measured service. The document then provides an overview of common data mining techniques like association, classification, clustering, prediction, and sequential patterns. It reviews recent studies applying these techniques in cloud and distributed systems. The document proposes a new Cloud Data Mining (CDM) algorithm that performs data mining in both cloud and non-cloud environments and compares the costs of each approach.
Microsoft's Hadoop Story
Microsoft's Hadoop StoryMichael Rys This document discusses Hadoop and its relationship to Microsoft technologies. It provides an overview of what Big Data is, how Hadoop fits into the Windows and Azure environments, and how to program against Hadoop in Microsoft environments. It describes Hadoop capabilities like Extract-Load-Transform and distributed computing. It also discusses how HDFS works on Azure storage and support for Hadoop in .NET, JavaScript, HiveQL, and Polybase. The document aims to show Microsoft's vision of making Hadoop better on Windows and Azure by integrating with technologies like Active Directory, System Center, and SQL Server. It provides links to get started with Hadoop on-premises and on Windows Azure.
Combining hadoop with big data analytics
Combining hadoop with big data analyticsThe Marketing Distillery This document discusses combining Hadoop with big data analytics. It begins by exploring how Hadoop has become a popular framework for handling big data challenges. It then discusses some of the key skills needed for successful big data analytics programs, including technical skills with tools like Hadoop as well as business knowledge. Specifically, it recommends including business analysts, BI developers, predictive model builders, data architects, data integration developers, and technology architects on any big data analytics team.
Distributed Framework for Data Mining As a Service on Private Cloud
Distributed Framework for Data Mining As a Service on Private CloudIJERA Editor This document discusses a distributed framework for data mining as a service (DMaaS) on a private cloud, focusing on improving efficiency in processing large datasets through the integration of cloud computing and data mining techniques. The proposed model utilizes Hadoop for distributed data mining and provides a secure environment for organizations to analyze their data efficiently while maintaining data integrity. The framework demonstrates enhanced performance over traditional centralized approaches, particularly as data size increases.
Clustering of Big Data Using Different Data-Mining Techniques
Clustering of Big Data Using Different Data-Mining TechniquesIRJET Journal This document discusses clustering techniques for big data using different data mining approaches. It begins with an introduction to big data and some of its key characteristics like volume, variety, velocity, etc. It then discusses two main data mining techniques - clustering and classification. For clustering, it describes algorithms like K-means and bisecting K-means. It proposes a methodology using these algorithms with MapReduce for big data clustering. Several modules are implemented and results are presented with figures. It concludes that big data frameworks need to consider complex relationships in data and high performance platforms are required for big data mining.
Hadoop as an extension of DW
Hadoop as an extension of DWSidi yazid This document discusses issues with processing large volumes of data and proposes an enterprise data warehouse architecture capable of handling big data. It aims to explain integrating Hadoop into existing data warehouses.
The first chapter introduces challenges of increased data volume, variety and velocity. It discusses skill shortages in big data and analytics. Existing data warehouses are built for reporting but not analyzing large, unaggregated data.
The second chapter outlines requirements for a new architecture and proposes a multi-platform data warehouse environment incorporating Hadoop. It describes Hadoop components like HDFS, YARN, Hive and tools like Sqoop.
The third chapter focuses on integrating Hadoop into existing data warehouses by implementing star schemas in Hive, addressing security,
Building Data Products
Building Data ProductsCloudera, Inc. The document is a presentation by Josh Wills, a senior director of data science, outlining the roles and responsibilities of data scientists and the intricacies of building data products. It covers various topics including data science methodologies, collaborative filtering, k-means clustering, and random forests, as well as their applications on Hadoop. The document emphasizes the importance of finding insights, building effective teams, and the significance of experimentation in data science.
Big Data Lessons from the Cloud
Big Data Lessons from the CloudMapR Technologies The document discusses the challenges of big data and how cloud computing, particularly through Hadoop, provides scalable solutions for processing large volumes of data. It highlights various use cases demonstrating Hadoop's efficiency and cost-effectiveness compared to traditional data warehousing. Key lessons emphasize the need for new approaches in big data analytics, the benefits of flexibility in cloud infrastructure, and the potential for combining diverse data sources for enhanced insights.
2013 International Conference on Knowledge, Innovation and Enterprise Presen...
2013 International Conference on Knowledge, Innovation and Enterprise Presen...oj08 The document discusses the challenges and opportunities associated with large distributed computing infrastructures and big data management. It highlights the exponential growth of digital data, the distinction between structured and unstructured data, and the necessity for companies to rethink their data handling strategies using cloud computing and advanced analytics. Key recommendations include treating big data projects as business mandates, leveraging human intelligence, and integrating various technologies and systems to improve data analysis while addressing the skills shortage in the analytics field.
LOAD BALANCING LARGE DATA SETS IN A HADOOP CLUSTER
LOAD BALANCING LARGE DATA SETS IN A HADOOP CLUSTERijdpsjournal This document presents a study on load balancing for large data sets within a Hadoop cluster, focusing on the use of MapReduce to enhance parallel processing and Yarn for task monitoring. It highlights the challenges of processing increasing data volumes and the need for real-time monitoring and efficient task distribution among nodes to optimize server performance. The research aims to propose methods for better load management, ensuring that data processing is handled effectively across a network of connected computers.
Ad
More from IRJET Journal (20)
Enhanced heart disease prediction using SKNDGR ensemble Machine Learning Model
Enhanced heart disease prediction using SKNDGR ensemble Machine Learning ModelIRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I201.pdf
Utilizing Biomedical Waste for Sustainable Brick Manufacturing: A Novel Appro...
Utilizing Biomedical Waste for Sustainable Brick Manufacturing: A Novel Appro...IRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I209.pdf
Kiona – A Smart Society Automation Project
Kiona – A Smart Society Automation ProjectIRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I207.pdf
DESIGN AND DEVELOPMENT OF BATTERY THERMAL MANAGEMENT SYSTEM USING PHASE CHANG...
DESIGN AND DEVELOPMENT OF BATTERY THERMAL MANAGEMENT SYSTEM USING PHASE CHANG...IRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I204.pdf
Invest in Innovation: Empowering Ideas through Blockchain Based Crowdfunding
Invest in Innovation: Empowering Ideas through Blockchain Based CrowdfundingIRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I205.pdf
SPACE WATCH YOUR REAL-TIME SPACE INFORMATION HUB
SPACE WATCH YOUR REAL-TIME SPACE INFORMATION HUBIRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I203.pdf
A Review on Influence of Fluid Viscous Damper on The Behaviour of Multi-store...
A Review on Influence of Fluid Viscous Damper on The Behaviour of Multi-store...IRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I206.pdf
Wireless Arduino Control via Mobile: Eliminating the Need for a Dedicated Wir...
Wireless Arduino Control via Mobile: Eliminating the Need for a Dedicated Wir...IRJET Journal https://www.irjet.net/archives/V11/i2/IRJET-V11I208.pdf
Explainable AI(XAI) using LIME and Disease Detection in Mango Leaf by Transfe...
Explainable AI(XAI) using LIME and Disease Detection in Mango Leaf by Transfe...IRJET Journal This paper presents a pre-trained deep learning model, DenseNet169, for the detection of leaf diseases in mango plants using transfer learning and the explainable AI tool LIME. The model achieved an accuracy of 97.41% and emphasizes the importance of model interpretability in agricultural machine learning applications. Future work aims to expand the dataset to enhance the model's generalization for a wider range of plant leaf diseases.
BRAIN TUMOUR DETECTION AND CLASSIFICATION
BRAIN TUMOUR DETECTION AND CLASSIFICATIONIRJET Journal This document presents a study on the application of artificial intelligence (AI) and machine learning (ML), specifically using support vector machines (SVM), for the early detection and classification of brain tumors. It emphasizes the importance of early detection in improving treatment outcomes and reviews existing methodologies and technologies for brain tumor diagnosis. The findings indicate high accuracy in tumor detection, with the SVM model achieving a training score of 0.9887 and a testing score of 0.9592.
The Project Manager as an ambassador of the contract. The case of NEC4 ECC co...
The Project Manager as an ambassador of the contract. The case of NEC4 ECC co...IRJET Journal The document discusses the NEC4 Engineering and Construction Contract (ECC) as a transformative approach to contract management in the construction industry, emphasizing collaborative risk sharing and management. It highlights the innovative features of NEC4, including a focus on mutual trust and early warning processes that facilitate proactive risk management. The article aims to improve traditional contracting models by reviewing the characteristics of NEC4 ECC contracts and their application in project management.
"Enhanced Heat Transfer Performance in Shell and Tube Heat Exchangers: A CFD ...
"Enhanced Heat Transfer Performance in Shell and Tube Heat Exchangers: A CFD ...IRJET Journal This study presents a computational fluid dynamics (CFD) analysis of a shell and tube heat exchanger using twisted tape turbulators and aluminum oxide (Al2O3) nanofluids to enhance heat transfer performance. It reveals that the incorporation of Al2O3 nanofluids significantly improves heat transfer rates, though higher concentrations increase pressure drops, suggesting a trade-off between enhanced heat transfer and pressure drop. The research aims to provide valuable insights for optimizing heat exchanger designs and operational parameters in industrial applications.
Advancements in CFD Analysis of Shell and Tube Heat Exchangers with Nanofluid...
Advancements in CFD Analysis of Shell and Tube Heat Exchangers with Nanofluid...IRJET Journal The document reviews advancements in computational fluid dynamics (CFD) analysis of shell and tube heat exchangers utilizing nanofluids and twisted tape turbulators to enhance heat transfer efficiency. It highlights the potential of nanofluids to improve thermal conductivity and the role of twisted tape in altering flow dynamics, while addressing challenges like nanoparticle agglomeration and increased pressure drop. The findings illustrate the synergy of these technologies, presenting insights for optimizing heat exchanger designs in various industrial applications.
Breast Cancer Detection using Computer Vision
Breast Cancer Detection using Computer VisionIRJET Journal The document discusses a novel computer vision-based method for the early detection and diagnosis of breast cancer, utilizing convolutional neural networks (CNNs) for high accuracy and cost-effectiveness. The research highlights the development of a CNN model that achieved 92.25% accuracy in identifying breast regions in medical images, demonstrating its potential for improving patient outcomes. It also addresses challenges faced in current methodologies and the future scope of enhancing breast cancer detection technologies.
Auto-Charging E-Vehicle with its battery Management.
Auto-Charging E-Vehicle with its battery Management.IRJET Journal The document discusses a novel auto-charging electric vehicle (EV) concept that minimizes charging time and maximizes travel distance by integrating a generator coupled to the vehicle's wheel shaft. It details the system's design involving dual batteries—one for propulsion and the other for storage—along with a controller for efficient power management through hard or soft switching mechanisms. The aim is to reduce reliance on charging stations and contribute to global pollution control by providing an energy-efficient EV solution.
Analysis of high energy charge particle in the Heliosphere
Analysis of high energy charge particle in the HeliosphereIRJET Journal The study analyzes galactic cosmic ray (GCR) flux variations during solar cycles 23-24, focusing on the effects of solar activity and heliospheric conditions. It finds that GCR intensity is modulated by solar winds, coronal mass ejections, and interplanetary magnetic field disturbances, demonstrating an anti-correlation with solar activity indices. The research highlights the impact of these solar phenomena on GCR behavior and their relation to the dynamics of heliospheric plasma.
A Novel System for Recommending Agricultural Crops Using Machine Learning App...
A Novel System for Recommending Agricultural Crops Using Machine Learning App...IRJET Journal The document discusses a novel crop recommendation system utilizing machine learning techniques aimed at improving agricultural productivity, particularly in Maharashtra, India. It highlights the importance of data analysis and precision agriculture in addressing the challenges farmers face due to changing climatic conditions and the need for reliable crop yield predictions. The proposed system aims to provide personalized recommendations based on various agricultural parameters to enhance yield and support farmers in making informed decisions.
Auto-Charging E-Vehicle with its battery Management.
Auto-Charging E-Vehicle with its battery Management.IRJET Journal The document discusses a novel approach to electric vehicles (EVs) featuring an auto-charging mechanism aimed at eliminating long charging times and extending travel distances. The project involves a dual-battery system using a generator coupled to the vehicle's wheel shaft, which allows for efficient energy management through a controller that switches between the main and auxiliary batteries. The proposed solution has the potential to reduce dependency on charging stations and contribute to lower emissions and maintenance costs.
Analysis of high energy charge particle in the Heliosphere
Analysis of high energy charge particle in the HeliosphereIRJET Journal The document presents a data-driven analysis of galactic cosmic rays (GCRs) during solar cycle 23-24, exploring the relationship between solar activity and GCR modulation. It discusses the dependence of GCR diffusion parameters on rigidity and time, emphasizing the influences of solar wind disturbances and interplanetary magnetic field variations. The findings reveal an inverse correlation between GCR intensity and solar activity indices, suggesting unique modulation characteristics during this solar cycle.
Wireless Arduino Control via Mobile: Eliminating the Need for a Dedicated Wir...
Wireless Arduino Control via Mobile: Eliminating the Need for a Dedicated Wir...IRJET Journal This document presents a method for wirelessly controlling Arduino using a mobile device via a laptop without dedicated hardware modules like ESP8266 or ESP32. It details a Python script that acts as a communication bridge, establishing a connection through serial communication and socket networking to exchange commands and responses, specifically demonstrated by controlling an LED. The project emphasizes cost-effectiveness and practicality for IoT applications by leveraging existing resources and offers flexibility for future expansions.
Ad
Recently uploaded (20)
Call For Papers - 17th International Conference on Wireless & Mobile Networks...
Call For Papers - 17th International Conference on Wireless & Mobile Networks...hosseinihamid192023 17th International Conference on Wireless & Mobile Networks (WiMoNe 2025) will provide
an excellent international forum for sharing knowledge and results in theory, methodology and
applications of Wireless & Mobile computing Environment. Current information age is witnessing
a dramatic use of digital and electronic devices in the workplace and beyond. Wireless, Mobile
Networks & its applications had received a significant and sustained research interest in terms of
designing and deploying large scale and high performance computational applications in real life.
The aim of the conference is to provide a platform to the researchers and practitioners from both
academia as well as industry to meet and share cutting-edge development in the field.
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdf
Abraham Silberschatz-Operating System Concepts (9th,2012.12).pdfShabista Imam Complete book of operating system edition 9
Modern multi-proposer consensus implementations
Modern multi-proposer consensus implementationsFrançois Garillot Multi-proposer consensus protocols let multiple validators propose blocks in parallel, breaking the single-leader throughput bottleneck of classic designs. Yet the modern multi-proposer consensus implementation has grown a lot since HotStuff. THisworkshop will explore the implementation details of recent advances – DAG-based approaches like Narwhal and Sui’s Mysticeti – and reveal how implementation details translate to real-world performance gains. We focus on the nitty-gritty: how network communication patterns and data handling affect throughput and latency. New techniques such as Turbine-like block propagation (inspired by Solana’s erasure-coded broadcast) and lazy push gossip broadcasting dramatically cut communication overhead. These optimizations aren’t just theoretical – they enable modern blockchains to process over 100,000 transactions per second with finality in mere milliseconds redefining what is possible in decentralized systems.
Validating a Citizen Observatories enabling Platform by completing a Citizen ...
Validating a Citizen Observatories enabling Platform by completing a Citizen ...Diego López-de-Ipiña González-de-Artaza Citizen Observatories (COs) are initiatives that empower citizens to engage in data collection, analysis and interpretation in order to address various issues affecting their communities and contribute to policy-making and community development.
Thematic co-exploration is a co-production process where citizens actively participate alongside scientists and other actors in the exploration of specific themes.
Making them a reality involves addressing the following challenges:
Data quality and reliability
Engagement and retention of participants
Integration with policy and decision-making
Proposal for folders structure division in projects.pdf
Proposal for folders structure division in projects.pdfMohamed Ahmed Proposal for folders structure division in projects
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...
Introduction to Natural Language Processing - Stages in NLP Pipeline, Challen...resming1 Lecture delivered in 2021. This gives an introduction to Natural Language Processing. It describes the use cases of NLP in daily life. It discusses the stages in NLP Pipeline. It highlights the challenges involved covering the different levels of ambiguity that could arise. It also gives a brief note on the present scenario with the latest language models, tools and frameworks/libraries for NLP.
Fatality due to Falls at Working at Height
Fatality due to Falls at Working at Heightssuserb8994f It is related to fatality due to falls at working at height
MATERIAL SCIENCE LECTURE NOTES FOR DIPLOMA STUDENTS
MATERIAL SCIENCE LECTURE NOTES FOR DIPLOMA STUDENTSSAMEER VISHWAKARMA This PPT contains notes for taking lecture at diploma level.
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptx
Deep Learning for Natural Language Processing_FDP on 16 June 2025 MITS.pptxresming1 This gives an introduction to how NLP has evolved from the time of World War II till this date through the advances in approaches, architectures and word representations. From rule based approaches, it advanced to statistical approaches. from traditional machine learning algorithms it advanced to deep neural network architectures. Deep neural architectures include recurrent neural networks, long short term memory, gated recurrent units, seq2seq models, encoder decoder models, transformer architecture, upto large language models and vision language models which are multimodal in nature.
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptx
Tesla-Stock-Analysis-and-Forecast.pptx (1).pptxmoonsony54 this is data science ppt for tesla stock (linear regression)
Microwatt: Open Tiny Core, Big Possibilities
Microwatt: Open Tiny Core, Big PossibilitiesIBM Microwatt is a lightweight, open-source core based on the OpenPOWER ISA.
It’s designed for FPGAs and easy experimentation in chip design.
Ideal for education, prototyping, and custom silicon development.
Fully open, it empowers developers to learn, modify, and innovate.
Complete guidance book of Asp.Net Web API
Complete guidance book of Asp.Net Web APIShabista Imam Unlock the full potential of modern web development with the Complete Guidance Book of ASP.NET Web API—your all-in-one resource for mastering RESTful services using Microsoft’s powerful ASP.NET Core framework. This book takes you on a step-by-step journey from beginner to expert, covering everything from routing and controllers to security, performance optimization, and real-world architecture.
International Journal of Advanced Information Technology (IJAIT)
International Journal of Advanced Information Technology (IJAIT)ijait International journal of advanced Information technology (IJAIT) is a bi monthly open access peer-
reviewed journal, will act as a major forum for the presentation of innovative ideas, approaches,
developments, and research projects in the area advanced information technology applications and
services. It will also serve to facilitate the exchange of information between researchers and industry
professionals to discuss the latest issues and advancement in the area of advanced IT. Core areas of
advanced IT and multi-disciplinary and its applications will be covered during the conferences.
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTUREShabista Imam FUNDAMENTALS OF COMPUTER ORGANIZATION AND ARCHITECTURE
By : Mostafa Abd-El-Barr & Hesham El-Rewini:: wiley
A complete guidance book
Tally.ERP 9 at a Glance.book - Tally Solutions .pdf
Tally.ERP 9 at a Glance.book - Tally Solutions .pdfShabista Imam Tally.ERP 9 at a Glance.book, a fully completed guidance to learn tally erp 9.0
Data Structures Module 3 Binary Trees Binary Search Trees Tree Traversals AVL...
Data Structures Module 3 Binary Trees Binary Search Trees Tree Traversals AVL...resming1 This covers binary trees, binary search trees, BST insertion, deletion, tree traversals - inorder, preorder, postorder, AVL trees, AVL tree insertion, deletion, BTrees - insertion, deletion, hash tables etc.
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management Process
May 2025: Top 10 Read Articles in Data Mining & Knowledge Management ProcessIJDKP Data mining and knowledge discovery in databases have been attracting a significant amount of research, industry, and media attention of late. There is an urgent need for a new generation of computational theories and tools to assist researchers in extracting useful information from the rapidly growing volumes of digital data.
This Journal provides a forum for researchers who address this issue and to present their work in a peer-reviewed open access forum. Authors are solicited to contribute to the Journal by submitting articles that illustrate research results, projects, surveying works and industrial experiences that describe significant advances in the following areas, but are not limited to these topics only.
Validating a Citizen Observatories enabling Platform by completing a Citizen ...
Validating a Citizen Observatories enabling Platform by completing a Citizen ...Diego López-de-Ipiña González-de-Artaza
IRJET- A Review on K-Means++ Clustering Algorithm and Cloud Computing with Map Reduce
- 1. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7542 A Review on K-means++ Clustering Algorithm and Cloud Computing with Map Reduce 1Sweekruth S Badiger, 2Sushmitha N 1PG Student, Dept. of Information Science and Engg., R. V. College of Engineering, Bangalore, Karnataka India 2Assistant Professor, Dept. of Information Science and Engg., R. V. College of Engineering, Bangalore, Karnataka, India ---------------------------------------------------------------------***--------------------------------------------------------------------- Abstract - The functionality of cloud computing is to host the servers in a dispersed network with a aim to deliver access to the wide range of customers. The core feature of cloud computing is its flexibility which offer users to perform upscaling or downscaling of the hardware. The main purpose for the development of cloud computing is the substantial increase in the volume of Big data evolved which require to be examined. Researchers utilize multiple algorithms to gain useful knowledge from a huge volume of data set. Hadoop has come up with a new software platform called MapReduce to carry out the operation parallelly on huge data set. Thereonly specific unsupervised learning algorithms which are executed successfully in MapReduce techniqueandaredeployedonhigh volume of data set. The combination of cloud computing with parallel processing in MapReduce stand out to be a powerful approach for the future technologyenhancements. Thissurvey provides a brief overview of cloud computing and of the most popular clustering algorithm named k-means++ Key Words: Hadoop, MapReduce, Cloud computing, K- Means++. 1. INTRODUCTION Cloud computing is on demand availability of hardware resources for computing or storage purpose. The term ‘Cloud’ basically means available to all through internet. It reduces the work for user to either setup or manage the hardware. Cloud provider take the ownership of providing and maintaining the hardware infrastructure. Most famous cloud service providers are Amazon, Google and Microsoft. World is producing data of 2.5 quintillion bytes per day at current pace due to internet, and it’s only going to increase with arrival of internet of things. Data is new ‘oil’ of our generation and mining it to discover knowledge is critical to many businesses. Processing such a large amount of data will pose unique kind of challenges to the data analyzers. Normal sequential methods of programming are less efficient and hence the need of parallel processing gained importance. Cloud provides the ideal infrastructure and Hadoop MapReduce programming paradigm can make most use of it. Many sequential programming algorithms are now converted to Hadoop MapReduceprogrammingparadigm.It should be noted here that there may be algorithms that cannot be parallelized, and hence are of not much use in the real world today as parallelization is of essence to process Big Data. Hence some of the conventional algorithms for clustering or technology can provide a great platform and advancements to the new emergingtechnologyandalsovery beneficial to the business enterprise organizations. classification are now implemented using MapReduce Programming paradigm. 2. BACKGROUND A. Cloud computing Cloud computing has evolved since the inception of internet. Historically processing and storagewereexpensive, but due to scientific and technological advancement in hardware manufacturing industries, hardware has become much cheaper and smaller insizecomparedtoearlier.Taking advantage of this fact, industries came up with providing the hardware infrastructure as service to users and this is how Cloud computing paradigm was born. Figure. 1. Cloud computing service types [1]
- 2. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7543 Figure. 2. Cloud computing deployment models [1] As shown in Fig. 1, cloudproviderscanprovideservicesin three delivery types, that is Software as a Service (SaaS), Platform as a Service (PaaS) and Infrastructure as a Service (IaaS). Cloud deployment services comes in the form of private, hybrid,publicandcommunityasmentionedinFigure 2. Public clouds have many customers compared to other forms of cloud. Private clouds usually are not cost efficient. B. Hadoop Hadoop is considered to be one of the best tools tohandle big data. It has two major components HDFS and another is MapReduce. HDFS stores the files in blocks of 64MB. It can handle the files of varying size from 10 MB to GB, TB.Hadoop can run withsingle nodeormulti-nodecluster.EveryHadoop cluster can have five running processes namely. HDFS can be thought of Data node + Name node + Secondary Name node and daemon process to manage MapReduce programming paradigm in HDFS are Job Tracker + Task Tracker. Figure. 3. Data flow in HDFS [2] C. Map reduce paradigm Map Reduce Programming Paradigm of Hadoop is a model to process huge amount of data. Map phase maps the input data into <key,value> pairs[3]. The reduce phase combines the data based on common keys and performs reduce operation defined by the user. The parallelization occurs with many mappers created for reading the data and it is not sequential. Because of this there is high throughput [4]. 3. K-Means++ CLUSTERING ALGORITHM K-Means++ algorithm is the improved version of most widely used K-means algorithm in clustering. K-Means algorithm initializes the centroid randomly, which is where it could sometimes create less accurate clusters. K-Means++ overcomes initialization part to improve K-Means. K- Means++ algorithm takes an input k, which refers to the number of clusters that should be generated and n refers to set of objects [5]. K-Means++ clustering algorithm works as follows. 1. Select initial centroid X uniformly at random. 2. For each instance X we need to compute D(X) which is the distance between X andthenearestcentroidthathas already been chosen. 3. Choose next centroid using a weighted probability distribution which is proportional to D(X)2. 4. Repeat 2 and 3 until K centroids have been chosen. 5. Assign each record or instance point to a cluster centre which has least distance. 6. Calculate mean value of all points in the cluster. 7. Replace cluster centroid to this new mean value. 8. Repeat the steps from 6, until thereare nomorechanges to centroids. This algorithm can be implemented in map-reduce pattern as follows. • Map function: The HDFS stores input data as sequence file of <key, value> pairs [6]. Every <key, value> pair represents a record. The map function splits the data acrossall mappers [7]. • Reduce function: After mapping, reducers are used for computing Step-2 of the algorithm. Reducer will also combine intermediate data of same mapper [8]. The intermediate data can be put in hdfs or stored locally [9]. New centres are generated which can be used for further iterations. Figure. 4. K-Means++ Map Reduce [2]
- 3. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7544 4. CONCLUSIONS AND FUTURE WORK The Big Data generated today has demanded more computing, more storage resources as well as better way to process the data. Conventional methods were failing tocope up with such challenges because of which Cloud Computing and Hadoop MapReduce gained popularity [10]. The K-Means++ algorithm discussed in this survey is efficient for large set of data but it suffers with outlier issue. Future work could involve outlier detecting and removal algorithm merged with K-Means++ to give better and more accurate results. REFERENCES [1] Adem Tepe, GüRay Yilmaz, “A Survey on Cloud Computing Technology and Its Application to Satellite Ground Systems”, International Conference on Recent Advances in Space Technologies (RAST), 2013. [2] Rajashree Shettar, Bhimasen. V. Purohit, “A Review on Clustering Algorithms Applicable for Map Reduce”, International Conference on Computational Systemsfor Health & Sustainability, pp. 176-178, 2015. [3] K. Singh and R. Kaur, "Hadoop: Addressing challengesof Big Data," 2014 IEEE International Advance Computing Conference (IACC), Gurgaon, 2014, pp. 686-689. [4] Borthakur. D “The Hadoop Distributed File System: Architecture and design”, 2007. [5] Weihzong Zhao, Huifang Ma, Qing He, “Parallel K-Means clustering BasedonMapReduce”,springer-verlagBerlin, Heidelberg, 2009. [6] Sangeeta Ahuja, M.Ester, H. P. Kriegel, J. Sander, X.Xu,“A Density based algorithm fordiscoveringclustersinlarge spatial database with noise”, Second international conference on knowledge discovery and Data Mining,1996. [7] B. Dai and I. Lin, "Efficient Map/Reduce-Based DBSCAN Algorithm with Optimized Data Partition," 2012 IEEE Fifth International Conference on Cloud Computing, Honolulu, HI, 2012, pp. 59-66. [8] V. Gaede, O. G’unther, “Multidimensional access methods”, ACM comput. Surv., Vol. 30, No. 2, pp. 170- 231, 1998. [9] Varad Meru “Data clustering: Using MapReduce”, software Developers Journal, 2013. [10] Das A.S, Datar M, Garg, and Rajaram S, “Google news personalization scalable online collaborative filtering”, pp. 271-280, 2007.