SlideShare a Scribd company logo
Parallel and Distributed Computing
(Lecture # 01) (Part 01)
1
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
Instructor Information
Name:
Muhammad Haroon (MSCS from BZU)
(PhD Scholar in Computer Science from HITEC University)
Contact information:
mr.harunahmad2014@gmail.com
Domain:
Machine Learning, Artificial Intelligence, Deep Learning, Data Science,
Image Processing, Computer Vision, Natural Language Processing,
Mobile Apps, Websites
Course Information
Name
Parallel and Distributed Computing
Lectures
16
Quizzes
10
Assignments
10
Attendance
75%
Semester Report + Project +Presentation
01
Note: The plagiarism & cheating cases would be reported to the Disciplinary Committee.
Classroom rules
Don’t
 Ask for leave
 Ask for quiz re-take
 Ask for assignment re-submit
 Ask for mobile call
 Ask for break
 20 minutes break
Overview of Course
At the end of the course the students will be able to:
 Write portable programs for parallel or distributed architectures using
Message-Passing Interface (MPI) library
 Analytical modelling and performance of parallel programs.
 Analyze complex problems with shared memory programming with
openMP.
5
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
DISTRIBUTED SYSTEMS
Principles and Paradigms
(Lecture # 01)
6
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
What is an Operating System
An operating system is:
A collection of software components that
 Provides useful abstractions and Manages resources to Support
application programs, and Provide an interface for users and programs
7
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
Operating System Functions
An operating system’s main functions are to:
 Schedule processes & multiplex CPU
 Provide mechanisms for IPC and synchronization
 Manage main memory
 Manage other resources
 Provide convenient persistent storage (files)
 Maintain system integrity, handle failures
 Enforce security policies (e.g., access control)
 Give users and processes an interface
8
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
Definition of a Distributed System (1)
A distributed system is (Tannenbaum):
 A collection of independent computers that appears to its users as a
single coherent system.
A distributed system is (Lamport):
 One in which the failure of a computer you didn't even know existed can
render your own computer unusable
9
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
Properties of Distributed Systems
 Concurrency
 Multicore systems
 Multiple hosts
 No global clock
 Theoretical impossibility
 Expense of accurate clocks
 Independent view
 Message delay, failure
 Impossible to distinguish slow vs. failed node
 Independent failure
 Message delivery (loss, corruption)
 Nodes (fail-stop)
10
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com
Software Concepts
An overview of
 NOS (Network Operating Systems)
 DOS (Distributed Operating Systems)
 Middleware
System Description Main Goal
DOS
Tightly-coupled operating system for multi-
processors and homogeneous
multicomputers
Hide and manage
hardware
resources
NOS
Loosely-coupled operating system for
heterogeneous multicomputers (LAN and
WAN)
Offer local
services to remote
clients
Middleware
Additional layer atop of NOS implementing
general-purpose services
Provide
distribution
transparency
Definition of a Distributed System (2)
Figure 1-1. A distributed system organized as middleware. The middleware
layer extends over multiple machines and offers each application the
same interface.
Transparency in a Distributed System
Figure 1-2. Different forms of transparency in a distributed
system (ISO, 1995).
Other forms:
Parallelism – Hide the number of nodes working on a task
Size – Hide the number of components in the system
Revision – Hide changes in software/hardware versions
Challenges
 Performance
 Concurrency
 Failures
 Scalability
 System updates/growth
 Heterogeneity
 Openness
 Multiplicity of ownership, authority
 Security
 Quality of service/user experience
 Transparency
 Debugging
Approaches
 Virtual clocks
 Group communication
 Heartbeats/failure detection, group membership
 Distributed agreement, snapshots
 Leader election
 Transaction protocols
 Redundancy, replication, caching
 Indirection - naming
 Distributed mutual exclusion
 Middleware, modularization, layering
 Decomposition vs. integration
 Cryptographic protocols
Scalability Problems
Figure 1-3. Examples of scalability limitations.
Engineering = art of compromise (making tradeoffs)
Distributed systems – many theoretical results on lower bounds of
tradeoffs that limit practical solutions
Scalability Examples
Distributed systems are ubiquitous and necessary:
 Web search
 Financial transactions
 Multiplayer games
 DNS
 Travel reservation systems
 Utility infrastructure (e.g., power grid)
 Embedded systems (e.g., cars)
 Sensor networks
Failure to scale is fatal
 Instagram – share cellphone pix
 Facebook IPO
Web Search
Google uses thousands of machines to
 Provide search results
 Run Page-Rank algorithm
Issues
 Connecting large number of machines
 Distributed file system (GFS)
 Indexing
 Programming model
 Scaling up when current system reaches limits
Financial Transactions
Volume is huge
 4 million messages per second
 50 million things you can trade
Requirements are stringent
 Low latency
 24/7 operation (around the world)
 Failure “is not an option”
 Facebook NASDAQ Freeze
 Transaction system overwhelmed
 Hours to complete transactions in falling market
Multiplayer Games
Very popular – huge market
Characteristics
 May have millions of players
 Players operate in same “world”
 Players interact with world, each other
Issues
 Number of users
 Latency, consistency
 Coordination of multiple servers
 Architecture???
End
21
Cell: +92300-7327761 Email: mr.harunahmad2014@gmail.com

More Related Content

What's hot (20)

Computer network solution
Computer network solution
Md. Mashiur Rahman
 
Design issues of dos
Design issues of dos
vanamali_vanu
 
Distributed system unit II according to syllabus of RGPV, Bhopal
Distributed system unit II according to syllabus of RGPV, Bhopal
NANDINI SHARMA
 
Lecture 1 introduction to parallel and distributed computing
Lecture 1 introduction to parallel and distributed computing
Vajira Thambawita
 
Distributed system notes unit I
Distributed system notes unit I
NANDINI SHARMA
 
Lecture 1 (distributed systems)
Lecture 1 (distributed systems)
Fazli Amin
 
Distributed and Cloud Computing 1st Edition Hwang Solutions Manual
Distributed and Cloud Computing 1st Edition Hwang Solutions Manual
kyxeminut
 
Computer Network Unit I RGPV
Computer Network Unit I RGPV
NANDINI SHARMA
 
Communications is distributed systems
Communications is distributed systems
SHATHAN
 
Computer networks
Computer networks
Jessore University of Science & Technology, Jessore.
 
1.intro. to distributed system
1.intro. to distributed system
Gd Goenka University
 
16.Distributed System Structure
16.Distributed System Structure
Senthil Kanth
 
Distributed systems1
Distributed systems1
Sumita Das
 
Fundamentals
Fundamentals
Divya Srinivasan
 
Dos unit1
Dos unit1
JebasheelaSJ
 
Distributed Systems Introduction and Importance
Distributed Systems Introduction and Importance
SHIKHA GAUTAM
 
Distributed Systems
Distributed Systems
naveedchak
 
Computer netwrks
Computer netwrks
sandeeppartole2
 
Distributed computing
Distributed computing
rohitsalunke
 
Mcq for final
Mcq for final
sazzadulbarihridoy
 
Design issues of dos
Design issues of dos
vanamali_vanu
 
Distributed system unit II according to syllabus of RGPV, Bhopal
Distributed system unit II according to syllabus of RGPV, Bhopal
NANDINI SHARMA
 
Lecture 1 introduction to parallel and distributed computing
Lecture 1 introduction to parallel and distributed computing
Vajira Thambawita
 
Distributed system notes unit I
Distributed system notes unit I
NANDINI SHARMA
 
Lecture 1 (distributed systems)
Lecture 1 (distributed systems)
Fazli Amin
 
Distributed and Cloud Computing 1st Edition Hwang Solutions Manual
Distributed and Cloud Computing 1st Edition Hwang Solutions Manual
kyxeminut
 
Computer Network Unit I RGPV
Computer Network Unit I RGPV
NANDINI SHARMA
 
Communications is distributed systems
Communications is distributed systems
SHATHAN
 
16.Distributed System Structure
16.Distributed System Structure
Senthil Kanth
 
Distributed systems1
Distributed systems1
Sumita Das
 
Distributed Systems Introduction and Importance
Distributed Systems Introduction and Importance
SHIKHA GAUTAM
 
Distributed Systems
Distributed Systems
naveedchak
 
Distributed computing
Distributed computing
rohitsalunke
 

Similar to Lecture 01 - Chapter 1 (Part 01): Some basic concept of Operating System (OS), Parallel & Distributed Computing (20)

Chapter 1-Introduction.ppt
Chapter 1-Introduction.ppt
sirajmohammed35
 
chap-0 .ppt
chap-0 .ppt
Lookly Sam
 
Distributed Systems.pptx
Distributed Systems.pptx
salutiontechnology
 
Introduction to Distributed System
Introduction to Distributed System
Sunita Sahu
 
Lecture 1 distriubted computing
Lecture 1 distriubted computing
ARTHURDANIEL12
 
chapter 1 Introduction Distributed System
chapter 1 Introduction Distributed System
sppunhan
 
Distributed Computing Introduction01.pptx
Distributed Computing Introduction01.pptx
janetvidyaanancys
 
433672084-distributed-vs-parallel-computing-ppt.ppt
433672084-distributed-vs-parallel-computing-ppt.ppt
MattChristianAustria2
 
Presentation of ditributed system
Presentation of ditributed system
google
 
Chapter-1-IntroDistributeddffsfdfsdf-1.pptx
Chapter-1-IntroDistributeddffsfdfsdf-1.pptx
meharikiros2
 
Chapter One.ppt
Chapter One.ppt
abdigeremew
 
istributed system
istributed system
abdillahkarine
 
Introduction distributed system modernss
Introduction distributed system modernss
sppunhan
 
Lect 2 Types of Distributed Systems.pptx
Lect 2 Types of Distributed Systems.pptx
PardonSamson
 
- Introduction - Distributed - System -
- Introduction - Distributed - System -
ssuser7c150a
 
01 - Introduction to Distributed Systems
01 - Introduction to Distributed Systems
Dilum Bandara
 
Lecture_1_Introduction of Distributed System.pptx
Lecture_1_Introduction of Distributed System.pptx
ZubaerIbnaMannan
 
distributed system original.pdf
distributed system original.pdf
KirimanyiJovanntanda
 
dcu1-distributed-computing-lecture-notes.docx
dcu1-distributed-computing-lecture-notes.docx
AmirMohamedNabilSale
 
Distributed OS - An Introduction
Distributed OS - An Introduction
Suhit Kulkarni
 
Chapter 1-Introduction.ppt
Chapter 1-Introduction.ppt
sirajmohammed35
 
Introduction to Distributed System
Introduction to Distributed System
Sunita Sahu
 
Lecture 1 distriubted computing
Lecture 1 distriubted computing
ARTHURDANIEL12
 
chapter 1 Introduction Distributed System
chapter 1 Introduction Distributed System
sppunhan
 
Distributed Computing Introduction01.pptx
Distributed Computing Introduction01.pptx
janetvidyaanancys
 
433672084-distributed-vs-parallel-computing-ppt.ppt
433672084-distributed-vs-parallel-computing-ppt.ppt
MattChristianAustria2
 
Presentation of ditributed system
Presentation of ditributed system
google
 
Chapter-1-IntroDistributeddffsfdfsdf-1.pptx
Chapter-1-IntroDistributeddffsfdfsdf-1.pptx
meharikiros2
 
Introduction distributed system modernss
Introduction distributed system modernss
sppunhan
 
Lect 2 Types of Distributed Systems.pptx
Lect 2 Types of Distributed Systems.pptx
PardonSamson
 
- Introduction - Distributed - System -
- Introduction - Distributed - System -
ssuser7c150a
 
01 - Introduction to Distributed Systems
01 - Introduction to Distributed Systems
Dilum Bandara
 
Lecture_1_Introduction of Distributed System.pptx
Lecture_1_Introduction of Distributed System.pptx
ZubaerIbnaMannan
 
dcu1-distributed-computing-lecture-notes.docx
dcu1-distributed-computing-lecture-notes.docx
AmirMohamedNabilSale
 
Distributed OS - An Introduction
Distributed OS - An Introduction
Suhit Kulkarni
 
Ad

More from National College of Business Administration & Economics ( NCBA&E) (15)

Lecturre 07 - Chapter 05 - Basic Communications Operations
Lecturre 07 - Chapter 05 - Basic Communications Operations
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 05 - Chapter 03 - Examples
Lecture 05 - Chapter 03 - Examples
National College of Business Administration & Economics ( NCBA&E)
 
Lecture # 02 - OOP with Python Language by Muhammad Haroon
Lecture # 02 - OOP with Python Language by Muhammad Haroon
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 01 - Basic Concept About OOP With Python
Lecture 01 - Basic Concept About OOP With Python
National College of Business Administration & Economics ( NCBA&E)
 
Lecture01 Part(B) - Installing Visual Studio Code On All Version Of Windows O...
Lecture01 Part(B) - Installing Visual Studio Code On All Version Of Windows O...
National College of Business Administration & Economics ( NCBA&E)
 
Lecture02 - Fundamental Programming with Python Language
Lecture02 - Fundamental Programming with Python Language
National College of Business Administration & Economics ( NCBA&E)
 
Lecture01 - Fundamental Programming with Python Language
Lecture01 - Fundamental Programming with Python Language
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 04 (Part 01) - Measure of Location
Lecture 04 (Part 01) - Measure of Location
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 03 Part 02 - All Examples of Chapter 02 by Muhammad Haroon
Lecture 03 Part 02 - All Examples of Chapter 02 by Muhammad Haroon
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 03 - Chapter 02 - Part 02 - Probability & Statistics by Muhammad Haroon
Lecture 03 - Chapter 02 - Part 02 - Probability & Statistics by Muhammad Haroon
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 03 - Chapter 02 - Part 01 - Probability & Statistics by Muhammad Haroon
Lecture 03 - Chapter 02 - Part 01 - Probability & Statistics by Muhammad Haroon
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 02 - Chapter 01 - Probability & Statistics by Muhammad Haroon
Lecture 02 - Chapter 01 - Probability & Statistics by Muhammad Haroon
National College of Business Administration & Economics ( NCBA&E)
 
WHO director-general's opening remarks at the media briefing on covid-19 - 23...
WHO director-general's opening remarks at the media briefing on covid-19 - 23...
National College of Business Administration & Economics ( NCBA&E)
 
Lecture 01 - Some basic terminology, History, Application of statistics - Def...
Lecture 01 - Some basic terminology, History, Application of statistics - Def...
National College of Business Administration & Economics ( NCBA&E)
 
Course Outline of Probability & Statistics
Course Outline of Probability & Statistics
National College of Business Administration & Economics ( NCBA&E)
 
Ad

Recently uploaded (20)

Paper 108 | Thoreau’s Influence on Gandhi: The Evolution of Civil Disobedience
Paper 108 | Thoreau’s Influence on Gandhi: The Evolution of Civil Disobedience
Rajdeep Bavaliya
 
Unit- 4 Biostatistics & Research Methodology.pdf
Unit- 4 Biostatistics & Research Methodology.pdf
KRUTIKA CHANNE
 
LDMMIA Spring Ending Guest Grad Student News
LDMMIA Spring Ending Guest Grad Student News
LDM & Mia eStudios
 
Allomorps and word formation.pptx - Google Slides.pdf
Allomorps and word formation.pptx - Google Slides.pdf
Abha Pandey
 
Capitol Doctoral Presentation -June 2025.pptx
Capitol Doctoral Presentation -June 2025.pptx
CapitolTechU
 
Final Sketch Designs for poster production.pptx
Final Sketch Designs for poster production.pptx
bobby205207
 
GEOGRAPHY-Study Material [ Class 10th] .pdf
GEOGRAPHY-Study Material [ Class 10th] .pdf
SHERAZ AHMAD LONE
 
LDMMIA Free Reiki Yoga S9 Grad Level Intuition II
LDMMIA Free Reiki Yoga S9 Grad Level Intuition II
LDM & Mia eStudios
 
MATERI PPT TOPIK 1 LANDASAN FILOSOFIS PENDIDIKAN
MATERI PPT TOPIK 1 LANDASAN FILOSOFIS PENDIDIKAN
aditya23173
 
Battle of Bookworms 2025 - U25 Literature Quiz by Pragya
Battle of Bookworms 2025 - U25 Literature Quiz by Pragya
Pragya - UEM Kolkata Quiz Club
 
Exploring Ocean Floor Features for Middle School
Exploring Ocean Floor Features for Middle School
Marie
 
Sustainable Innovation with Immersive Learning
Sustainable Innovation with Immersive Learning
Leonel Morgado
 
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
razelitouali
 
Chalukyas of Gujrat, Solanki Dynasty NEP.pptx
Chalukyas of Gujrat, Solanki Dynasty NEP.pptx
Dr. Ravi Shankar Arya Mahila P. G. College, Banaras Hindu University, Varanasi, India.
 
Webcrawler_Mule_AIChain_MuleSoft_Meetup_Hyderabad
Webcrawler_Mule_AIChain_MuleSoft_Meetup_Hyderabad
Veera Pallapu
 
MATERI PPT TOPIK 4 LANDASAN FILOSOFIS PENDIDIKAN
MATERI PPT TOPIK 4 LANDASAN FILOSOFIS PENDIDIKAN
aditya23173
 
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
Sourav Kr Podder
 
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
parmarjuli1412
 
How to Manage Multi Language for Invoice in Odoo 18
How to Manage Multi Language for Invoice in Odoo 18
Celine George
 
Black and White Illustrative Group Project Presentation.pdf (1).pdf
Black and White Illustrative Group Project Presentation.pdf (1).pdf
AnnasofiaUrsini
 
Paper 108 | Thoreau’s Influence on Gandhi: The Evolution of Civil Disobedience
Paper 108 | Thoreau’s Influence on Gandhi: The Evolution of Civil Disobedience
Rajdeep Bavaliya
 
Unit- 4 Biostatistics & Research Methodology.pdf
Unit- 4 Biostatistics & Research Methodology.pdf
KRUTIKA CHANNE
 
LDMMIA Spring Ending Guest Grad Student News
LDMMIA Spring Ending Guest Grad Student News
LDM & Mia eStudios
 
Allomorps and word formation.pptx - Google Slides.pdf
Allomorps and word formation.pptx - Google Slides.pdf
Abha Pandey
 
Capitol Doctoral Presentation -June 2025.pptx
Capitol Doctoral Presentation -June 2025.pptx
CapitolTechU
 
Final Sketch Designs for poster production.pptx
Final Sketch Designs for poster production.pptx
bobby205207
 
GEOGRAPHY-Study Material [ Class 10th] .pdf
GEOGRAPHY-Study Material [ Class 10th] .pdf
SHERAZ AHMAD LONE
 
LDMMIA Free Reiki Yoga S9 Grad Level Intuition II
LDMMIA Free Reiki Yoga S9 Grad Level Intuition II
LDM & Mia eStudios
 
MATERI PPT TOPIK 1 LANDASAN FILOSOFIS PENDIDIKAN
MATERI PPT TOPIK 1 LANDASAN FILOSOFIS PENDIDIKAN
aditya23173
 
Battle of Bookworms 2025 - U25 Literature Quiz by Pragya
Battle of Bookworms 2025 - U25 Literature Quiz by Pragya
Pragya - UEM Kolkata Quiz Club
 
Exploring Ocean Floor Features for Middle School
Exploring Ocean Floor Features for Middle School
Marie
 
Sustainable Innovation with Immersive Learning
Sustainable Innovation with Immersive Learning
Leonel Morgado
 
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
Energy Balances Of Oecd Countries 2011 Iea Statistics 1st Edition Oecd
razelitouali
 
Webcrawler_Mule_AIChain_MuleSoft_Meetup_Hyderabad
Webcrawler_Mule_AIChain_MuleSoft_Meetup_Hyderabad
Veera Pallapu
 
MATERI PPT TOPIK 4 LANDASAN FILOSOFIS PENDIDIKAN
MATERI PPT TOPIK 4 LANDASAN FILOSOFIS PENDIDIKAN
aditya23173
 
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
SPENT QUIZ NQL JR FEST 5.0 BY SOURAV.pptx
Sourav Kr Podder
 
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
THERAPEUTIC COMMUNICATION included definition, characteristics, nurse patient...
parmarjuli1412
 
How to Manage Multi Language for Invoice in Odoo 18
How to Manage Multi Language for Invoice in Odoo 18
Celine George
 
Black and White Illustrative Group Project Presentation.pdf (1).pdf
Black and White Illustrative Group Project Presentation.pdf (1).pdf
AnnasofiaUrsini
 

Lecture 01 - Chapter 1 (Part 01): Some basic concept of Operating System (OS), Parallel & Distributed Computing

  • 1. Parallel and Distributed Computing (Lecture # 01) (Part 01) 1 Cell: +92300-7327761 Email: [email protected]
  • 2. Instructor Information Name: Muhammad Haroon (MSCS from BZU) (PhD Scholar in Computer Science from HITEC University) Contact information: [email protected] Domain: Machine Learning, Artificial Intelligence, Deep Learning, Data Science, Image Processing, Computer Vision, Natural Language Processing, Mobile Apps, Websites
  • 3. Course Information Name Parallel and Distributed Computing Lectures 16 Quizzes 10 Assignments 10 Attendance 75% Semester Report + Project +Presentation 01 Note: The plagiarism & cheating cases would be reported to the Disciplinary Committee.
  • 4. Classroom rules Don’t  Ask for leave  Ask for quiz re-take  Ask for assignment re-submit  Ask for mobile call  Ask for break  20 minutes break
  • 5. Overview of Course At the end of the course the students will be able to:  Write portable programs for parallel or distributed architectures using Message-Passing Interface (MPI) library  Analytical modelling and performance of parallel programs.  Analyze complex problems with shared memory programming with openMP. 5 Cell: +92300-7327761 Email: [email protected]
  • 6. DISTRIBUTED SYSTEMS Principles and Paradigms (Lecture # 01) 6 Cell: +92300-7327761 Email: [email protected]
  • 7. What is an Operating System An operating system is: A collection of software components that  Provides useful abstractions and Manages resources to Support application programs, and Provide an interface for users and programs 7 Cell: +92300-7327761 Email: [email protected]
  • 8. Operating System Functions An operating system’s main functions are to:  Schedule processes & multiplex CPU  Provide mechanisms for IPC and synchronization  Manage main memory  Manage other resources  Provide convenient persistent storage (files)  Maintain system integrity, handle failures  Enforce security policies (e.g., access control)  Give users and processes an interface 8 Cell: +92300-7327761 Email: [email protected]
  • 9. Definition of a Distributed System (1) A distributed system is (Tannenbaum):  A collection of independent computers that appears to its users as a single coherent system. A distributed system is (Lamport):  One in which the failure of a computer you didn't even know existed can render your own computer unusable 9 Cell: +92300-7327761 Email: [email protected]
  • 10. Properties of Distributed Systems  Concurrency  Multicore systems  Multiple hosts  No global clock  Theoretical impossibility  Expense of accurate clocks  Independent view  Message delay, failure  Impossible to distinguish slow vs. failed node  Independent failure  Message delivery (loss, corruption)  Nodes (fail-stop) 10 Cell: +92300-7327761 Email: [email protected]
  • 11. Software Concepts An overview of  NOS (Network Operating Systems)  DOS (Distributed Operating Systems)  Middleware System Description Main Goal DOS Tightly-coupled operating system for multi- processors and homogeneous multicomputers Hide and manage hardware resources NOS Loosely-coupled operating system for heterogeneous multicomputers (LAN and WAN) Offer local services to remote clients Middleware Additional layer atop of NOS implementing general-purpose services Provide distribution transparency
  • 12. Definition of a Distributed System (2) Figure 1-1. A distributed system organized as middleware. The middleware layer extends over multiple machines and offers each application the same interface.
  • 13. Transparency in a Distributed System Figure 1-2. Different forms of transparency in a distributed system (ISO, 1995). Other forms: Parallelism – Hide the number of nodes working on a task Size – Hide the number of components in the system Revision – Hide changes in software/hardware versions
  • 14. Challenges  Performance  Concurrency  Failures  Scalability  System updates/growth  Heterogeneity  Openness  Multiplicity of ownership, authority  Security  Quality of service/user experience  Transparency  Debugging
  • 15. Approaches  Virtual clocks  Group communication  Heartbeats/failure detection, group membership  Distributed agreement, snapshots  Leader election  Transaction protocols  Redundancy, replication, caching  Indirection - naming  Distributed mutual exclusion  Middleware, modularization, layering  Decomposition vs. integration  Cryptographic protocols
  • 16. Scalability Problems Figure 1-3. Examples of scalability limitations. Engineering = art of compromise (making tradeoffs) Distributed systems – many theoretical results on lower bounds of tradeoffs that limit practical solutions
  • 17. Scalability Examples Distributed systems are ubiquitous and necessary:  Web search  Financial transactions  Multiplayer games  DNS  Travel reservation systems  Utility infrastructure (e.g., power grid)  Embedded systems (e.g., cars)  Sensor networks Failure to scale is fatal  Instagram – share cellphone pix  Facebook IPO
  • 18. Web Search Google uses thousands of machines to  Provide search results  Run Page-Rank algorithm Issues  Connecting large number of machines  Distributed file system (GFS)  Indexing  Programming model  Scaling up when current system reaches limits
  • 19. Financial Transactions Volume is huge  4 million messages per second  50 million things you can trade Requirements are stringent  Low latency  24/7 operation (around the world)  Failure “is not an option”  Facebook NASDAQ Freeze  Transaction system overwhelmed  Hours to complete transactions in falling market
  • 20. Multiplayer Games Very popular – huge market Characteristics  May have millions of players  Players operate in same “world”  Players interact with world, each other Issues  Number of users  Latency, consistency  Coordination of multiple servers  Architecture???