Stable Storage and File Systems
Photo by Kyriacos Georgiou on
Unsplash
We're always talking about how the disk is slow---but why is it slow? And what does the OS do to hide that latency? AND how does the OS communicate with the disk? It's time to find out. We'll also begin exploring the file system and its design.
Learning Objectives
It's time to explore the world of stable storage. We'll begin with spinning disks, SSDs, and the OS's management of those devices.
Upon completion of this module, you will be able to:
- Describe the methods the OS uses to communicate with I/O devices and compare and contrast them.
- Describe the purpose of stable storage and compare and contrast it to memory.
- Label the parts of a spinning disk and describe their purpose and effect on performance.
- Describe disk head scheduling algorithms.
- Describe the components of the SSD, and how those components affect its functions and endurance.
- Describe the steps to improve SSD endurance designed into the controlling software.
- Consider sources of latency and the methods that the OS uses to hide that latency.
- Apply knowledge of stable storage architecture and OS policies to determine behavior of hypothetical workloads.
- Describe the file system and its goals.
- Describe the basic layout of a file system.
- Identify and categorize file system data into metadata and data.
Learning
Videos coming soon!
- Video: Stable Storage and File Systems (5 minutes)
- Video: External Devices (6 minutes)
- Video: Disk (7 minutes)
- Video: Disks and the Storage Hierarchy (5 minutes)
- Video: Disk Operations and Performance (7 minutes)
- Video: Communicating with I/O Devices (11 minutes)
- Video: Disk Head Scheduling (14 minutes)
- Video: File System Design (11 minutes)
- Slides that were presented in the videos.
Recommended Readings
Completing the readings in this class is highly recommended---it can be very helpful to see how the concepts are explained by a different person, and the extra details can help the pieces fit together.
OSTEP: I/O Devices and Hard Disk Drives
Fun Insights
- Polling through the Eyes of a Mob Boss
- Interrupts and DMA from a Mob Boss
- 330TB Tiny Tapes
- Animation of a disk access
- Curious George episode related to disk head scheduling
- A picture of a pre-disk file system
From Class
Evaluating Your Understanding
We are providing these rubrics for each module so that you can better understand what is expected and evaluate your understanding against those expectations. The hope is that, if you find yourself earning a 3 or below, you will continue to enhance your understanding until you find yourself earning a 4 or a 5.
| Standards for Stable Storage Sub-Competency | 5 | 4 | 3 | 2 |
|---|---|---|---|---|
| I/O Interfaces | Student accurately describes the methods the OS uses to communicate with I/O devices and accurately assesses the advantages and disadvantages of each; student accurately selects and justifies the best communication method for a hypothetical scenario. | Student accurately describes the methods the OS uses to communicate with I/O devices and satisfactorily assesses the advantages and disadvantages of each; student satisfactorily selects and justifies the best communication method for a hypothetical scenario. | Student satisfactorily describes the methods the OS uses to communicate with I/O devices but unsatisfactorily assesses the advantages and disadvantages of each; student unsatisfactorily selects and justifies the best communication method for a hypothetical scenario. | Student unsatisfactorily describes the methods the OS uses to communicate with I/O devices and unsatisfactorily assesses the advantages and disadvantages of each; student unsatisfactorily selects and justifies the best communication method for a hypothetical scenario. |
| Stable Storage Mechanics | Student accurately describes the purpose of stable storage, accurately compares and contrasts it to memory, accurately labels and describes the purpose of parts of a spinning disk, accurately analyzes the performance of a spinning disk, accurately describes the components of the SSD, accurately describes how the components of the SSD affect its function and performance, accurately describes steps taken to improve SSD endurance, accurately assesses how a stable storage device behaves in a hypothetical system with a hypothetical workload, and accurately selects and justifies the best stable storage solution in hypothetical workloads. | Student accurately describes the purpose of stable storage, accurately compares and contrasts it to memory, accurately labels and describes the purpose of parts of a spinning disk, satisfactorily analyzes the performance of a spinning disk, accurately describes the components of the SSD, satisfactorily describes how the components of the SSD affect its function and performance, satisfactorily describes steps taken to improve SSD endurance, satisfactorily assesses how a stable storage device behaves in a hypothetical system with a hypothetical workload, and satisfactorily selects and justifies the best stable storage solution in hypothetical workloads. | Student satisfactorily describes the purpose of stable storage, satisfactorily compares and contrasts it to memory, satisfactorily labels and describes the purpose of parts of a spinning disk, unsatisfactorily analyzes the performance of a spinning disk, satisfactorily describes the components of the SSD, unsatisfactorily describes how the components of the SSD affect its function and performance, unsatisfactorily describes steps taken to improve SSD endurance, unsatisfactorily assesses how a stable storage device behaves in a hypothetical system with a hypothetical workload, and unsatisfactorily selects and justifies the best stable storage solution in hypothetical workloads. | Student unsatisfactorily describes the purpose of stable storage, unsatisfactorily compares and contrasts it to memory, unsatisfactorily labels and describes the purpose of parts of a spinning disk, unsatisfactorily analyzes the performance of a spinning disk, unsatisfactorily describes the components of the SSD, unsatisfactorily describes how the components of the SSD affect its function and performance, unsatisfactorily describes steps taken to improve SSD endurance, unsatisfactorily assesses how a stable storage device behaves in a hypothetical system with a hypothetical workload, and unsatisfactorily selects and justifies the best stable storage solution in hypothetical workloads. |
| OS Interaction with Stable Storage | Student accurately describes OS methods to hide latency during interactions with stable storage, accurately describes disk head scheduling algorithms and accurately analyzes their performance, and accurately applies the knowledge of disk and algorithm behavior to workloads. | Student accurately describes OS methods to hide latency during interactions with stable storage, accurately describes disk head scheduling algorithms and satisfactorily analyzes their performance, and satisfactorily applies the knowledge of disk and algorithm behavior to workloads. | Student satisfactorily describes OS methods to hide latency during interactions with stable storage, satisfactorily describes disk head scheduling algorithms but unsatisfactorily analyzes their performance, and unsatisfactorily applies the knowledge of disk and algorithm behavior to workloads. | Student unsatisfactorily describes OS methods to hide latency during interactions with stable storage, unsatisfactorily describes disk head scheduling algorithms and unsatisfactorily analyzes their performance, and unsatisfactorily applies the knowledge of disk and algorithm behavior to workloads. |
| File System Design | Student accurately describes the file system purpose and goals, accurately identifies and categorizes file system data into data and metadata, accurately describes how and why file systems maintain information about disk free space. | Student accurately describes the file system purpose and goals, accurately identifies and categorizes file system data into data and metadata, accurately describes how and why file systems maintain information about disk free space. | Student satisfactorily describes the file system purpose and goals, satisfactorily identifies and categorizes file system data into data and metadata, satisfactorily describes how and why file systems maintain information about disk free space. | Student unsatisfactorily describes the file system purpose and goals, unsatisfactorily identifies and categorizes file system data into data and metadata, unsatisfactorily describes how and why file systems maintain information about disk free space. |
| Short Answer Questions: Stable Storage-Specific | Student submitted answers to given questions that accurately and succinctly answer the questions. | Student submitted answers to given questions that satisfactorily and succinctly answer the questions. | Student submitted answers to given questions that unsatisfactorily answer the questions. | Student does not submit the answers OR submitted answers to given questions that incorrectly answer the questions. |
| Short Answer Questions: Stable Storage as part of the larger system | Student submitted answers to given questions that accurately and succinctly answer the questions. | Student submitted answers to given questions that satisfactorily and succinctly answer the questions. | Student submitted answers to given questions that unsatisfactorily answer the questions. | Student does not submit the answers OR submitted answers to given questions that incorrectly answer the questions. |
| Short Answer Questions: File System-Specific | Student submitted answers to given questions that accurately and succinctly answer the questions. | Student submitted answers to given questions that satisfactorily and succinctly answer the questions. | Student submitted answers to given questions that unsatisfactorily answer the questions. | Student does not submit the answers OR submitted answers to given questions that incorrectly answer the questions. |