File System Efficiency
Photo by
Arthur Tseng
from
Unsplash
So we've learned how to store bits on the disk, but how can we make sure we know which bits are where? And that our user does, too?
Learning Objectives
It's time to make make file systems efficient!
Upon completion of this module, you will be able to:
- Assess the advantages and disadvantages of file layouts.
- Describe what metadata a file system may maintain about a file.
- Name the file metadata structure for both generic and sample file systems.
- Explain where the file metadata structures are stored.
- Consider how file system design and file layout interacts with disk structure, particularly in light of mechanical sympathy.
- Describe FFS structure and design.
- Describe NTFS structure and design.
- Describe SSDs and analyze their performance.
Learning
- Video: File System Efficiency (3 minutes)
- Video: File Layouts (14 minutes)
- Video: More File Layouts (7 minutes)
- Video: Multilevel Indexed Files and FFS (8 minutes)
- Video: Mechanical Sympathy (10 minutes)
- Video: NTFS (8 minutes)
- Video: SSDs (15 minutes)
- Slides that were presented in the videos.
Note that these videos have embedded formative assessments ---you'll want to watch the videos and complete those before class, so that you can earn participation credit.
Recommended Readings
Completing the readings in this class is highly recommended---it can be very helpful to see how the concepts are explained by a different person, and the extra details can help the pieces fit together.
OSTEP: File System Implementation, Locality and The Fast File System, and SSDs
Fun Insights
- Julia Evans's (@b0rk) comics:
- Alison likes to say that NTFS is "flexible-like Gumby". Who is Gumby? Gumby is a cultural reference that is way too old for any of you. Still, it can be useful imagery to help you remember that NTFS is not as rigid as FFS and its derivatives. Here is a Gumby episode where Gumby demonstrates his flexibility
- Gumby: Mirrorland (Season 1, Episode 2)
- If you want to start from the beginning, Season 1, Episode 1 is here:
- Gumby: Moon Trip (Season 1, Episode 1)
From Class
Evaluating Your Understanding
We are providing these rubrics for each module so that you can better understand what is expected and evaluate your understanding against those expectations. The hope is that, if you find yourself earning a 3 or below, you will continue to enhance your understanding until you find yourself earning a 4 or a 5.
| Standards for File Systems Sub-Competency | 5 | 4 | 3 | 2 |
|---|---|---|---|---|
| File Systems | Student accurately assesses the advantages and disadvantages of file layouts and file system design accurately considers how file system design interacts with disk structure, and accurately designs a file system based on the requirements and characteristics of a system. | Student satisfactorily assesses the advantages and disadvantages of file layouts and file system design satisfactorily considers how file system design interacts with disk structure, and satisfactorily designs a file system based on the requirements and characteristics of a system. | Student unsatisfactorily assesses the advantages and disadvantages of file layouts and file system design, unsatisfactorily considers how file system design interacts with disk structure, and unsatisfactorily designs a file system based on the requirements and characteristics of a system. | Student unsatisfactorily assesses the advantages and disadvantages of file layouts and file system design unsatisfactorily considers how file system design interacts with disk structure, and unsatisfactorily designs a file system based on the requirements and characteristics of a system. |
| File Systems Project | Student submitted project that 1) when executed, passes all test cases, including accurately transferring data from main memory to disk and extending the file system to allow for file growth, a hierarchical directory structure, and concurrent access, 2) when visually inspected, does not reveal any race conditions or concurrency errors, 3) includes a design document that accurately describes the code and answers the given questions, and 4) follows all given formatting guidelines. | Student submitted project that 1) when executed, passes most test cases, including satisfactorily transferring data from main memory to disk and extending the file system to allow for file growth, a hierarchical directory structure, and concurrent access, 2) when visually inspected, does reveal one or no race conditions or concurrency errors, 3) includes a design document that satisfactorily describes the code and answers the given questions, and 4) follows most given formatting guidelines. | Student submitted project that 1) when executed, passes some test cases, including unsatisfactorily transferring data from main memory to disk and extending the file system to allow for file growth, a hierarchical directory structure, and concurrent access, 2) when visually inspected, does reveal a few race conditions or concurrency errors, 3) includes a design document that unsatisfactorily describes the code and answers the given questions, and 4) follows few given formatting guidelines. | Student fails to submit the project or submitted project that 1) when executed, passes no or few test cases, including incorrectly transferring data from main memory to disk and extending the file system to allow for file growth, a hierarchical directory structure, and concurrent access, 2) when visually inspected, does reveal many race conditions or concurrency errors, 3) includes a design document that incorrectly describes the code and answers the given questions, and 4) follows few given formatting guidelines. |
| Short Answer Questions: File System-Specific | Student submitted answers to given questions that accurately and succinctly answer the questions. | Student submitted answers to given questions that satisfactorily and succinctly answer the questions. | Student submitted answers to given questions that unsatisfactorily answer the questions. | Student does not submit the answers OR submitted answers to given questions that incorrectly answer the questions. |
| Short Answer Questions: File systems as part of the larger system | Student submitted answers to given questions that accurately and succinctly answer the questions. | Student submitted answers to given questions that satisfactorily and succinctly answer the questions. | Student submitted answers to given questions that unsatisfactorily answer the questions. | Student does not submit the answers OR submitted answers to given questions that incorrectly answer the questions. |