Harder Drive: Storing Data on the Internet

TLDRThis video explores the concept of storing data on the internet using the example of creating a virtual hard drive. The process involves sending pings to hosts all over the world and using the response data to store information. The video also touches on the challenges and limitations of this approach.

Key insights

🌐Storing data on the internet can be achieved by leveraging the ping response data from hosts around the world.

💻A virtual hard drive can be created using the No Big Deal (NBD) kit library to simulate block devices in user space.

📈Benchmarking the virtual hard drive reveals performance and reliability issues due to network throttling and lost ping responses.

🌍Geographic diversity of hosts is crucial to prevent correlated failures and ensure reliable data storage.

⚙️Implementation includes address search, data storage using pings, and creating a user interface for monitoring and control.

Q&A

What is a virtual hard drive?

A virtual hard drive is a simulated storage device that can be created using software. It allows users to store and retrieve data as if it were a physical hard drive.

How does storing data on the internet work?

Storing data on the internet involves using the response data from pings sent to hosts around the world. This data is used to store information in a virtual hard drive.

What are the challenges of storing data on the internet?

Challenges include network throttling, lost ping responses, and the need for geographically diverse and reliable hosts.

How can the performance of a virtual hard drive be measured?

The performance of a virtual hard drive can be measured through benchmarks that test data read and write speeds, as well as reliability and response times.

What are the benefits of storing data on the internet?

Storing data on the internet provides scalable and distributed storage options, allowing for easy access and retrieval of information from anywhere in the world.

Timestamped Summary

00:00Introduction to the concept of storing data on the internet using a virtual hard drive.

02:30Explanation of the process of sending pings to hosts around the world and using the response data for storage.

05:45Discussion of the challenges and limitations of storing data on the internet, including network throttling and lost ping responses.

08:15Explanation of the importance of geographically diverse hosts to ensure reliable data storage.

10:00Overview of the implementation steps, including address search and the creation of a user interface.