Database Seminar - Joyo Li

— 5:30pm

Location:
Virtual Presentation - ET - Remote Access - Zoom

Speaker:
JOYO VICTOR , Chief Architect
SingleStore

https://www.linkedin.com/in/joyo-victor-683432173/

Storage Metadata for Modern Cloud Databases

In modern database architecture, separating compute from storage unlocks powerful capabilities. Our tiered storage, “bottomless”, started by uploading files to remote object storage. This worked well until we wanted to create database branches pointing to the same remote storage. One branch does not know if it can delete a file that another branch depends on.

To solve this, we built Bottle Service, a metadata service that tracks file references across branches, essentially a distributed ref-counting system. But then we realized this service could be leveraged for more than garbage collection. It became the foundation for advanced features like cross-region branching, disaster recovery, change data capture (CDC) out, and Apache Iceberg egress.


This talk will walk through the problem, the design of Bottle Service, and how it empowers SingleStore to build modern cloud-native functionality.

Joyo Li is the Chief Architect at SingleStore, and has been with the company for over 11 years. Joyo worked extensively on Separation of Storage and Compute. 

This talk is part of the Future Data Systems Seminar Series.

Zoom Participation. See announcement.

For More Information:
db-www@cs.cmu.edu


Add event to Google
Add event to iCal