The HDF Group's Call the Doctor

Exploring and comparing performance between original and cloud-optimized HDF5 files

January 16, 2024 The HDF Group
The HDF Group's Call the Doctor
Exploring and comparing performance between original and cloud-optimized HDF5 files
Show Notes

In this episode of "Call the Doctor," Aleksandar Jelenak delves into recent work on analyzing Earth science HDF5 files, comparing their original versions with cloud-optimized versions. Using data from the Global Ecosystem Dynamics Investigation Instrument (GEDI) on the International Space Station, he showcases the instrument's laser beams mapping Earth's vegetation. Aleksandar discusses the challenges of optimizing HDF5 files for cloud usage, emphasizing the need for user-friendly data for scientists worldwide. He presents a detailed analysis of chunk data sets, storage settings, and statistics, highlighting the potential benefits of cloud-optimized files. The episode concludes with performance comparisons between original and cloud-optimized files, shedding light on the advantages of efficient data storage and access.

This session was recorded on January 16, 2024. You can also watch it online.

Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over the previous week’s HDF Forum posts. The HDF Clinics are free sessions intended to help users tackle real-world HDF problems from a common cold to severe headaches and offer relief where that’s possible. As time permits, we will include how-tos, offer advice on tool usage, review your code samples, teach you survival in the documentation jungle, and discuss what’s new or just around the corner in the land of HDF.

Join us every Tuesday at 12:20 p.m. central (US/Canada.) on Zoom!