In this episode of "Call the Doctor," Scot Breitenfeld of The HDF Group hosted an open help session for your HPC HDF5 questions. (Questions are welcome at any session, but we knew we had some community members with specific needs for this session.)
A research engineer working on open-source thermohydraulics code discusses issues with writing results in the CGNS (CFD General Notation System) format. The engineer explores different approaches, including writing the CGNS skeleton on the master processor and distributing data writing on multiple nodes. However, there are concerns about the slowdown when increasing time steps, possibly due to opening and closing the HDF file at each time step. The discussion also touches on options like sub-filing and using the core file driver to eliminate the file system component. Additionally, there's a brief inquiry about compressing large strings in HDF5. See this forum post for details. Overall, the episode addresses technical challenges in parallel file writing and optimization strategies.
This session happened on January 23, 2024. You can also watch this episode online.
Call the Doctor is a series of weekly, unscripted, live events! The HDF Group’s staff members will answer attendee questions and, for example, go over the previous week’s HDF Forum posts. The HDF Clinics are free sessions intended to help users tackle real-world HDF problems from a common cold to severe headaches and offer relief where that’s possible. As time permits, we will include how-tos, offer advice on tool usage, review your code samples, teach you survival in the documentation jungle, and discuss what’s new or just around the corner in the land of HDF.
Join us every Tuesday at 12:20 p.m. central (US/Canada.) on Zoom!