JupyterLab: accessing supplementary catalogs (postprocessing)

Alice Chen
  • 25 Mar

Sorry in advance if this has already been asked/listed somewhere, but I have been unable to find this information. Is there a way to access the individual .hdf5 files in the interactive Jupyter Lab notebook (https://www.tng-project.org/data/lab/), for example if we want the stellar assembly history or galaxy morphology data only (not from the fof or snapshot files)? If there is, what's the path name? I have tried looking in the folders in '../sims.TNG/TNG100-1/output/' and '/sims.TNG/TNG100-1/postprocessing/', as well as '/sims.other' (which was empty), and none of them had the .hdf5 files.
Thank you in advance for any help

Dylan Nelson
  • 26 Mar

Hi Alice,

All of the "supplementary catalogs" would be found in the postprocessing/ subdirectory under a given simulation.

However, not all are available in the Lab. I have just tried to make some of the most common (and biggest) available.

If there is something in particular you need, I can try to think about adding it. The alternative is simply to download it, into the Lab, with e.g. a wget command.

Alice Chen
  • 26 Mar

Hi Dr. Nelson, thank you so much for your reply. I am trying to look at the stellar assembly histories for the simulations, which doesn't seem to be in the postprocessing/ subdirectory (unless it's under a different name?), and I am worried about Jupyter Lab crashing if I use the "wget" command since the files are ~17GB in size in total (why I didn't want to download and process them locally). Is there a way around this?
Thank you again for your help

Dylan Nelson
  • 27 Mar

I have now added the postprocessing/released sub-directory to all simulations in the Lab. Inside you will find the Stellar Assembly catalog, among others.

Alice Chen
  • 27 Mar

Thank you so much Dr. Nelson! That'll be really helpful for studying galaxy-halo evolutions

  • Page 1 of 1