Public Data Access Overview / Discussion Forum

Hello!

I was wondering if there is a way to download a specific file of the trees directory. The comand suggested for downloading the Sublink tree files in te example scripts is:

wget -nd -nc -nv -e robots=off -l 1 -r -A hdf5 --content-disposition --header="API-Key: KEY_HERE" "http://www.illustris-project.org/api/Illustris-3/files/sublink/?format=api"

For some reason, one of the tree files that i have downloaded, tree_extended.36.hdf5, is "truncated" ( IOError: Unable to open file (Truncated file: eof = 2048556, sblock->base_addr = 0, stored_eoa = 131671404). I started downloading again the full set of files again, because is the Ilustris-3 simulation. If this happens with the Illustris-1 could be more problematic. Is there a comand to download only the tree_extended.36.hdf5 file? changing the link : "http://www.illustris-project.org/api/Illustris-3/files/sublink/tree_extended.36.hdf5?format=api" doesn't work for me.

Many thanks in advance!

Hey,

If you just click on the first link in your post, it shows you a page with individual links to each file. You could just click on one and download it, in your browser.

Or, you could do a wget like

wget --content-disposition --header="API-Key: KEY_HERE" http://www.illustris-project.org/api/Illustris-3/files/sublink.36.hdf5

Sorry for my late answer! But thanks! I didn't realize about the link! :/ .

Hi Dylan, Ignacio,

I have a related question: I'm trying to download individual snapshot files with:

wget --content-disposition --header="API-Key: f19b52bd8297b0cbb986b89efe99a378" "http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5"

As suggested on the page listing all individual files, but instead of initiating the download I'm stuck waiting for response:

Karen% wget --content-disposition --header="API-Key: f19b52bd8297b0cbb986b89efe99a378" "http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5"                                
--2016-07-29 10:27:02--  http://www.illustris-project.org/api/Illustris-3/files/snapshot-45.29.hdf5
Resolving www.illustris-project.org (www.illustris-project.org)... 23.239.9.40
Connecting to www.illustris-project.org (www.illustris-project.org)|23.239.9.40|:80... connected.
HTTP request sent, awaiting response... 302 FOUND
Location: http://data.illustris-project.org/app/file/snapshot/L75n455FP/45/29/?token=5cd8962924f8a75ffe2e [following]
--2016-07-29 10:27:02--  http://data.illustris-project.org/app/file/snapshot/L75n455FP/45/29/?token=5cd8962924f8a75ffe2e
Resolving data.illustris-project.org (data.illustris-project.org)... 140.247.151.71
Connecting to data.illustris-project.org (data.illustris-project.org)|140.247.151.71|:80... connected.
HTTP request sent, awaiting response...

Am I doing something wrong or is there a connection problem at the moment?

Thanks, Karen

Hi Karen,

Just a temporary hiccup on the server, should be working again now.

Please limit scripts to downloading 1 at a time (don't run 10 in parallel), it's going to cause more trouble than benefit.

Thanks - it's downloading now!