Filesystem directories

This page describes the filesystem directories available in the Notebook Aspect.

Directory	Private	Persistent	Writeable
$HOME	✅	✅	✅
/datasets		✅
/project		✅	✅
/scratch			✅

$HOME

Your home directory is just that.

The $HOME directory is also the base directory for the JupyterLab file browser. Notebooks and other files need to be inside the $HOME directory (or a subdirectory) for you to open them from the file browser.

Inside the $HOME directory is a ~/notebooks directory that you can use to organize your personal notebooks. This directory also contains the ~/notebooks/.user_setups file that you can use to configure the environment your notebooks run in.

Currently there is a 100 GB quota for $HOME. There is also a limit of 102400 files and subdirectories (inodes) within $HOME. You can use /project for larger datasets.

Note

If you also have an account on lsst-dev, you can access your Notebook Aspect home directory via $HOME/jhome/ from lsst-dev.

/datasets

This is a read-only directory containing curated Butler data repositories. Each dataset has a README file describing its contents and intended applications. See Common Dataset Organization and Policy in the DM Developer Guide for more information about these datasets.

/project

This directory is for shared, uncurated, persistent data. There is no disaster recovery, nor is there an enforced quota or purge policy.

/scratch

This directory is for completely transient data. There is no disaster recovery or quota, but there is a purge cycle.