Filesystem directories

This page describes the filesystem directories available in the Notebook Aspect.

Directory	Private	Persistent	Writeable
$HOME	✅	✅	✅
~/notebooks	✅	✅	✅
/datasets		✅
/project		✅	✅
/scratch			✅

$HOME

Your home directory is just that. It’s backed by essentially the same storage as your home directory on lsst-dev in the LSST Data Facility. In fact, your $HOME directory in the Notebook Aspect is the $HOME/jhome/ directory on lsst-dev.

Currently there is a 100 GB quota for $HOME. There is also a limit of 102400 files and subdirectories (inodes) within $HOME. You can use /project for larger datasets.

~/notebooks

The ~/notebooks directory inside your $HOME directory is the base directory for the JupyterLab file browser. Notebooks and other files need to be inside the ~/notebooks directory for you to open them from the file browser.

The ~/notebooks directory is created for you.

/datasets

This is a read-only directory containing curated Butler data repositories. Each dataset has a README file describing its contents and intended applications. See Common Dataset Organization and Policy in the DM Developer Guide for more information about these datasets.

/project

This directory is for shared, uncurated, persistent data. There is no disaster recovery, nor is there an enforced quota or purge policy.

/scratch

This directory is for completely transient data. There is no disaster recovery or quota, but there is a purge cycle.