HATS catalogs on Hugging Face

HATS catalogs on Hugging Face#

A curated set of LSDB/HATS catalogs is published as a Hugging Face collection:

This is part of our collaboration with Multimodal Universe project. For more details about Multimodal Universe, see the project page.

Requirements#

To load catalogs from Hugging Face via the hf:// URI scheme, install huggingface_hub:

pip install huggingface_hub

For more installation options, see the huggingface_hub documentation.

Example: load the GAIA dataset#

The Multimodal Universe GAIA dataset is available at:

You can open it with LSDB using:

import lsdb

cat = lsdb.open_catalog("hf://datasets/UniverseTBD/mmu_gaia_gaia@main/mmu_gaia_gaia")