PDSSP Crawler Documentation

Warning

PDSSP Crawler is under development, in a design and prototyping phase. This documentation is not complete. Updates:

• Mar 30, 2023: In parallel, a pds_crawler package is being developed to address the extraction of a large volume and complete set of PDS metadata. A pdssp-labtools repository is also being used to prototype a STAC catalog builder for PDSSP labs, publishing their data. Both should eventually be used and/or refactored into the pdssp-crawler package.

• Release Notes

Developer Guides

• Design
• Documentation

References

• Crawler Python API
• Crawler CLI

• PDSSP Platform Documentation