Notebooks

• Estimate Pixel Threshold
  • Create a sample parquet file
  • Inspect parquet file and metadata
  • Want to see more?
• Pipeline Stages
  • Setup: Create Toy Dataset
  • Helper Function
  • Stage 1: Mapping
  • Stage 2: Binning (Alignment Generation)
  • Stage 3: Splitting
  • Stage 4: Reducing
  • Stage 5: Finishing
  • Exploring the Final Catalog
  • Loading with LSDB
  • Summary
    • Key Concepts:
• Creating empty schema parquet
  • File1
  • File2
    • Error Demonstration
    • Making a new parquet schema file
      • Using pandas type strings
      • Explict list of pyarrow data types
• Backport Collection
  • 1. Existing directory in the expected format.
  • 2. Inserting collection in place of catalog
  • 3. Check your collection