API Documentation

Modules

obiwan.fetch Download and unpack tarballs
obiwan.mk_fits_image
obiwan.db_tools Query our PostgreSQL Databases at NERSC
obiwan._version
obiwan.draw_radec_color_z Draw random location and galaxy properties from Gaussian Mixtures
obiwan.kenobi The Monte Carlo code that adds fake galaxiesto images from the Legacy Survey
obiwan.common Commonly used functions
obiwan.runs Grabs, configures, and otherwise sets up a production run on eBOSS DR3 data or DR5 data
obiwan.time_per_brick

Post-Processing

obiwan.runmanager.merge_tables Reads 1000s per brick tables and merges them
obiwan.runmanager.derived_tables Post-processes the obiwan/, tractor/, data products.
obiwan.runmanager.qdo_tasks Given a ra,dec bounding box of region to inject simulated sources, and the number density of simulated sources, these functions write the ‘qdo’ task list of each brick to process, repeated for how iterations will be needed per brick
obiwan.runmanager.update_imagefn_if_doesnt_exist Images used in DR3 are now in different location on project/staging.
obiwan.runmanager.status Monitors an obiwan production run using qdo

Analysis & Plotting

obiwan.qa.plots_common commonly used code for plotting and analysis
obiwan.qa.tally
obiwan.qa.number_finished_by_slurm Given a qdo slurm log file, this computes the fraction of launched bricks that resulted in a tractor table to the total number of launched bricksself.
obiwan.qa.unique_ccds_dr3 Searches a DataRelase like directory for all legacysurvey*ccd.fits files, creates a no-duplicate set of all CCDs included in that DR, and writes the list to disk.
obiwan.qa.cpu_hours Uses ‘SLURM sacct’ to compute the number of CPU and MPP hours
obiwan.qa.visual Helper functions for plotting fits and numpy 2D arrays as images
obiwan.qa.aaron_healpix Work with healpix data
obiwan.qa.plots_footprint Draw box around region of intertest, show where injected sources, color code sources by those with obiwa tractor catalogues
obiwan.qa.plots_randomsprops_fluxdiff The main analysis script, created the majority of my thesis plots Ch 4-5

Scaling Tests

obiwan.scaling.select_bricks Choose N (10 in my thesis) random bricks with grz CCDs that have completed processing with obiwan.
obiwan.scaling.timing Script to make the obiwan scaling plots in my thesis

Tests

System Message: WARNING/2 (/srv/repos_for_docker/obiwan/doc/api.rst, line 61)

failed to import tests.test_200x200_pixel_regions

System Message: WARNING/2 (/srv/repos_for_docker/obiwan/doc/api.rst, line 61)

toctree references unknown document ‘_autosummary/tests.test_200x200_pixel_regions’
tests.run_200x200_pixel_regions Similar to legacypipe/py/test/runbrick_test.py, this runs and analyzes the output of legacypipe running on 200x200 pixels regions that obiwan has injected simulated sources intoself.
tests.__init__ Initialize self.
tests.test_200x200_pixel_regions

Deep Learning

obiwan.dplearn.cnn Trains a CNN on fake and real galaxy images using TensorFlow.
obiwan.dplearn.create_training saves 64x64 pixel cutouts of each source in a Data Release as HDF5 files
obiwan.dplearn.split_testtrain