Skip navigation and jump directly to page content

 IU Trident Indiana University

One Degree Imager - Pipeline Portal and Archive (ODI-PPA)

Project Leads: Arvind Gopu, UITS Research Technologies

Research Storage, High Performance File Systems, High Performance Computing, Scientific Application and Performance Tuning, UITS Research Technologies

Research made possible by: Big Red II, Karst, Scholarly Data Archive, Data Capacitor

Screenshot showing Search and Image Explorer in ODI-PPA
Figure 1. Screenshot showing Search and Image Explorer in ODI-PPA

ODI-PPA has been operational at a fully production level since March 2012, with various functionality added over time since then. It has served as a web based Scalable Compute Archive system that provides astronomers a modern web interface that acts as a single point of access to their data, and rich computational and visualization capabilities. 

ODI-PPA has supported scientists in handling complex data sets, and enhanced WIYN Observatory's scientific productivity beyond data acquisition on its 3.5m telescope. It has also served as a template for refactored design, development, and deployment of similar projects like the IU Electron Microscopy Center - SCA and others. 

ODI-PPA is designed, with periodic user feedback, to be a compute archive that has built-in frameworks including: (1) Collections that allow an astronomer to create logical collations of data products intended for publication, further research, instructional purposes, or to execute data processing tasks (2) Image Explorer and Source Explorer, which together enable real-time interactive visual analysis of massive astronomical data products within an HTML5 capable web browser, and overlaid standard catalog and Source Extractor-generated source markers (3) Workflow framework which enables rapid integration of data processing pipelines on an associated compute cluster and users to request such pipelines to be executed on their data via custom user interfaces. ODI-PPA is made up of several light-weight services connected by a message bus; the web portal built using Twitter/Bootstrap, AngularJS and jQuery JavaScript libraries, and backend services written in PHP (using the Zend framework) and Python; it leverages supercomputing and storage resources at Indiana University. ODI-PPA is designed to be reconfigurable for use in other science domains with large and complex datasets, including an ongoing offshoot project for electron microscopy data.

The Scientific Applications and Performance Tuning (SciAPT) group delivers and supports software tools that promote effective and efficient use of IU’s advanced cyberinfrastructure – which in turn improves research and enables discoveries.

The Research Storage team of Research Technologies is responsible for the administration and support of the Research File System and the Scholarly Data Archive, which provide interactive and archival storage, respectively, for Indiana University faculty, staff, and research students.

The High Performance File System group provides high-speed, disk-based storage of data for IU researchers and operates the Data Capacitor II and the Data Capacitor Wide Area Network (DC-WAN).

The High Performance Systems (HPS) group implements, operates, and supports some of the fastest supercomputers in the world – IU’s Big Red II, the Quarry cluster, and the large memory Mason system – in order to advance Indiana University's mission in research, training, and engagement in the state.

NSF GSS Codes:

Primary Field: Astronomy (201) - Planetary Astronomy and Science

Secondary Field: Computer Science (401) - Information Science/Studies