Software Architecture
SciDAS: Scientific Data Analysis at Scale
Description
Scientific Data Analysis at Scale (SciDAS; http://scidas.org/) researchers are developing a more fluid and flexible cyberinfrastructure for working with and analyzing large-scale data. It will combine both new and existing software to construct a system that will be efficient, practical, and user-friendly. The SciDAS system helps researchers discover data, move it smoothly across advanced networks, and improve flexibility and accessibility to national and international scientific resources. Domain scientists will be heavily involved in building the SciDAS system, providing real data sets and use cases that will help to refine the system.
RENCI's Role
RENCI leads the effort to integrate existing cyber tools and technologies into the new SciDAS infrastructure that will be designed to support all aspects of distributed, data-driven research. Development of the SciDAS framework will involve integrating a number of NSF-funded CI systems—many of them developed at RENCI—into one package. This work applies RENCI’s HeLx framework and iRODS with customizations for cloud native GPU workflows with Nextflow.