ARTÍCULO
TITULO

Analysis and Visualization of Coastal Ocean Model Data in the Cloud

Richard P. Signell and Dharhas Pothina    

Resumen

The traditional flow of coastal ocean model data is from High-Performance Computing (HPC) centers to the local desktop, or to a file server where just the needed data can be extracted via services such as OPeNDAP. Analysis and visualization are then conducted using local hardware and software. This requires moving large amounts of data across the internet as well as acquiring and maintaining local hardware, software, and support personnel. Further, as data sets increase in size, the traditional workflow may not be scalable. Alternatively, recent advances make it possible to move data from HPC to the Cloud and perform interactive, scalable, data-proximate analysis and visualization, with simply a web browser user interface. We use the framework advanced by the NSF-funded Pangeo project, a free, open-source Python system which provides multi-user login via JupyterHub and parallel analysis via Dask, both running in Docker containers orchestrated by Kubernetes. Data are stored in the Zarr format, a Cloud-friendly n-dimensional array format that allows performant extraction of data by anyone without relying on data services like OPeNDAP. Interactive visual exploration of data on complex, large model grids is made possible by new tools in the Python PyViz ecosystem, which can render maps at screen resolution, dynamically updating on pan and zoom operations. Two examples are given: (1) Calculating the maximum water level at each grid cell from a 53-GB, 720-time-step, 9-million-node triangular mesh ADCIRC simulation of Hurricane Ike; (2) Creating a dashboard for visualizing data from a curvilinear orthogonal COAWST/ROMS forecast model.

 Artículos similares

       
 
Jialong Peng, Shaoqiang Wang, Lin Mu and Si Wang    
With the increasing global reliance on maritime oil transportation, oil spills pose significant environmental hazards to coastal ecosystems. This study presents a comprehensive quantitative framework for assessing oil spill risks along the Jiaozhou Bay c... ver más
Revista: Water

 
Andrei Zaharia, Valentin Nedeff, Juan A. López-Ramírez, Emilian Mo?negu?u, Narcis Bârsan, Mirela Lehadus-Panaite, Jamroziak Krzysztof and Claudia Tomozei    
In recent years, more and more emphasis has been placed on the use of home filtration systems as a coarse pre-filtration step. The PP (polypropylene) filter cartridge is one of the most common of these systems, with the role of retaining solid suspension... ver más
Revista: Water

 
Moxian Chu, Bilin Liu, Liguo Ou, Ziyue Chen and Qingying Li    
Statoliths are important hard tissues in cephalopods. Significant differences are found in the external morphology of statoliths in different groups or species. In this study, stepwise discriminant analysis was used to investigate the external morphologi... ver más

 
Romain Amyot, Noriyuki Kodera and Holger Flechsig    
Simulation of atomic force microscopy (AFM) computationally emulates experimental scanning of a biomolecular structure to produce topographic images that can be correlated with measured images. Its application to the enormous amount of available high-res... ver más
Revista: Algorithms

 
Olga Kurasova, Arnoldas Bud?ys and Viktor Medvedev    
As artificial intelligence has evolved, deep learning models have become important in extracting and interpreting complex patterns from raw multidimensional data. These models produce multidimensional embeddings that, while containing a lot of informatio... ver más
Revista: Informatics