Data Fellows project aims to make storm surge predictions faster and more accurate

By Nelson Tull

Note: Nelson Tull is a graduate student in the Department of Civil, Construction, and Environmental Engineering at North Carolina State University. His faculty advisor, Casey Dietrich, is an NCDS Data Fellow conducting research to improve hurricane and storm surge guidance to emergency managers in North Carolina’s coastal counties. Dietrich’s Data Fellows research builds on previous work supported by the North Carolina Sea Grant program. Other collaborators are Rick Luettich, head of the Institute of Marine Sciences at UNC-Chapel Hill, Brian Blanton, a senior research scientist and oceanographer at RENCI, and Jason Fleming of Seahorse Coastal Consulting. To learn more about this research, tune into the September 2017 NCDS DataBytes webinar.

When lives are on the line, minutes count but so does accuracy
Storm surge model forecasts are a critical tool used by coastal emergency managers to plan and make decisions. These models must be both accurate and fast to give reliable information in a timely manner as a storm moves toward the coast. The forecast guidance must also be visualized in a way that is meaningful to those who need this vital information.

Our research team uses ADCIRC, a powerful computer model that predicts coastal flooding caused by storm surge on regional and even continental scales. When the National Hurricane Center issues a storm advisory, ADCIRC runs every six hours, such as during Hurricane Matthew Advisory 27, which was issued on Oct. 4, 2016, four days before the center of the storm moved past Wilmington, NC. Model forecasts are visualized using Kalpana, a computer program developed with support from North Carolina Sea Grant that converts the model results into visual formats that are easily understood and useable. The image below is an example of one such format (ArcGIS).

(Figure 1) Map of maximum water levels for Hurricane Matthew Advisory 27 in North Carolina. The black box represents the zoomed region shown in the following image.

When a storm threatens the coast, the North Carolina Emergency Management (NCEM) division needs forecasts of the maximum flooding that is expected along the coast to make evacuation decisions and develop damage estimates. Although our model provides water level predictions from the deep ocean all the way to the coastal floodplains, the system is limited by the model’s resolution. Topographic features at scales smaller than 500 feet, such as roadways or narrow stream channels, are often not included in the models because of the computer time needed to produce such high-resolution outputs. That means the extent of flooding can be under predicted by the model.

Continuing our North Carolina Sea Grant project and with new support from the National Consortium of Data Science, we are developing a method to improve prediction of the true flooding extent by combining the results of our model with more accurate elevation datasets.

To perform this prediction of the flooding extent, we use a Geographic Information System (GIS) called GRASS GIS that specializes in processing very large amounts of data. The project has two major objectives. The first is to process the modeled water levels and the elevation data set together, producing a map showing the extent of predicted flooding. When the modeled water levels are greater than the land elevation, flooding extends outward into neighboring, unflooded areas in the data set. By mapping the model results to the higher resolution data sets on elevation, we can create more accurate surge forecasts of overland flooding. The result is illustrated in the image below.

(Figure 2) Zoomed image of flooding along the Newport River, just northwest of Morehead City in Carteret County. The dark blue represents model-computed flooding for Matthew Advisory 27, while the light blue represents the flooding boundary produced by the enhanced resolution.

The second major objective of our work is speed. Because the model is used for real-time forecasting during storm events, it is critical for the process to be fast. Emergency managers need to know how high the water will be and where flooding will occur, and they need this information as quickly as possible.

To speed up the process of producing models, our enhanced-resolution program uses methods that work efficiently with large amounts of data. After exploring several methods and trying different ways of structuring the program, we developed a process that can produce visual models in 15 to 20 minutes, depending on the complexity of the storm. This new technology is slower than the existing visualization methods because the higher resolution requires more computing time. However, the new visualizations are more accurate than what is currently available, and they can still be provided to NC emergency managers in time to help them make better decisions.

This new process will become part of the workflow at Seahorse Coastal Consulting and RENCI, which includes running the ADCIRC storm surge model for every forecast advisory during an approaching storm. Our goal is to produce the model forecast in 60 to 90 minutes, immediately followed by the 15- to 20-minute, enhanced-resolution program. This new and improved guidance is being shared with NCEM during the 2017 hurricane season.

While this project has given emergency managers in North Carolina new capabilities, additional work will be required to apply this method to different coastal regions, such as Louisiana or Texas. In addition, we continue to work on improving the speed of the program, because for those who live on the coast and for those in charge of protecting them, every minute counts when a storm is approaching.

A version of this article appears on the NC Sea Grant website.

BRAIN-I project uses RENCI cyberinfrastructure called xDCI to manage brain microscopy images

Sharing massive image files just became easier

Today’s advanced microscopes have revolutionized biology by giving scientists the ability to view 3D biological structures at the cellular and molecular level. However, that ability has created another problem: How to share and manage massive image files that can each be as large as 1 terabyte (TB), with possibly more than 50 TBs of data for the entire research project.  (A terabyte equals 1 trillion bytes of data, or about 150 hours of HD quality recording). Read more

iRODS Consortium welcomes OCF as newest member

UK-based technical support provider will now have a role in future iRODS development

CHAPEL HILL, NC – OCF, an organization that specializes in supporting the data challenges of private and public organizations in the UK, is the latest organization to join the iRODS Consortium, the membership-based foundation that leads development and support of the integrated Rule-Oriented Data System (iRODS).

Read more

RENCI to lead $3 million project aimed at enabling safe and secure data sharing

CHAPEL HILL, NC – RENCI and partners at UNC-Chapel Hill, Duke University, Indiana University and the city of Durham, NC, will work together on a project that aims to allow scientists to share and analyze data across institutional boundaries while keeping that data safe and in compliance with regulations that control data location, availability, movement and access. Read more

Presentations at upcoming meeting highlight worldwide uses of iRODS

Go to to register for the 2017 User Group Meeting at Utrecht University

UTRECHT, The Netherlands – Users will take the spotlight during the annual iRODS User Group Meeting, which will feature at least 20 user presentations highlighting the many industries, government agencies, and research institutes who depend on iRODS to manage their data.

iRODS—the integrated Rule Oriented Data System—is free open source software for data management and discovery, workflow automation, secure collaboration, and data virtualization. iRODS software is developed and maintained through the support of the iRODS Consortium, a membership organization with industry and academic members worldwide. Read more

Tagged , , |

A sneak peek at iRODS User Group Meeting technology previews

New plugins to be highlighted; register now at

Above: Terrell Russell speaks at last year’s iRODS User Group Meeting.

The worldwide iRODS community will gather June 13 – 15 for the first User Group Meeting to be held at Utrecht University in The Netherlands.

Along with use cases and presentations by iRODS users from at least seven countries, the meeting will offer a glimpse at new technologies that will soon be available alongside iRODS 4.2. Read more

RENCI teams with Clemson and WSU on $2.95 million project to improve and simplify large-scale data analysis

CHAPEL HILL, NC – RENCI researchers will work with scientists from Clemson University and Washington State University on a project funded by the National Science Foundation to develop cyberinfrastructure aimed at providing researchers around the nation and world with a more fluid and flexible system of analyzing large-scale data.

The NSF awarded $2.95 million for a collaborative project that will unite biologists, hydrologists, computer engineers and computer scientists to design a system called Scientific Data Analysis at Scale (SciDAS). Read more

Tagged , , |

Registration now open for June iRODS User Group Meeting

Users of the integrated Rule Oriented Data System (iRODS) from around the globe will gather in Utrecht, The Netherlands to discuss iRODS-enabled applications and discoveries, technologies powered by iRODS, and the future of iRODS and the iRODS Consortium.

Thousands of businesses, research centers, and government agencies located in the U.S., Europe, Asia, Australia, South America, and Africa use iRODS for flexible, policy-based data management that provides long-term preservation and federation.

Read more

Tagged , , |

RENCI and Carolinas Center to build online health management and wellness platform

CHAPEL HILL, NC – A new web-based platform being developed by RENCI in partnership with The Carolinas Center for Hospice and End of Life Care will allow people in the Carolinas to better manage their health and interact with loved ones and healthcare providers on planning for their future healthcare.

The Carolinas Center received a grant of $1.06 million from the Duke Endowment to support building the new system over the next three years. RENCI will receive about $500,000 from that grant to create the platform’s data management system and a framework for safely accessing and sharing data. Read more

Tagged , , |

iRODS Consortium Welcomes Intel as Newest Member

The integrated Rule-Oriented Data System (iRODS) Consortium today announced Intel Corporation, has joined the membership-based foundation.

As a consortium member, Intel plans to improve integration between iRODS, the free open source software for data virtualization, data discovery, workflow automation, and secure collaboration, and Lustre, an open source parallel distributed file system used for computing on large-scale high performance computing clusters. Membership in the consortium is a first step in offering an integrated tiered solution to Lustre end-users that allows them to easily move data sets from HPC systems into less costly long-term storage systems, where the data can be managed, shared and kept secure using iRODS.   Read more

Page 1 of 4212345...102030...Last »