Building Bridges: Applying AI for Intertidal Monitoring

The Building Bridges initiative of Canada’s Ocean Supercluster (OSC) aims at accelerating the use of artificial intelligence (AI) in the ocean sector. As a Building Bridges partner, the Hakai Institute has begun automating the process of mapping coastal mussel beds by using convolutional neural networks. 

The rocky intertidal zone is an area of high biodiversity; mussel beds are a vital component of this ecosystem, creating habitat and providing an important food source for other organisms. Climate change and associated sea-level rise are subjecting this domain to increasing stress, and there is a resultant need to monitor these changes to better assess the health and resilience of blue mussels (Mytilus edulis) and California mussels (Mytilus californianus).

Hakai has been monitoring mussel beds on the Central Coast for nearly a decade, via nearshore field studies performed in situ by researchers, and through flying annual drone surveys. The Institute has been a leader in deploying drones to extend our observational reach, allowing researchers to observe sites that are too dangerous or logistically difficult to access. 

Traditional methods for processing drone imagery data, however, are time-consuming and expensive. The use of deep neural networks—designed for processing imagery—has resulted in a substantial increase in efficiency, enabling Hakai to process and analyze vastly greater amounts of imagery. Insights are being shared with the provincial government and First Nation partners within the Marine Plan Partnership for the North Pacific Coast (MaPP), as well as with Parks Canada, Fisheries and Oceans Canada, and university researchers.

Partners

Hakai Institute is a partner within the Canadian Integrated Ocean Observing System (CIOOS), an open-access platform for sharing information about the state of our oceans. CIOOS is a recipient of funding through the Building Bridges initiative of the Canada Ocean Supercluster—which, as noted above, aims to accelerate AI adoption in the ocean sector, with a focus on not-for-profit organizations. Each CIOOS partner is applying AI to help them achieve their research objectives.

In turn, Hakai Institute shares insights (including tools and/or data) from the mussel mapping project with a variety of partners, including BC coastal First Nations and Fisheries and Oceans Canada, as well as researchers at the University of British Columbia, California State Polytechnic University Pomona, University of California Santa Cruz, the University of Washington, Oregon State University, University of Alaska Fairbanks, and the Multi-Agency Rocky Intertidal Network (MARINe).

Timeframe

Applications of AI to mussel bed mapping began in April of 2023 and are ongoing, with this round of funding carrying through March, 2026.

Context

Much of our work with mapping mussels is built upon previous work for mapping kelp using drones and neural networks. Many of the same methods for detecting kelp in drone imagery can be adopted for intertidal mussel beds, with some tweaks—such as altering our methodology to better account for variable lighting conditions and a more limited spatial distribution of monitoring sites.

We are working to further expand our models to detect and distinguish gooseneck barnacles in images, which often co-occur with other mussel species at rocky intertidal sites.

Outcomes

• The model can currently detect mussel beds in imagery with a fairly high level of precision (precision=0.8314, recall=0.8262). Many of the mistakes the model makes are in areas where human labellers also struggle, such as shadowy areas in crevasses.

• Our model is publicly available for others to use, and distributed as an open-source Python package. This allows others to use our model to label their own imagery efficiently.

• The dataset used to train our model is also publicly available via CIOOS. This helps ensure that others can use our data to develop their own models if they wish, and ensures that both the Hakai Institute and other researchers have the opportunity to develop new models for mussel detection—models that may be more accurate, that run better in resource-constrained environments, or that alter output to better suit their specific needs.

Gallery