In progress – view active session
Conference 13061
Ocean Sensing and Monitoring XV
23 - 24 April 2024 | Potomac 5
View Session 
Symposium Plenary
22 April 2024 • 5:00 PM - 6:30 PM EDT | Potomac A
Session Chairs:
Tien Pham, The MITRE Corp. (United States), Douglas R. Droege, L3Harris Technologies, Inc. (United States)
View Full Details: spie.org/dcs/symposium-plenary
Chair welcome and introduction
22 April 2024 • 5:00 PM - 5:05 PM EDT
DoD's microelectronics for the defense and commercial sensing ecosystem (Plenary Presentation)
Presenter(s): Dev Shenoy, Principal Director for Microelectronics, Office of the Under Secretary of Defense for Research and Engineering (United States)
22 April 2024 • 5:05 PM - 5:45 PM EDT
NATO DIANA: a case study for reimagining defence innovation (Plenary Presentation)
Presenter(s): Deeph Chana, Managing Director, NATO Defence Innovation Accelerator for the North Atlantic (DIANA) (United Kingdom)
22 April 2024 • 5:50 PM - 6:30 PM EDT
Symposium Panel on Microelectronics Commercial Crossover
23 April 2024 • 8:30 AM - 10:00 AM EDT | Potomac A
View Full Details: spie.org/dcs/symposium-panel
The CHIPS Act Microelectronics Commons network is accelerating the pace of microelectronics technology development in the U.S. This panel discussion will explore opportunities for crossover from commercial technology into DoD systems and applications, discussing what emerging commercial microelectronics technologies could be most impactful on photonics and sensors and how the DoD might best leverage commercial innovations in microelectronics.
Moderator:
John Pellegrino, Electro-Optical Systems Lab., Georgia Tech Research Institute (retired) (United States)
Panelists:
Shamik Das, The MITRE Corporation (United States)
Erin Gawron-Hyla, OUSD (R&E) (United States)
Carl McCants, Defense Advanced Research Projects Agency (United States)
Kyle Squires, Ira A. Fulton Schools of Engineering, Arizona State Univ. (United States)
Anil Rao, Intel Corporation (United States)
Session 1:
Ocean Sensing
23 April 2024 • 1:00 PM - 2:30 PM EDT | Potomac 5
Session Chair:
Weilin Hou, Office of Naval Research (Singapore)
Opening Remarks 1:00 PM to 1:10 PM
13061-1
23 April 2024 • 1:10 PM - 1:30 PM EDT | Potomac 5
Show Abstract +
The characterization of algae biomass is essential for ensuring the health of an aquatic ecosystem. Algae overgrowth can be detrimental to the chemical composition of a habitat and affect the availability of safe drinking water. In-situ sensors are commonplace in ocean and water quality monitoring scenarios where the collection of field data using readily deployable, cost-effective sensors is required. For this purpose, the use of compact time-domain nuclear magnetic resonance (TD-NMR) is proposed for the assessment of magnetic particle (MP) content in algae. A custom NMR system capable of rapidly acquiring relaxometric data is introduced, and the $T_2$ relaxation curves of algae samples sourced from Lake Wateree in South Carolina are analyzed. A clear correlation between the relaxation rate and MP concentration of the samples is observed, and the viability of the proposed scheme for MP-based estimations concerning algae is discussed.
13061-3
23 April 2024 • 1:30 PM - 1:50 PM EDT | Potomac 5
Show Abstract +
Uncertainties in radiance above the ocean surface are mostly determined by the skylight reflected from the air-water interface. Uncertainties are affected by the state of the ocean surface dependent on the wind speed and the corresponding reflection coefficient, which can be calculated based on Cox-Munk relationships. These uncertainties were estimated in the hyperspectral mode from shipborne measurements by the Hyperspectral Imager with a 400-1000 nm wavelength range and a 410x410 pixel resolution and by the polarization camera during VIIRS Cal/Val cruise in Hawaii in a broad range of wind speeds 0-10 m/s. In addition, airborne measurements from a helicopter at four different altitudes were carried out in different parts of Chesapeake Bay to establish a relationship between uncertainties and altitude. Measurement uncertainties are further compared with simulations.
13061-4
23 April 2024 • 1:50 PM - 2:10 PM EDT | Potomac 5
Show Abstract +
Remotely Operated Vehicles (ROVs) play a crucial role in subsea inspection, remote surveillance, and deep-water explorations. Typically, a surface operator controls the ROV based on its onboard camera data, i.e., the first-person visual feedback. However, the ROV's camera feed only offers a low-resolution and often noisy egocentric view - which is not very informative in deep water and challenging remote tele-operating conditions. To address this, we developed a novel "Eye On the Back" technology to provide a global third-person view for interactive ROV teleoperation. We develop interactive features for generating augmented visuals for the teleoperator as well as for enabling semi-autonomous behavior such as next-best-view planner and active ROV localization. We conduct a series of field experiments with expert ROV operators to validate this technology, and currently designing an end-to-end portable solution for the next-generation of intelligent ROV operations.
13061-25
23 April 2024 • 2:10 PM - 2:30 PM EDT | Potomac 5
Show Abstract +
Developing ocean-going unmanned robotic systems has been a focus for the marine research community for many years. Compared with earlier manned submersibles, the current state-of-the-art autonomous underwater vehicles (AUVs), tethered remotely operated vehicles (ROVs) and unmanned surface vehicles (USVs) augmented with the advancement in the sensor technology offer dramatic improvements in safety, cost, and efficiency, especially for deep water sensing operations. However, coastal zones such as estuaries and river deltas that are highly productive habitats supporting a variety of fish and wildlife may be challenging for the current suite of platforms. The complex geographical features in these regions, such as land barriers, icebergs and tidal currents, may hinder the movements of the aforementioned platforms. For this reason, a complementary sensing paradigm that employs waterproof unmanned aerial vehicles (UAVs) integrated with underwater sensors is proposed. The implementation of such concept – the Hybrid Aerial Underwater Robotic System (HAUCS) is presented. The development of one HAUCS platform, the coaxial waterproof drone, is discussed.
Break
Coffee Break 2:30 PM - 3:00 PM
Session 2:
Lidar
23 April 2024 • 3:00 PM - 4:20 PM EDT | Potomac 5
Session Chair:
Linda J. Mullen, Naval Air Warfare Ctr. Aircraft Div. (United States)
13061-5
23 April 2024 • 3:00 PM - 3:20 PM EDT | Potomac 5
Show Abstract +
Naval Air Warfare Center Aircraft Division (NAWCAD) engineers and scientists recently completed initial laboratory and field testing of the Modulated Underwater Laser Imaging System (MULIS) prototype. The MULIS prototype miniaturizes NAWCAD’s radar-encoded laser imaging technology to be compatible with the size, weight, and power constraints of an autonomous underwater vehicle (AUV) platform. MULIS can obtain high-resolution, three-dimensional imagery in the underwater environment. This paper will present results from both initial laboratory and field tests of the MULIS prototype. In the laboratory tests, the MULIS prototype was mounted to a translation stage and subsequently driven over a set of submerged objects at the bottom of a water tank. MULIS was also integrated into a REMUS 600 AUV for a field test event in the Chesapeake Bay in the summer of 2023. The paper will present results from these test events and summarize potential future directions to continue to increase the maturity of the MULIS technology.
13061-7
23 April 2024 • 3:20 PM - 3:40 PM EDT | Potomac 5
Show Abstract +
During a 12 day field test off the coast of Washington state, we conducted multiple environmental data collection flights in a 150 km by 150 km area. We operated a scanning lidar system optimized for ocean profiling collecting near surface atmospheric return signal, surface reflections and optical profiles to several optical depths. We also deployed ten single use temperature profiling buoys during the test. We will present comparisons of the spatial-temporal lidar data to the buoy data and other public source data, such as satellite derived k-diffuse, Argo float data and historical in-situ optical profile data.
13061-8
23 April 2024 • 3:40 PM - 4:00 PM EDT | Potomac 5
Show Abstract +
Underwater perception is challenging due to scattering effects and the limited output and processing power on undersea robotic platforms. Our key idea is to separate the transmitter and receiver components of a continuous wave lidar system by a baseline, and independently modulate these components with microelectromechanical (MEMS) mirrors. The first advantage is that MEMS based modulation systems are low-power and compact. The second advantage is that the separation allows confocal imaging, where scattering effects can be minimized if the mirrors follow the epipolar constraint.
13061-9
23 April 2024 • 4:00 PM - 4:20 PM EDT | Potomac 5
Show Abstract +
We experimentally demonstrate optical ranging through turbid underwater using a structured beam. This beam consists of two Bessel modes, each carrying a pair of orbital angular momentum order and longitudinal wavenumber. As a result, the beam has a “petal-like” intensity profile with different rotation angles at different distances. The object’s distance (z) is retrieved by measuring the rotation angle of the petal-like profile of the back-reflected beam. We demonstrate <20-mm ranging errors through scattering with extinction coefficient 𝛾 up to 9.4 m-1 from z=0 to 0.4 m. Moreover, we simulate both coarse- and fine-ranging by using two different structured beams. One beam has a slower rotating petal-like profile, leading to a 4X larger dynamic range for coarse ranging. A second beam has a faster-rotating profile, resulting in higher accuracy for fine ranging. In our simulation, < 7-mm errors over a 2-m dynamic range are achieved under 𝛾 = 4 m-1.
Symposium Plenary on AI/ML + Sustainability
24 April 2024 • 8:30 AM - 10:00 AM EDT | Potomac A
Session Chairs:
Latasha Solomon, DEVCOM Army Research Lab. (United States), Ann Marie Raynal, Sandia National Labs. (United States)
View Full Details: spie.org/dcs/plenary-ai-ml-sustainability
Welcome and opening remarks
24 April 2024 • 8:30 AM - 8:40 AM EDT
Army intelligence data and AI in modern warfare (Plenary Presentation)
Presenter(s): David Pierce, U.S. Army Intelligence (United States)
24 April 2024 • 8:40 AM - 9:20 AM EDT
FUTUR-IC: A three-dimensional optimization path towards building a sustainable microchip industry (Plenary Presentation)
Presenter(s): Anu Agarwal, Massachusetts Institute of Technology, Microphotonics Ctr. and Materials Research Lab. (United States)
24 April 2024 • 9:20 AM - 10:00 AM EDT
Break
Coffee Break 10:00 AM - 10:30 AM
Session 3:
AI/ML I
24 April 2024 • 10:30 AM - 11:10 AM EDT | Potomac 5
Session Chair:
David W. Illig, Naval Air Warfare Ctr. Aircraft Div. (United States)
Opening Remarks 10:30 AM to 10:40 AM
13061-11
24 April 2024 • 10:30 AM - 10:50 AM EDT | Potomac 5
Show Abstract +
Plastic pollution is an always-growing problem in earth’s oceans. In this paper, we propose an aerial method to detect marine plastic litter, which can be utilized on oil pollution control aircraft already in use in many parts of the globe. These sensors used in these aircraft are partially adapted and utilized in a new way to detect plastic litter. In addition to the development of the method for plastic detection, results from intermediate field tests are presented.
13061-13
24 April 2024 • 10:50 AM - 11:10 AM EDT | Potomac 5
Show Abstract +
One of the main challenges in underwater automatic target recognition is in the data scarcity of underwater sonar imagery. This challenge arises especially in data-driven approaches because of the limited training dataset and unknown environmental conditions before the mission. Transfer learning and synthetic data generation have been suggested as effective methods to overcome this challenge. However, the efficiency and effectiveness of synthetic data generation methods have been limited due to the difficulty from implementing complex acoustic imaging processes and data-driven model's poor performance under domain shifts. In this paper, we present a novel approach to address this challenge by utilizing cycle-generative adversarial networks (GAN) to generate synthetic sonar images to enhance the effectiveness of the training data set.
Break
Lunch/Exhibition Break 11:10 AM - 1:30 PM
Session 4:
AI/ML II
24 April 2024 • 1:30 PM - 2:50 PM EDT | Potomac 5
Session Chair:
David W. Illig, Naval Air Warfare Ctr. Aircraft Div. (United States)
13061-14
24 April 2024 • 1:30 PM - 1:50 PM EDT | Potomac 5
Show Abstract +
Detecting fish species, especially in underwater environments, poses significant challenges. Numerous object detection algorithms have been developed to address this issue, but they often rely heavily on accurately labeled training samples, which can be both time-consuming and costly. To mitigate the expenses associated with annotation and enhance the model's robustness, we introduce an active learning approach based on inconsistency assessment. This inconsistency is calculated by comparing the original image with its flipped version. Additionally, we incorporate an adaptive auto-labeling criterion to facilitate the generation of pseudo-labels for all classes. We evaluate the performance of our model using the SEAMAPD21 dataset, demonstrating improved fish species identification and a notable reduction in overall annotation costs. This comprehensive framework not only advances the field of active learning in object detection but also provides a practical solution for real-world applications, ensuring accurate and cost-effective results across diverse object classes.
13061-15
24 April 2024 • 1:50 PM - 2:10 PM EDT | Potomac 5
Show Abstract +
SEAMAPD21 represents our fish dataset, captured in an underwater environment, characterized by a significant imbalance in the distribution of fish classes. Identifying fish in such a dataset poses a substantial challenge. As we know, object detectors trained using weak annotations provide cost-effective alternatives to their fully supervised counterparts. Our proposal aims to reduce this disparity by fine-tuning a foundational active detector using a small subset of fully annotated samples that are automatically chosen from the training dataset. The main objective of this paper is to implement the active detection framework for this challenging dataset to reduce the cost in manual annotation.
13061-16
24 April 2024 • 2:10 PM - 2:30 PM EDT | Potomac 5
Show Abstract +
Accurate recognition of multiple fish species is crucial in marine ecology and fisheries. The proposed model combines YOLOv8 for object detection with ByteTrack for tracking, offering improved detection across angles and robust tracking in various scenarios. Experimental results using the SEAMAPD21 dataset demonstrate the model's effectiveness, with YOLOv8n being a lightweight yet modestly accurate option for constrained environments. The study also identifies challenges in fish tracking, such as lighting variations and fish appearance changes, proposing solutions for future research. This model shows promising fish tracking and counting results, which are crucial for monitoring marine life and promoting sustainable practices.
13061-17
24 April 2024 • 2:30 PM - 2:50 PM EDT | Potomac 5
Show Abstract +
In aquaculture research, accurate fish larvae monitoring is crucial but often impeded by water clarity and equipment constraints. Traditional green lasers, though effective, can disturb fish and harm their vision. Our study at the Harbor Branch Oceanographic Institute introduces a solution: a modified Time-of-Flight (ToF) camera with an IR laser, designed for microscopic imaging. Paired with machine learning, this tool offers precise fish larvae identification, even in murky waters, without compromising fish welfare. This innovation combines cost-efficiency, accuracy, and animal safety, advancing fish larvae tracking techniques.
Session 5:
Turbulence
24 April 2024 • 3:20 PM - 4:40 PM EDT | Potomac 5
Session Chair:
Nathaniel A. Ferlic, Naval Air Warfare Ctr. Aircraft Div. (United States)
13061-18
24 April 2024 • 3:20 PM - 3:40 PM EDT | Potomac 5
Show Abstract +
In the ocean, underwater currents are driven by various natural effects attributed to heat transfer through water. The movement of heat subsequently affects light propagation due to changes in the water’s refractive index leading to optical phase distortions. Applications implementing laser beams containing structured phase profiles are prone to being distorted by this underwater optical turbulence. Experimental and theoretical studies have shown optical vortices, a form of structured light, propagate differently through optical turbulence compared with Gaussian beams. Changes in propagation are observed by varying the amount of orbital angular momentum (OAM) a vortex beam carries that increases the beam size as OAM increases. Results show the scintillation and on-axis intensity, when chosen at locations along the LG beam annuli, are similar for different LG beams. When the initial beam waist is normalized, the speckle field correlation width and peak correlation energy decreases as RMS radius increases.
13061-19
24 April 2024 • 3:40 PM - 4:00 PM EDT | Potomac 5
Show Abstract +
Accurate measurement of laser light phase after propagation through underwater optical turbulence is crucial for defense and commercial applications like underwater communications and sensing. Traditional phase-measuring methods, like Shack-Hartmann wavefront sensors, are limited in strong optical turbulence. The Gerchberg-Saxton method utilizes synchronized intensity images in the image and Fourier planes and retrieves the phase through an iterative algorithm. The Gerchberg-Saxton algorithm's accuracy is evaluated for laser light propagation through Rayleigh-Benard natural convection, comparing results with a Shack-Hartmann sensor, showcasing its efficacy as a robust method to estimate the phase of laser light upon propagation through underwater optical turbulence.
13061-20
24 April 2024 • 4:00 PM - 4:20 PM EDT | Potomac 5
Show Abstract +
NIWC Pacific will present a novel, cost-effective method for in situ measurement and characterization of atmospheric turbulence, as quantified by the atmospheric seeing parameter, r0, by leveraging spatially encoded QR codes that are imaged using normal imaging optics. The presentation will cover the theory of the technique along with simulation and experimental results.
13061-21
24 April 2024 • 4:20 PM - 4:40 PM EDT | Potomac 5
Show Abstract +
Optical turbulence causes fluctuations in the refractive index along a propagation path, leading to severe distortions in laser beams, which in turn cause a reduced performance of electro-optical systems like directed energy weapons, imaging systems, and free space optical communication systems. We propose experimental characterization of the optical turbulence height profile in the maritime and littoral surface layer, leveraging the versatility and mobility of unmanned aerial vehicles (UAVs) over a vertical path. Initial experiments include a stationary set up to measure laser beam intensity fluctuations at five points along a vertical down link of ~30 m length. Our research results have applications for optical communication and energy delivery system between airborne and surfaced platforms (submarine or ship) through the marine surface layer.
Break
Coffee Break 2:50 PM - 3:20 PM
Break
Break 4:40 PM - 4:50 PM
Best Paper Award Presentation
24 April 2024 • 4:50 PM - 5:00 PM EDT | Potomac 5
Session Chairs:
Weilin Hou, Office of Naval Research (Singapore), Linda J. Mullen, Naval Air Warfare Ctr. Aircraft Div. (United States)
Please join us for the presentation of the Ocean Sensing and Monitoring Best Paper Award.
Digital Posters
The posters listed below are available exclusively for online viewing during the week of SPIE Defense + Commercial Sensing 2024.
13061-10
On demand | Presenting live 25 April 2024
Show Abstract +
This study delves into the Extended Kalman Filter's (EKF) use in ocean science through a detailed bibliometric and text mining examination. Tracing its roots back to the original Kalman Filter from the 1960s, the EKF has become crucial for managing nonlinear dynamics, especially in oceanography. Our analysis, drawing from Scopus data covering 1980-2023, delivers an extensive overview of the EKF's growth, applications, and cross-disciplinary influence in this area. The results demonstrate a steady increase in EKF applications, particularly in autonomous underwater vehicle navigation, forecasting ocean currents, and modeling marine ecosystems. The bibliometric findings show its broad interdisciplinary appeal, while the text analysis underscores the EKF's integration with cutting-edge computational techniques and its significance in burgeoning oceanographic technologies. The paper highlights the EKF's indispensable role in ocean science, reflecting its historical importance and versatility in addressing contemporary challenges in marine technology. The study not only sheds light on the EKF's historical and current uses but also suggests potential future directions for research.
Conference Co-Chair
NOAA Ctr. for Satellite Applications and Research (United States)