Congratulations to Prof. Sai-Kit YEUNG (Professor, Division of Integrative Systems and Design, Department of Computer Science and Engineering, and Department of Ocean Science) and Mr. Ziqiang ZHENG (PhD Candidate, Department of Computer Science and Engineering) for getting their groundbreaking research paper accepted as an oral presentation at one of the top-tier conferences - European Conference on Computer Vision (ECCV) 2024. The research team develops the first foundation model for image analysis for marine realms with instance visual description, together with the largest marine image dataset.

The oceans, covering 70% of the Earth’s surface, are teeming with life and play a pivotal role in global climate regulation, yet remain largely unexplored and poorly understood due to their vastness and inaccessibility. Therefore, analyzing and understanding marine imagery has gained increasing attention within both computer vision and marine communities. However, building a foundation model for marine visual analysis is very challenging. The scarcity of labeled data is the most hindering issue, and marine photographs illustrate significantly different appearances and contents from general in-air images. Based on their previous work MarineGPT, the first vision-language model specifically on the marine domain with extensive marine knowledge, Prof. YEUNG and his team created MarineInst20M, the largest marine image dataset to date, with 2.42 million images and 19.2 million masks in total and introduced MarineInst, a foundation model for marine visual analysis which can segment and describe the marine object instances. The dataset and model support a wide range of marine visual analysis tasks, from image-level scene understanding to regional mask-level instance understanding. What’s more, the model exhibits strong generalization ability and flexibility to support various downstream tasks with state-of-the-art performance.

European Conference on Computer Vision (ECCV) ranks top 2 on Research.com’s 2023 Best Computer Science Conference List. Getting the paper accepted as an oral presentation with only 2.33% (200/8585) of total submissions in ECCV 2024 recognizes the innovative capacity of ISD and Prof. Yeung’s team. The research contributes to progress in AI for Science at large and indicates HKUST’s advanced ability in frontier research on Marine AI.

For more information about MarineInst, please visit the website: https://marineinst.hkustvgd.com.

(Article reposted from HKUST Academy of Interdisciplinary Studies)

Haosong ZHONG (Year 4 undergraduate student) and Xupeng LU (year 1 PhD student) from the Division of Integrative Systems and Design (ISD) have recently published a research paper titled “Seeing Through Muddy Water: Laser-Induced Graphene for Portable Tomography Imaging” on Advanced Science as the first authors under the supervision of Prof. Mitch LI of ISD.

Advanced Science is a premium interdisciplinary open access journal covering cutting-edge research in materials science, physics, chemistry, medical and life sciences, and engineering. It publishes high-quality research as a leading open access journal in various scientific fields.

The study explores the potential of graphene in imaging by utilizing laser-induced graphene (LIG) electrodes for detection in turbid water through an Electrical Impedance Tomography (EIT) application. A fiber laser marking machine with a wavelength of 1064 nm is used for fabricating the LIG electrode array, and later is placed in a beaker of water for testing. The portable four-terminal EIT prototype enables easy identification of items with varying conductivity levels under muddy water via wireless (Bluetooth) communication.

The discovery not only demonstrates that LIG fabricated by a 1064 nm fiber laser could serve as EIT electrode material but also proposes a new, cost-effective method for long-term underwater monitoring due to its high corrosion resistance. The device produces satisfactory image quality and resolution at a low cost, and the technology causes less environmental degradation compared to existing methods, which is an ideal nanomaterial that could integrate into underwater robotics or marine automation devices.

A team of UG students from the Division of Integrative Systems and Design (ISD) won the Bronze Award of ASMPT Technology Award 2024.

Five of our undergraduate students Shijie WANG, Mukai YU, Yui Kai TSE, Wang Lok LUK and Chen SONG came up with a practical innovation under the supervision of Prof. Chi-Ying TSUI and Dr. Jac LEUNG for their final year project, titled “Facade Installation Robotic System (F.I.R.S): Modernizing Working at Heights”. F.I.R.S is a smart construction robot that could handle the most high-risk procedures of mounting panels at heights with Computer Vision-powered Automation, and IoT connectivity while giving construction workers control to monitor and intervene safely from the ground. This solution could empower the construction workers to install the Building-Integrated Photovoltaics (BIPV).

Nominated to participate in the competition, the team stood out from the rest of the final year projects among universities in Hong Kong in engineering or science fields and won the Bronze Award with their outstanding design and presentation.

The ASMPT Technology Award is the initiative of ASMPT Limited that aims to recognize and reward students with exceptional final year projects which demonstrate excellence in technology and innovation.

Congratulations to the winning team!