FUSE: Intelligent Sensor Fusion Guidance

Degree Project 2022

As a response to the zero emission targets set for 2050, electric and alternative fuel vehicles have become very common in the last years.

The new type of transmission systems and the new technologies being implemented make a lot of structural differences in the vehicles and create a wide range of variety. This changes how to respond to those vehicles and makes it harder for the firefighters to know exactly what to do before correctly identifying the vehicles. Furthermore, at the moment, it is also not very clear how to respond to these vehicles in case of an emergency situation as there are not widely accepted procedures.

FUSE is an AI-assisted handheld tool and a system designed for the firefighters to be used for car accidents. FUSE has a set of sensors and cameras together with the flashlights and a laser pointer. It’s not only packed with sensors but a powerful AI which has the access to a database of 3d models and rescue information of the vehicles together with the real-world knowledge. It compares 3d datas of the vehicles with real-world scans and generates recommendations in augmented reality form.

The FUSE system provides the most critical information for the firefighters while interfering with crashed vehicles while also allowing this to be documented and used for training the AI and the firefighters for the future cases.

Sinan Altun

Master's Programme in Advanced Product Design
When responding to the vehicles there's a lot of problems related with how the information is received and handled. Moreover, EVs bring new problems we need to solve. Image:Umeå Institute of Design

When responding to the vehicles there's a lot of problems related with how the information is received and handled. Moreover, EVs bring new problems we need to solve.

The flashlights in the front are designed to improve the accuracy of the sensors while also giving the user a better lit target. Image:Umeå Institute of Design

The flashlights in the front are designed to improve the accuracy of the sensors while also giving the user a better lit target.

FUSE has a set of sensors and cameras together with the flashlights and a laser pointer. Image:Umeå Institute of Design

FUSE has a set of sensors and cameras together with the flashlights and a laser pointer.

FUSE can mounted to a tripod to watch an ongoing situation easier. Image:Umeå Institute of Design

FUSE can mounted to a tripod to watch an ongoing situation easier.

The keypad is made in one piece in order to provide a water-proof solution to be used in the harsh environment. Image:Umeå Institute of Design

The keypad is made in one piece in order to provide a water-proof solution to be used in the harsh environment.
7 of 14

FUSE gives the opportunity to the firefighters to hold it with 2 hands to give better control while directing. Image:Umeå Institute of Design

FUSE gives the opportunity to the firefighters to hold it with 2 hands to give better control while directing.
8 of 14

The battery has a lever in order to lock and release the battery securely. Image:Umeå Institute of Design

The battery has a lever in order to lock and release the battery securely.

The screen can be tilted up to 40° for various applications. Image:Umeå Institute of Design

The screen can be tilted up to 40° for various applications.
10 of 14

FUSE can either be placed straight or inclined. This gives flexibility to the firefighters when sharing the informaion with others. Image:Umeå Institute of Design

FUSE can either be placed straight or inclined. This gives flexibility to the firefighters when sharing the informaion with others.

Some of the main functions of FUSE are connection to the vehicles, 3d scanning, thermal imaging and laser cross projecting Image:Umeå Institute of Design

Some of the main functions of FUSE are connection to the vehicles, 3d scanning, thermal imaging and laser cross projecting

The interface consists of a horizontal module on the top that is showing the critical info of the connected vehicle, a vertical module on the left called tasks panel, a temperature bar, and the real-time AR view window. Image:Umeå Institute of Design

The interface consists of a horizontal module on the top that is showing the critical info of the connected vehicle, a vertical module on the left called tasks panel, a temperature bar, and the real-time AR view window.

FUSE is a handheld device with an integrated screen designed for professional use for the firefighters. Image:Umeå Institute of Design

FUSE is a handheld device with an integrated screen designed for professional use for the firefighters.