Image Processing for Camera Arrays for Multi/Hyperspectral Imaging


The chair developed a camera array for multispectral imaging (CAMSI) that consists of nine cameras arranged in a three times three grid as well as a hexagonal array for hyperspectral imaging (HAHSI) with 37 cameras. While the sensor and the lens stays the same for all cameras, the filter changes to record different parts of the light spectrum. For example, there are filters in the visible wavelength area to record an RGB image, but also in the infrared, which is often very helpful for classification of materials, since many materials have specific spectral absorption bands and therefore spectral fingerprints, which can be exploited to discriminate them.
Since the cameras are placed at different positions, an image processing pipeline is necessary to reconstruct a consistent multispectral/hyperspectral datacube, i.e., it should look like as if every camera recorded the scene from the center camera. Within this pipeline diverse thesis are possible ranging from synthesizing hyperspectral data to neural networks for cross spectral depth estimation. Also on the hardware side, possible thesis include optimizing the filter arrangement to a proper camera calibration.

Weitere Informationen können dem nachfolgenden Dokument entnommen werden:

Aushang Camera Arrays


Vorausgesetzt werden Erfahrungen in der Programmierung mit Python und Bildsignalverarbeitung.


Frank Sippel, M.Sc
Raum 06.0192


Prof. Dr.-Ing. André Kaup
Raum 06.031