A qualia exploitation of sensor technology (QUEST) motivated architecture using algorithm fusion and adaptive feedback loops for face recognition for hyperspectral imagery (HSI) is presented. QUEST seeks to develop a general purpose computational intelligence system that captures the beneficial engineering aspects of qualia-based solutions. Qualia-based approaches are constructed from subjective representations and have the ability to detect, distinguish, and characterize entities in the environment Adaptive feedback loops are implemented that enhance performance by reducing candidate subjects in the gallery and by injecting additional probe images during the matching process. The architecture presented provides a framework for exploring more advanced integration strategies beyond those presented. Algorithmic results and performance improvements are presented as spatial, spectral, and temporal effects are utilized; additionally, a Matlab-based graphical user interface (GUI) is developed to aid processing, track performance, and to display results. 1. Introduction Social interaction depends heavily on the amazing face recognition capability that humans possess, especially the innate ability to process facial information. In a myriad of environments and views, people are able to quickly recognize and interpret visual cues from another person’s face. With an increasing focus on personal protection and identity verification in public environments and during common interactions (e.g., air travel, financial transactions, and building access), the performance capability of the human system is now a desired requirement of our security and surveillance systems. Face recognition is a crucial tool being used in current operations in Iraq and Afghanistan by allied forces to identify and track enemies  and effectively distinguish friendlies and nonenemies . The human recognition process utilizes not only spatial information but also important spectral and temporal aspects as well. Utilizing only visual wavelengths for computer vision solutions has significant downsides, where features evident to humans are too subtle for a machine to capture. Prior research has shown deficiencies in computer vision techniques compared to human or animal vision when detecting defects in parts  or biometric identification . By increasing the spectral sampling to include nonvisible wavelengths it might be possible to detect some of these subtle features included in the facial data. However, incorporation and handling of features in multispectral or hyperspectral imagery
D. Shastri, A. Merla, P. Tsiamyrtzis, and I. Pavlidis, “Imaging facial signs of neurophysiological responses,” IEEE Transactions on Biomedical Engineering, vol. 56, no. 2, Article ID 4599232, pp. 477–484, 2009.
I. Pavlidis and P. Symosek, “The imaging issue in an automatic face/disguise detection system,” in Proceedings of the IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications, pp. 15–24, 2000.
B. Klare and A. K. Jain, “HeTerogeneous face recognition: matching NIR to visible light images,” in Proceedings of the 20th International Conference on Pattern Recognition (ICPR '10), pp. 1513–1516, August 2010.
T. Bourlai, N. Kalka, A. Ross, B. Cukic, and L. Hornak, “Cross-spectral face verification in the Short Wave Infrared (SWIR) band,” in Proceedings of the 20th International Conference on Pattern Recognition (ICPR '10), pp. 1343–1347, August 2010.
S. G. Kong, J. Heo, B. R. Abidi, J. Paik, and M. A. Abidi, “Recent advances in visual and infrared face recognition—a review,” Computer Vision and Image Understanding, vol. 97, no. 1, pp. 103–135, 2005.
M. I. Elbakary, M. S. Alam, and M. S. Asian, “Face recognition algorithm in hyperspectral imagery by employing the K-means method and the mahalanobis distance,” in Advanced Signal Processing Algorithms, Architectures, and Implementations XVII, vol. 6697 of Proceedings of SPIE, August 2007.
Z. Pan, G. Healey, M. Prasad, and B. Tromberg, “Hyperspectral face recognition for homeland security,” in Infrared Technology and Applications XXIX, vol. 5074 of Proceedings of SPIE, pp. 767–776, April 2003.
Z. Pan, G. Healey, M. Prasad, and B. Tromberg, “Hyperspectral face recognition under variable outdoor illumination,” in Algorithms and Technologies for MultiSpectral, Hyperspectral, and Ultraspectral Imagery X, vol. 5425 of Proceedings of SPIE, pp. 520–529, April 2004.
Z. Pan, G. Healey, and B. Tromberg, “Multiband and spectral eigenfaces for face recognition in hyperspectral images,” in Biometric Technology for Human Identification II, vol. 5779 of Proceedings of SPIE, pp. 144–151, March 2005.
N. V. Chawla and K. W. Bowye, “Random subspaces and subsampling for 2-D face recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), pp. 582–589, June 2005.
I. Jarudi and P. Sinha, “Recognizing degraded faces: contribution of internal and external features,” in Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Artificial Intelligence Memo 2003-004 and Center for Biological and Computational Learning Memo, p. 225, 2005.