This paper develops the theory behind the bispectrum, a concept that is well established in statistical signal processing but not, until recently, extended to computer vision as a source of frequency-domain invariants. Recent papers on using the bispectrum in vision show good results when the bispectrum is applied to spherical harmonic models of three-dimensional (3-D) shapes, in particular by improving discrimination over previously-proposed magnitude invariants, and also by allowing detection of neutral pose in human activity detection. The bispectrum has also been formulated for vector spherical harmonics, which have been used in medical imaging for 3-D anatomical modeling. In a paper published in this journal, Smach et al. use duality t...