A MSA Feature-based Multiple Targets Association Algorithm in Remote Sensing Images
基于MSA特征的遥感图像多目标关联算法

Target identification fusion based onmulti-source remote sensing mi ages canmake fulluse of the redundancy and complementary information from all sensors, acquiring more accurate result of target recognition. One of the pre- condition of identification fusion is targetassociation, which is to determine if the information from two ormore mi ages are related to the same target and should be fused together. Due to different performance of sensor and diverse target distribution, the extracted information of targets generally has some uncertainty, which results in the difficulty in judging whether the information from two mi ages is originated from the same target. Therefore, how to utilize the information of remote sensing mi ages to distinguishmulti-target association has become an urgen problem. There are two kinds ofmethods concerning target association when using mi age data: one isKalman filtering based data association and tracking, which utilizes accumulated kinematic information ofmulti-frame mi ages to estmi ate and track. Typicalmethods areNearestNeighbor (NN), JointProbabilistic Data Association (JPDA), Multiple-Hypothesis Tracking (MHT) and so on. Thesemethodsneed dense sampling ofobserved data, and the targetmotionmodel should be smi ple. The otherone uses mi agematch in computervision for reference. Typicalmethods are cross correlationmatching, featurematching and so on. Thesemethods usuallywork on condition thatonly single target is concerned. For remote sensing mi ages, there are two problemswhen associatingmultiple targets in them. Firstly, it is incapable to acquire a seriesofmulti-temporal remote sensing mi ageson the same region atpresent, so the kinematic state ofa target cannotbe estmi ated accuratelywith low temporal resolution data and the classicalKalman filtering association algorithms are nomore applicable. Wemust seek for other tmi e-independent information as the associatingmeasurement, which can be mi age invariant feature. Secondly, there are two uncertainties lying in mi age feature extraction of a target. One uncertainty lies in determining invariant features due to various mi age distortions such as rotation, scaling and so on. The other lies in establishing feature correspondencesbetween any two consecutive mi ages. So, it isdifficultto discrmi inate the ambiguity ofmultiple targets correspondenceswhen using mi agematching-based associationmethod. In order to solve above problems, a novel multiple targets association method based on mi age invariant feature matching andAssociation CostMatrix (ACM) global optmi ization is proposed. At first, theMulti-scaleAutoconvolution (MSA) transform of a target is computed based on affine invariant theory and is used as associationmeasurement, which can overcome the negative influence of changes in target s pose, mi aging viewpoint and so on. Secondly, the association costmatrix is constructed based on the dissmi ilarities ofMSA featurematching of any two target pairs from two mi