关键词:
Robotics
Artificial intelligence
Computer science
摘要:
Motion estimation using visual data is an essential aspect of today's self-driving cars, autonomous drones, robotics, and many other similar applications. Most proposed algorithms use either feature-based methods, which look at special features in images; or, direct methods, which look at the whole image pixels. Feature-based algorithms are mostly used with traditional descriptors, such as SIFT, SURF, Hessian, or Harris, to extract point-wise features and then match those features across the image frames in the camera's video input. Recently, local affine features (LAFs) have become a hot topic in many 3D vision applications, including relative pose estimation and Structure from Motion (SfM). This is because they are more informative than point features. The clear benefit to using affine correspondences (ACs) is the fact that they add three linear constraints on the Fundamental matrix F, hence fewer correspondences are required. This means the iterative, random sampling process of RANSAC will take fewer iterations to find the inlier matches. Therefore, the use of ACs improves performance by reducing the computation time, while maintaining similar accuracy. In this work, we focus on making motion estimation with affine correspondences more accurate, robust, and applicable to a wider range of setups. We also extend the epipolar constraint on affine correspondences to the multi-camera setting. Then, we propose a new solution for multi-camera motion estimation with affine correspondences using this constraint. Our new affine-based solver outperforms its point-based counterpart while maintaining similar accuracy. A statistical analysis of the experimental results on synthetic and real data confirms this conclusion. However, affine correspondences are known to be more vulnerable to noise than point correspondences. Current photometric refinement methods are costly; making such solutions unsuitable for real-time applications. We propose a new method to correct affine corre