Critical configurations for three projective views
DOI:
https://doi.org/10.7146/math.scand.a-139788Abstract
The problem of structure from motion is concerned with recovering the 3-dimensional structure of an object from a set of 2-dimensional images taken by unknown cameras. Generally, all information can be uniquely recovered if enough images and point correspondences are provided, yet there are certain cases where unique recovery is impossible; these are called \emph{critical configurations}. We use an algebraic approach to study the critical configurations for three projective cameras. We show that all critical configurations lie on the intersection of quadric surfaces, and classify exactly which intersections constitute a critical configuration.
References
Agarwal, S., Pryhuber, A., and Thomas, R. R., Ideals of the multiview variety, IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (2021), no. 4, 1279–1292. https://doi.org/10.1109/TPAMI.2019.2950631
Bertolini, M., Besana, G. M., Notari, R., and Turrini, C., Critical loci in computer vision and matrices dropping rank in codimension one, J. Pure Appl. Algebra 224 (2020), no. 12, 106439. https://doi.org/10.1016/j.jpaa.2020.106439
Bertolini, M., and Turrini, C., Critical configurations for 1-view in projections from $ P^k$ to $P^2$, J. Math. Imaging Vision 27 (2007), no. 3, 277–287. https://doi.org/10.1007/s10851-007-0649-6
Bertolini, M., Turrini, C., and Besana, G., Instability of projective reconstruction of dynamic scenes near critical configurations, in “2007 IEEE 11th International Conference on Computer Vision”, 2007, pp. 1–7. https://doi.org/10.1109/ICCV.2007.4409100
Bråtelund, M., Critical configurations for two projective views, a new approach, J. Symbolic Comput. (2024), 102226, 22pp. https://doi.org/https://doi.org/10.1016/j.jsc.2023.102226
Bråtelund, M., and Rydell, F., Compatibility of Fundamental Matrices for Complete Viewing Graphs, arXiv e-prints (2023), arXiv:2303.10658. https://doi.org/10.48550/arXiv.2303.10658
Buchanan, T., The twisted cubic and camera calibration, Comput. Vision Graphics Image Process. 42 (1988), no. 1, 130–132. https://doi.org/https://doi.org/10.1016/0734-189X(88)90146-6
Buchanan, T., Critical sets for 3d reconstruction using lines, Computer vision—ECCV '92 (Santa Margherita Ligure, 1992), 730–738, Lecture Notes in Comput. Sci., 588, Springer, Berlin, 1992. https://doi.org/10.1007/3-540-55426-2_82
Coxeter, H. S. M. and Greitzer, S. L., Geometry revisited, New Mathematical Library, 19. Random House, Inc., New York, 1967.
Hartley, R., Ambiguous configurations for 3-view projective reconstruction, in “Computer Vision—ECCV 2000” (Berlin, Heidelberg), Springer Berlin Heidelberg, 2000, 922–935.
Hartley, R., and Kahl, F., Critical curves and surfaces for euclidean reconstruction, in “Computer Vision—ECCV 2002” Springer Berlin Heidelberg, 2002, pp. 447–462. https://doi.org/10.1007/3-540-47967-8_30
Hartley, R., and Kahl, F., Critical configurations for projective reconstruction from multiple views, Int. J. Comput. Vision 71 (2007), no. 1, 5–47. https://doi.org/doi:10.1007/s11263-005-4796-1
Hartley, R., and Zisserman, A., Multiple view geometry in computer vision, Second ed., Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511811685
Kahl, F., Hartley, R., and Astrom, K., Critical configurations for $n$-view projective reconstruction, in “Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001”, vol. 2, 2001, pp. II–158–II–164. https://doi.org/10.1109/CVPR.2001.990945
Krames, J., Zur Ermittlung eines Objektes aus zwei Perspektiven. (Ein Beitrag zur Theorie der “gefährlichen Örter”), Monatsh. Math. Phys. 49 (1941), 327–354 https://doi.org/10.1007/BF01707311
Luong, Q. T., and Faugeras, O. D., A stability analysis of the fundamental matrix, Computer vision—ECCV '94, Vol. 1 (Stockholm, 1994), 589–599, Lecture Notes in Comput. Sci., 800, Springer, Berlin, 1994. https://doi.org/10.1007/3-540-57956-7_66
Maybank, S., Theory of reconstruction from image motion, Springer Series in Information Sciences, 28. Springer-Verlag, Berlin, 1993. https://doi.org/https://doi.org/10.1007/978-3-642-77557-4
Maybank, S., and Shashua, A., Ambiguity in reconstruction from images of six points, in “Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271)”, 02 1998, 703–708. https://doi.org/10.1109/ICCV.1998.710794
