This paper proposed a multirobot collaborative location algorithm based on a joint semantic constraint model using the characteristics of image semantics, which contained stable environment information. Aided by a semantic segmentation network and the ORB (oriented features from accelerated segment test (FAST) and rotated binary robust independent elementary feature (BRIEF)) extraction algorithm, the proposed algorithm obtained the semantic map points of scenes, used the semantic map points to construct the semantic error function, and constructed a joint semantic constraint model by combining semantic and geometric reprojection errors. Subsequently, the semantic label of feature points combined with feature bag of words (BOW) technology was used to estimate the relative pose of multiple robots, and the multirobot pose trajectory was unified based on the relative pose. Finally, the global pose was optimized by combining the joint semantic constraint model to realize multirobot collaborative localization. Experimental results showed that compared with the current mainstream multirobot collaborative localization algorithm，the proposed algorithm reduced the absolute pose error (APE) by 17.4%, thus demonstrating the applicability of the proposed algorithm to multirobot collaborative scenes.
FANG Haorui
,
ZHANG Jinyi
,
JIANG Yuxi
. Multirobot collaborative location based on joint semantic constraint model[J]. Journal of Shanghai University, 2026
, 32(2)
: 212
-225
.
DOI: 10.12066/j.issn.1007-2861.2525
[1] 陶永, 刘海涛, 王田苗, 等. 我国服务机器人技术研究进展与产业化发展趋势[J]. 机械工程学报, 2022, 58(18): 56-74.
[2] Parker L E. Current research in multirobot systems [J]. Artiflcial Life and Robotics, 2003, 7(1): 1-5.
[3] Ma T, Zhang T, Li S. Multi-robot collaborative SLAM and scene reconstruction based on RGB-D camera [C]// 2020 Chinese Automation Congress (CAC). 2020: 139-144.
[4] Mur-Artal R, Tardos J D. ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras [J]. IEEE Transactions on Robotics, 2017, 33(5): 1255-1262.
[5] Hesch J A, Kottas D G, Bowman S L, et al. Consistency analysis and improvement of vision-aided inertial navigation [J]. IEEE Transactions on Robotics, 2013, 30(1): 158-176.
[6] Kottas D G, Roumeliotis S I. E-cient and consistent vision-aided inertial navigation using line observations [C]// 2013 IEEE International Conference on Robotics and Automation. 2013: 1540-1547.
[7] Henry P, Krainin M, Herbst E, et al. RGB-D mapping: using kinect-style depth cameras for dense 3D modeling of indoor environments [J]. The International Journal of Robotics Research, 2012, 31(5): 647-663.
[8] Bescos B, Fácil J M, Civera J, et al. Dyna-SLAM: tracking, mapping, and inpainting in dynamic scenes [J]. IEEE Robotics and Automation Letters, 2018, 3(4): 4076-4083.
[9] 方哲, 张金艺, 姜玉稀. MR中融合语义特征传播模型的前景对象感知定位算法[J]. 上海大学学报(自然科学版), 2023, 29(1): 41-55.
[10] Yue Y, Zhao C, Li R, et al. A hierarchical framework for collaborative probabilistic semantic mapping [C]// 2020 IEEE International Conference on Robotics and Automation (ICRA). 2020: 9659-9665.
[11] Rublee E, Rabaud V, Konolige K, et al. ORB: an e-cient alternative to SIFT or SURF [C]// 2011 IEEE International Conference on Computer Vision (ICCV). 2011: 2564-2571.
[12] He K, Gkioxari G, Dollar P, et al. Mask R-CNN [C]// Proceedings of the IEEE International Conference on Computer Vision. 2017: 2961-2969.
[13] Sturm J, Engelhard N, Endres F, et al. A benchmark for the evaluation of RGB-D SLAM systems [C]// 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012: 573-580.
