论文中文题名: | 煤矿巷道掘锚一体机捷联惯导与双目视觉组合定位方法研究 |
姓名: | |
学号: | 20205108044 |
保密级别: | 公开 |
论文语种: | chi |
学科代码: | 080402 |
学科名称: | 工学 - 仪器科学与技术 - 测试计量技术及仪器 |
学生类型: | 硕士 |
学位级别: | 工学硕士 |
学位年度: | 2023 |
培养单位: | 西安科技大学 |
院系: | |
专业: | |
研究方向: | 智能检测与控制 |
第一导师姓名: | |
第一导师单位: | |
论文提交日期: | 2023-06-14 |
论文答辩日期: | 2023-06-03 |
论文外文题名: | Research on the Combined Positioning Method of Strapdown Inertial Navigation and Binocular Vision for Coal Mine Tunnel Anchor Digging Robot |
论文中文关键词: | 掘锚一体机 ; “惯导+双目视觉”组合定位 ; 双目视觉测距 ; 立体匹配算法 ; 误差状态卡尔曼滤波 |
论文外文关键词: | digging and anchor integrated machine ; Combined positioning of "inertial navigation+binocular vision" ; Binocular vision ranging ; Stereo matching algorithm ; Error state Kalman filtering |
论文中文摘要: |
掘锚一体机将煤巷掘进和永久支护功能有效结合,大幅提升了掘进效率。目前大多数掘锚一体机钻锚作业的定位基本需要人工完成,存在定位精度和效率低等问题,严重影响掘锚一体机的智能化程度和巷道支护质量。本文针对煤矿巷道掘锚一体机定位难题,提出了掘锚一体机捷联惯导与双目视觉组合定位方法,旨在实现掘锚一体机的自动精准定位。 针对煤矿井下无BD和GPS、巷道空间受限且环境复杂、单一传感器定位难精度低等问题,综合分析了掘锚一体机定位需求与巷道特征,提出了捷联惯导与双目视觉组合的掘锚一体机定位方案。 针对煤矿井下照度低、粉尘高、环境复杂等因素严重影响双目视觉成像质量的问题,提出了一种双目视觉立体匹配视差图获取方法。分析了巷道坐标系-锚杆坐标系-相机坐标系的转换关系,建立了基于巷道特征的分布式锚杆多目标视差原理模型;结合双目立体校正技术对双目图像进行立体校正;基于Census变换算法,提出了改进的绝对像素差Census变换算法,有效提高了图像质量与匹配精度。 针对掘锚一体机在行驶过程中存在行驶位移检测精度低的问题,提出了掘锚一体机双目视觉机身行驶位移检测方法。研究了一种基于双目视觉的已支护锚杆特征点提取方法,获取锚杆视差图的感兴趣区域,采用Sobel算子检测锚杆轮廓;采用组合外接矩形算法,提取图像中的锚杆特征点;建立双目视觉行驶位移检测模型求解掘锚一体机的行驶位移,实现了掘锚一体机行驶位移的精确测量。 针对“惯导+双目视觉”掘锚一体机精准定位信息融合难题,建立了“惯导+双目视觉”的掘锚一体机位姿测量模型,提出了基于误差状态卡尔曼滤波的“惯导+双目视觉”数据融合算法以及掘锚一体机精确定位方法。仿真实验结果表明,该方法能够实现掘锚一体机精准定位。 最后,搭建了“惯导+双目视觉”的掘锚一体机组合定位实验平台,验证“惯导+双目视觉”组合定位方法的有效性与可行性。实验结果表明:本文所研究的组合定位方法能够有效修正单一惯导产生的位姿累积误差,具有较高的定位精度,能够满足煤矿巷道掘锚一体机定位要求。 |
论文外文摘要: |
The digging and anchor integrated machine effectively combines the functions of coal mine roadway driving and permanent support, greatly improving the driving efficiency. At present, most of the positioning of the anchor drilling operation of the digging and anchor integrated machine requires manual completion, which has problems such as low positioning accuracy and low positioning efficiency, seriously affecting the intelligence level of the digging and anchor integrated machine and the quality of roadway support. In this thesis, aiming at the positioning problem of the driving and anchoring machine in coal mine roadway, a combined positioning method of strapdown inertial navigation and binocular vision is proposed to realize the automatic and accurate positioning of the driving and anchoring machine. Aiming at the problems of coal mines without BD and GPS, limited coal mine roadway space and complex environment, and low positioning accuracy with a single sensor, a comprehensive analysis was conducted on the positioning requirements and coal mine roadway characteristics of the digging and anchor integrated machine, a positioning scheme for the digging and anchor integrated machine combining strapdown inertial navigation and binocular vision is proposed. Aiming at the serious impact of factors such as low illumination, high dust, and complex environment in coal mine roadway on the quality of binocular visual imaging, a positioning method of binocular stereo matching disparity map acquisition method is proposed. Analyzed the transformation relationship between the coal mine roadway coordinate system, anchor rod coordinate system, and camera coordinate system, and established a distributed anchor rod multi-objective parallax principle model based on coal mine roadway features; Combining binocular stereo correction technology to perform stereo correction on binocular images; Based on the Census transform algorithm, an improved absolute pixel difference Census transform algorithm is proposed, which effectively improves image quality and matching accuracy. Aiming at the problem of low detection accuracy of travel displacement during the driving process of the digging and anchor integrated machine, a positioning method of binocular vision method for detecting the travel displacement of the digging and anchor integrated machine is proposed. A feature point extraction method for supported anchor rods based on binocular vision was studied to obtain the region of interest of the anchor rod disparity map, using the Sobel operator to detect the contour of the anchor rods; Using the combined bounding rectangle algorithm to extract anchor feature points in the image; Establish a binocular vision driving displacement detection model to solve the driving displacement of the anchor excavator, and achieve accurate measurement of the driving displacement of the anchor excavator. Aiming at the problem of precise positioning information fusion for the "inertial navigation+binocular vision" digging and anchor integrated machine, establish a pose measurement model for the "inertial navigation+binocular vision" anchor and digging integrated machine. A positioning method of data fusion algorithm based on error state Kalman filtering for the "inertial navigation+binocular vision" and a precise positioning method for the digging and anchor integrated machine is proposed. The simulation experimental results show that this method can achieve precise positioning of the digging and anchor integrated machine. Finally, building the combined positioning experimental platform of "inertial navigation+binocular vision" for the digging and anchor integrated machine, and verifying the effectiveness and feasibility of the combined positioning method. The experimental results show that the combined positioning method can effectively correct the cumulative error of a single inertial navigation system, it has high positioning accuracy and can meet the positioning requirements of the coal mine roadway excavation anchor integrated machine. |
参考文献: |
[1]袁亮,张平松.煤炭精准开采地质保障技术的发展现状及展望[J].煤炭学报,2019,44(08):2277-2284. [2]王国法,刘峰,庞义辉,等.煤矿智能化——煤炭工业高质量发展的核心技术支撑[J].煤炭学报,2019,44(02):349-357. [3]邢震,韩安,陈晓晶,等.基于工业互联网的智能矿山灾害数字孪生研究[J].工矿自动化,2023,49(02):23-30+55. [4]王国法,任世华,庞义辉,等.煤炭工业“十三五”发展成效与“双碳”目标实施路径[J].煤炭科学技术,2021,49(09):1-8. [5]袁亮,张农,阚甲广,等.我国绿色煤炭资源量概念、模型及预测[J].中国矿业大学学报,2018,47(01):1-8. [6]李飞,张林,尚宇琦,等.煤矿智能化掘进关键技术研究[J/OL].工矿自动化:1-10[2023-04-13]. [8]邢震,韩安,陈晓晶,等.基于工业互联网的智能矿山灾害数字孪生研究[J].工矿自动化,2023,49(02):23-30+55. [10]贾建称,贾茜,桑向阳,等.我国煤矿地质保障系统建设30年:回顾与展望[J].煤田地质与勘探,2023,51(01):86-106. [13]王国法,庞义辉,任怀伟,等.煤炭安全高效综采理论、技术与装备的创新和实践[J]. 煤炭学报,2018,43(04):903-913. [14]李刚.煤矿巷道快速掘进工艺及设备配套现状与应用[J].煤炭技术,2022,41(04):32-34. [15]马宏伟,毛金根,毛清华,等.基于惯导/全站仪组合的掘进机自主定位定向方法[J]. 煤炭科学技术,2022,50(08):189-195. [19]毛清华,安炎基,马宏伟,等.煤矿掘进装备光纤惯导多源异构噪声降噪方法研究[J/OL].煤炭科学技术:1-11[2022-11-17]. [20]杨文娟,张旭辉,张超,等.基于三激光束标靶的煤矿井下长距离视觉定位方法[J]. 煤炭学报,2022,47(02):986-1001. [21]薛光辉,李圆,张云飞.基于激光靶向跟踪的悬臂式掘进机位姿测量系统研究[J].工矿自动化,2022,48(07):13-21. [22]杨秀宇.基于光电传感器的掘进机位姿测量方法[J].机械设计,2022,39(07):117-121. [23]杜雨馨.矿井悬臂式掘进机位姿感知及定位方法研究[D].北京:中国矿业大学,2019. [25]杨林,马宏伟,王岩.基于激光惯性融合的煤矿井下移动机器人SLAM算法[J].煤炭学报,2022,47(09):3523-3534. [26]曹波,王世博,葛世荣,等.基于超宽带系统的采煤机端头定位策略及定位技术研究[J].煤炭科学技术,2022,50(03):257-266. [27]郁露,唐超礼,黄友锐,等.基于UWB和IMU的煤矿机器人紧组合定位方法研究[J].工矿自动化,2022,48(12):79-85. [28]窦学丽,牛永刚,殷鹏,等.煤矿井下超宽带信号路径损耗测量与分析[J].工矿自动化,2020,46(10):99-103. [29]刘鹏飞.里程计辅助的高精度车载GNSS/INS组合导航系统[J].光学精密工程,2020,28(04):979-987. [30]马宏伟,张璞,毛清华,等.基于捷联惯导和里程计的井下机器人定位方法研究[J].工矿自动化,2019,45(04):38-45. [31]刘博兴.煤矿井下全站仪定位与设备姿态角测量方法研究[D].西安:西安科技大学,2021. [33]张旭辉,刘博兴,张超,等.掘进机全站仪与捷联惯导组合定位方法[J].工矿自动化,2020,46(09):1-7. [34]朱信平,李睿,高娟,等.基于全站仪的掘进机机身位姿参数测量方法[J].煤炭工程,2011(06):113-115. [35]徐硕,姜言清,李晔,等.智能水下机器人自主回收的双目视觉定位[J].哈尔滨工程大学学报,2022,43(08):1084-1090. [36]周红旭.井下悬臂式掘进机及截割部定位技术[D].邯郸:河北工程大学,2022. [37]孙海军.基于磁场和双目视觉的掘进机截割部组合定位技术研究[D].邯郸:河北工程大学,2022. [38]薛旭升,任众孚,毛清华,等.基于数字孪生的煤矿掘进机器人纠偏控制研究[J].工矿自动化,2022,48(01):26-32. [39]纪志敏.基于运动约束的采煤机惯性导航系统技术研究[D].太原:中北大学,2022. [40]武俊,刘瀚文.基于捷联惯导系统的采煤机定位方法[J].工矿自动化,2021,47(S2):19-22. [41]吴刚.基于捷联惯导的采煤机运行姿态高精度感知理论与技术研究[D].北京:中国矿业大学,2020. [42]张成林,王亚慧,张秋逸.基于捷联惯导的蛇形管道机器人定位算法[J].科学技术与工程,2022,22(12):4872-4878. [45]韩燕.基于LML模型的图像特征提取算法研究[D].唐山:华北理工大学,2022. [46]姚依妮,王玮.Harris角点检测算法的应用研究[J].智能计算机与应用,2022,12(08):148-151. [48]周东新.基于显著性检测的ORB特征提取算法优化[D].北京:中国矿业大学,2022. [51]康传利,兰猗令,王宁,等.一种结合SIFT与3D Hough变换的建筑物屋顶点云分割方法[J].遥感信息,2022,37(05):31-37. [52]刘源,夏春蕾.一种基于Sobel算子的带钢表面缺陷图像边缘检测算法[J].电子测量技术,2021,44(03):138-143. [53]宋培玉,王森.改进Census立体匹配算法研究综述[J].华东交通大学学报,2022,39(01):116-125. [54]尹萍,徐爱俊,尹建新.基于改进SGM的立木视差图生成方法[J].激光与光电子学进展,2022,59(18):372-381. [55]黄超,赵华治.根据灰度值信息自适应窗口的半全局匹配[J].中国图象图形学报, 2019,24(08):1381-1390. [58]李大华,沈洪宇,于晓,等.一种改进Census变换的双目匹配测距方法[J].激光与光电子学进展,2019,56(11):197-202. [59]杨敬钰,谢天昊,岳焕景.基于多层级跨模态特征融合的深度图重建算法[J].华中科技大学学报(自然科学版),2023,51(03):52-59. [60]王广建.RGBD视觉场景深度图像修复与三维重建关键技术研究[D].南昌:江西理工大学,2022. [62]张晨龙.基于立体视觉与惯性导航的SLAM系统研究[D].北京:北京建筑大学, 2022. [64]郭庆尧,林嘉睿,任永杰,等.基于激光标靶和捷联惯导系统组合位姿测量方法[J].激光与光电子学进展,2018,55(01):322-329. [65]曹波.采煤机惯导与超宽带融合定位方法研究[D].北京:中国矿业大学,2022. [66]石金龙.惯导与里程计组合的综采工作面直线度测量技术研究[D].西安:西安科技大学,2021. [67]毛金根.煤矿巷道掘进机器人捷联惯导与数字全站仪组合定位系统研究[D].西安:西安科技大学,2021. [68]孙志鹏.基于双目视觉与惯导融合的移动机器人定位系统研究[D].青岛:青岛科技大学,2022. [69]许智宾,李宏伟,张斌,等.双目视觉与惯导融合的移动机器人定位方法[J].测绘学报,2021,50(11):1512-1521. [70]崔玉明.煤矿巷道掘进机视觉/惯性融合自主定位关键技术研究[D].北京:中国矿业大学,2021. [71]张超.悬臂式掘进机双目视觉与捷联惯导组合定位技术研究[D].西安:西安科技大学,2020. [72]邹汉达,袁洪.视觉辅助下的室内惯导位姿修正[J].测绘通报,2019(05):16-20. [73]康红普,姜鹏飞,刘畅,等.煤巷锚杆支护施工装备现状及发展趋势[J].工矿自动化,2023,49(01):1-18. [74]董庆,蔡志炯,赵洪.掘锚一体机在特厚煤层大断面回采巷道支护中的应用[J].煤炭工程,2018,50(12):35-40. [75]曾伟伟.复杂构造区穿层巷道支护参数设计[J].煤炭技术,2023,42(02):107-111. [76]骆元庆,何涛,王传礼,等.巷道临时支护支架同步阀阀腔气蚀特性研究[J].煤炭工程,2023,55(01):100-105. [77]韩龙.全断面矩形高效快速掘进巷道支护方案优化[J].煤炭工程,2017,49(12):61-65. [78]黄文文,彭小红,李丽圆,等.相机标定方法及进展研究综述[J/OL].激光与光电子学进展:1-17[2022-11-17]. [85]虞文杰,叶嵩,郭毓,等.基于改进Census变换与多特征融合的立体匹配算法[J].激光与光电子学进展,2022,59(08):157-163. [88]谢孟辛,张捍卫,李鹏杰,等.基于整体最小二乘原理的GPS轨道坐标拟合[J].导航定位学报,2021,9(04):11-18. [89]余哲琳.基于视觉惯导融合的智能车辆定位技术研究[D].成都:电子科技大学, 2022. [90]田伟琴.基于视觉-惯导组合的掘进机定位方法研究与试验[D].北京:煤炭科学研究总院,2022. [91]方怀.捷联惯导姿态算法研究与应用[D].北京:中国矿业大学,2022. |
中图分类号: | TD421/TP212.9 |
开放日期: | 2023-06-14 |