A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments

Jin-wen HU; Bo-yin ZHENG; Ce WANG; Chun-hui ZHAO; Xiao-lei HOU; Quan PAN; Zhao XU

doi:10.1631/FITEE.1900518

Your Location：

Home >

Browse articles >

A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments

Special Issue on Intelligent Unmanned Systems | Updated：2022-05-19

- A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments
- 基于多传感器融合的智能车在野外环境中的障碍物检测研究
- Frontiers of Information Technology & Electronic Engineering Vol. 21, Issue 5, Pages: 675-692(2020)
- Affiliations：
  
  Key Laboratory of Information Fusion Technology, Northwestern Polytechnical University, Xi'an 710072, China
- Author bio：
  
  [ "Jin-wen HU, E-mail: hujinwen@nwpu.edu.cn" ]
  Bo-yin ZHENG, E-mail: zhengboyin@mail.nwpu.edu.cn
- Funds：
- DOI：10.1631/FITEE.1900518
  CLC： TP242.6
- Received：24 September 2019，
  
  Revised：2020-;4-;1，
  
  Published：2020-05
- Accepted：
Scan QR Code
Jin-wen HU, Bo-yin ZHENG, Ce WANG, et al. A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments[J]. Frontiers of Information Technology & Electronic Engineering, 2020, 21(5): 675-692.
DOI：

Jin-wen HU, Bo-yin ZHENG, Ce WANG, et al. A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments[J]. Frontiers of Information Technology & Electronic Engineering, 2020, 21(5): 675-692. DOI： 10.1631/FITEE.1900518.

摘要

随着传感器融合技术发展，人们对智能地面车辆进行大量研究，其中障碍物检测是一个关键技术。障碍物检测是一项复杂任务，涉及多种障碍物、传感器特性和环境条件。虽然道路驾驶员辅助系统或自动驾驶系统已得到充分研究，但是为城市场景结构化道路开发的方法应用于野外环境时，可能因不确定性和多样性而失效。单一类型传感器由于感受范围、信号特征和检测环境的限制，难以满足障碍物检测需求，这促使研究人员和工程师开发多传感器融合方法和系统集成。该综述旨在总结野外环境中智能地面车辆的车载多传感器配置的主要考虑事项，为用户提供根据性能要求和应用环境选择传感器的指南。本文回顾了最新多传感器融合方法和系统原型，将其与对应的异构传感器配置相关联，讨论了新兴技术和面临的挑战。

Abstract

With the development of sensor fusion technologies

there has been a lot of research on intelligent ground vehicles

where obstacle detection is one of the key aspects of vehicle driving. Obstacle detection is a complicated task

which involves the diversity of obstacles

sensor characteristics

and environmental conditions. While the on-road driver assistance system or autonomous driving system has been well researched

the methods developed for the structured road of city scenes may fail in an off-road environment because of its uncertainty and diversity. A single type of sensor finds it hard to satisfy the needs of obstacle detection because of the sensing limitations in range

signal features

and working conditions of detection

and this motivates researchers and engineers to develop multi-sensor fusion and system integration methodology. This survey aims at summarizing the main considerations for the onboard multi-sensor configuration of intelligent ground vehicles in the off-road environments and providing users with a guideline for selecting sensors based on their performance requirements and application environments. State-of-the-art multi-sensor fusion methods and system prototypes are reviewed and associated to the corresponding heterogeneous sensor configurations. Finally

emerging technologies and challenges are discussed for future study.

关键词

Keywords

references

B Arbanas , , , A Ivanovic , , , M Car , , , 等 . . Decentralized planning and control for UAV-UGV cooperative teams . . Auton Robot , , 2018 . . 42 ( ( 8 ): ): 1601 - - 1618 . . DOI: 10.1007/s10514-018-9712-y http://doi.org/10.1007/s10514-018-9712-y . .

E Arnold , , , OY Al-Jarrah , , , M Dianati , , , 等 . . A survey on 3D object detection methods for autonomous driving applications . . IEEE Trans Intell Trans Syst , , 2019 . . 20 ( ( 10 ): ): 3782 - - 3795 . . DOI: 10.1109/TITS.2019.2892405 http://doi.org/10.1109/TITS.2019.2892405 . .

A Asvadi , , , P Girão , , , P Peixoto , , , 等 . . 3D object tracking using RGB and LIDAR data . . IEEE 19$^{\rm th}$ Int Conf on Intelligent Transportation Systems , , 2016 . . p.1255 - - 1260 . . DOI: 10.1109/ITSC.2016.7795718 http://doi.org/10.1109/ITSC.2016.7795718 . .

R Aufrère , , , J Gowdy , , , C Mertz , , , 等 . . Perception for collision avoidance and autonomous driving . . Mechatronics , , 2003 . . 13 ( ( 10 ): ): 1149 - - 1161 . . DOI: 10.1016/S0957-4158(03)00047-3 http://doi.org/10.1016/S0957-4158(03)00047-3 . .

S Avidan . . Support vector tracking . . IEEE Trans Patt Anal Mach Intell , , 2004 . . 26 ( ( 8 ): ): 1064 - - 1072 . . DOI: 10.1109/TPAMI.2004.53 http://doi.org/10.1109/TPAMI.2004.53 . .

A Azim , , , O Aycard . . Detection, classification and tracking of moving objects in a 3D environment . . IEEE Intelligent Vehicles Symp , , 2012 . . p.802 - - 807 . . DOI: 10.1109/IVS.2012.6232303 http://doi.org/10.1109/IVS.2012.6232303 . .

Q Baig , , , O Aycard , , , TD Vu , , , 等 . . Fusion between laser and stereo vision data for moving objects tracking in intersection like scenario . . IEEE Intelligent Vehicles Symp , , 2011 . . p.362 - - 367 . . DOI: 10.1109/IVS.2011.5940576 http://doi.org/10.1109/IVS.2011.5940576 . .

M Bajracharya , , , J Ma , , , M Malchano , , , 等 . . High fidelity day/night stereo mapping with vegetation and negative obstacle detection for vision-in-the-loop walking . . IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2013 . . p.3663 - - 3670 . . DOI: 10.1109/IROS.2013.6696879 http://doi.org/10.1109/IROS.2013.6696879 . .

I Bogoslavskyi , , , C Stachniss . . Efficient online segmentation for sparse 3D laser scans . . PFG J Photogramm Remote Sens Geoinform Sci , , 2017 . . 85 ( ( 1 ): ): 41 - - 52 . . DOI: 10.1007/s41064-016-0003 http://doi.org/10.1007/s41064-016-0003 . .

A Bosch , , , A Zisserman , , , X Munoz . . Representing shape with a spatial pyramid kernel . . 6$^{\rm th}$ ACM Int Conf on Image and Video Retrieval , , 2007 . . p.401 - - 408 . . DOI: 10.1145/1282280.1282340 http://doi.org/10.1145/1282280.1282340 . .

CJC Burges . . A tutorial on support vector machines for pattern recognition . . Data Min Knowl Discov , , 1998 . . 2 ( ( 2 ): ): 121 - - 167 . . DOI: 10.1023/A:1009715923555 http://doi.org/10.1023/A:1009715923555 . .

C Cadena , , , L Carlone , , , H Carrillo , , , 等 . . Past, present, and future of simultaneous localization and mapping: toward the robust-perception age . . IEEE Trans Robot , , 2016 . . 32 ( ( 6 ): ): 1309 - - 1332 . . DOI: 10.1109/TRO.2016.2624754 http://doi.org/10.1109/TRO.2016.2624754 . .

ZW Cai , , , QF Fan , , , RS Feris , , , 等 . . A unified multi-scale deep convolutional neural network for fast object detection . . Proc 14$^{\rm th}$ European Conf on Computer Vision , , 2016 . . p.354 - - 370 . . DOI: 10.1007/978-3-319-46493-0_22 http://doi.org/10.1007/978-3-319-46493-0_22 . .

J Castorena , , , US Kamilov , , , PT Boufounos . . Autocalibration of lidar and optical cameras via edge alignment . . Proc Int Conf on Acoustics, Speech and Signal Processing , , 2016 . . p.2862 - - 2866 . . DOI: 10.1109/ICASSP.2016.7472200 http://doi.org/10.1109/ICASSP.2016.7472200 . .

RO Chavez-Garcia . . Multiple Sensor Fusion for Detection, Classification and Tracking of Moving Objects in Driving Environments . . PhD Thesis, Université de Grenoble, Grenoble, France , , 2014 . . .

L Chen , , , J Yang , , , H Kong . . Lidar-histogram for fast road and obstacle detection . . Proc IEEE Int Conf on Robotics and Automation , , 2017 . . p.1343 - - 1348 . . DOI: 10.1109/ICRA.2017.7989159 http://doi.org/10.1109/ICRA.2017.7989159 . .

XZ Chen , , , HM Ma , , , J Wan , , , 等 . . Multi-view 3D object detection network for autonomous driving . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2017 . . p.6526 - - 6534 . . DOI: 10.1109/CVPR.2017.691 http://doi.org/10.1109/CVPR.2017.691 . .

H Cho , , , YW Seo , , , BVKV Kumar , , , 等 . . A multi-sensor fusion system for moving object detection and tracking in urban driving environments . . Proc IEEE Int Conf on Robotics and Automation , , 2014 . . p.1836 - - 1843 . . DOI: 10.1109/ICRA.2014.6907100 http://doi.org/10.1109/ICRA.2014.6907100 . .

P del Moral , , , A Doucet , , , A Jasra . . An adaptive sequential Monte Carlo method for approximate Bayesian computation . . Stat Comput , , 2012 . . 22 ( ( 5 ): ): 1009 - - 1020 . . DOI: 10.1007/s11222-011-9271-y http://doi.org/10.1007/s11222-011-9271-y . .

T Denoeux . . A neural network classifier based on Dempster-Shafer theory . . IEEE Trans Syst Man Cybern Part A , , 2000 . . 30 ( ( 2 ): ): 131 - - 150 . . DOI: 10.1109/3468.833094 http://doi.org/10.1109/3468.833094 . .

KC Dey , , , A Rayamajhi , , , M Chowdhury , , , 等 . . Vehicle- to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication in a heterogeneous wireless network---performance evaluation . . Trans Res Part C , , 2016 . . 68 ( ( 7 ): ): 168 - - 184 . . DOI: 10.1016/j.trc.2016.03.008 http://doi.org/10.1016/j.trc.2016.03.008 . .

B Douillard , , , A Brooks , , , F Ramos . . A 3D laser and vision based classifier . . Int Conf on Intelligent Sensors, Sensor Networks and Information Processing , , 2009 . . p.295 - - 300 . . DOI: 10.1109/ISSNIP.2009.5416828 http://doi.org/10.1109/ISSNIP.2009.5416828 . .

A Elfes . . Using occupancy grids for mobile robot perception and navigation . . Computer , , 1989 . . 22 ( ( 6 ): ): 46 - - 57 . . DOI: 10.1109/2.30720 http://doi.org/10.1109/2.30720 . .

C Fernández , , , M Gavilán , , , DF Llorca , , , 等 . . Free space and speed humps detection using lidar and vision for urban autonomous navigation . . Proc IEEE Intelligent Vehicles Symp , , 2012 . . p.698 - - 703 . . DOI: 10.1109/IVS.2012.6232255 http://doi.org/10.1109/IVS.2012.6232255 . .

H Fourati . . Multisensor Data Fusion: from Algorithms and Architectural Design to Applications , , : : Boca Raton, USA CRC Press , , 2015 . . DOI: 10.1201/b18851 http://doi.org/10.1201/b18851 . .

R Fukatsu , , , K Sakaguchi . . Millimeter-wave V2V communications with cooperative perception for automated driving . . IEEE 89$^{\rm th}$ Vehicular Technology Conf , , 2019 . . p.1 - - 5 . . DOI: 10.1109/VTCSpring.2019.8746344 http://doi.org/10.1109/VTCSpring.2019.8746344 . .

F García , , , J García , , , A Ponz , , , 等 . . Context aided pedestrian detection for danger estimation based on laser scanner and computer vision . . Expert Syst Appl , , 2014 . . 41 ( ( 15 ): ): 6646 - - 6661 . . DOI: 10.1016/j.eswa.2014.04.034 http://doi.org/10.1016/j.eswa.2014.04.034 . .

AI García-Moreno , , , JJ Gonzalez-Barbosa , , , FJ Ornelas-Rodriguez , , , 等 . . LIDAR and panoramic camera extrinsic calibration approach using a pattern plane . . Proc 5$^{\rm th}$ Mexican Conf on Pattern Recognition , , 2013 . . p.104 - - 113 . . DOI: 10.1007/978-3-642-38989-4_11 http://doi.org/10.1007/978-3-642-38989-4_11 . .

A Gning , , , F Abdallah , , , P Bonnifait . . A new estimation method for multisensor fusion by using interval analysis and particle filtering . . Proc IEEE Int Conf on Robotics and Automation , , 2007 . . p.3844 - - 3849 . . DOI: 10.1109/ROBOT.2007.364068 http://doi.org/10.1109/ROBOT.2007.364068 . .

XJ Gong , , , Y Lin , , , JL Liu . . Extrinsic calibration of a 3D LIDAR and a camera using a trihedron . . Opt Laser Eng , , 2013a . . 51 ( ( 4 ): ): 394 - - 401 . . DOI: 10.1016/j.optlaseng.2012.11.015 http://doi.org/10.1016/j.optlaseng.2012.11.015 . .

XJ Gong , , , Y Lin , , , JL Liu . . 3D LIDAR-camera extrinsic calibration using an arbitrary trihedron . . Sensors , , 2013b . . 13 ( ( 2 ): ): 1902 - - 1918 . . DOI: 10.3390/s130201902 http://doi.org/10.3390/s130201902 . .

A González , , , Z Fang , , , Y Socarras , , , 等 . . Pedestrian detection at day/night time with visible and FIR cameras: a comparison . . Sensors , , 2016 . . 16 ( ( 6 ): ): 820 DOI: 10.3390/s16060820 http://doi.org/10.3390/s16060820 . .

B Grabe , , , T Ike , , , M Hoetter . . Evaluation method of grid based representation from sensor data . . Proc IEEE Intelligent Vehicles Symp , , 2009 . . p.1245 - - 1250 . . DOI: 10.1109/IVS.2009.5164461 http://doi.org/10.1109/IVS.2009.5164461 . .

R Hadsell , , , JA Bagnell , , , D Huber , , , 等 . . Space-carving kernels for accurate rough terrain estimation . . Int J Robot Res , , 2010 . . 29 ( ( 8 ): ): 981 - - 996 . . DOI: 10.1177/0278364910369996 http://doi.org/10.1177/0278364910369996 . .

M Häselich , , , M Arends , , , D Lang , , , 等 . . Terrain classification with Markov random fields on fused camera and 3D laser range data . . Proc 5$^{\rm th}$ European Conf on Mobile Robots , , 2011 . . p.153 - - 158 . . . .

J Hosang , , , R Benenson , , , P Dollár , , , 等 . . What makes for effective detection proposals . . IEEE Trans Patt Anal Mach Intell , , 2016 . . 38 ( ( 4 ): ): 814 - - 830 . . DOI: 10.1109/TPAMI.2015.2465908 http://doi.org/10.1109/TPAMI.2015.2465908 . .

X Hu , , , FSA Rodriguez , , , A Gepperth . . A multi-modal system for road detection and segmentation . . Proc IEEE Intelligent Vehicles Symp , , 2014 . . p.1365 - - 1370 . . DOI: 10.1109/IVS.2014.6856466 http://doi.org/10.1109/IVS.2014.6856466 . .

S Hwang , , , J Park , , , N Kim , , , 等 . . Multispectral pedestrian detection: benchmark dataset and baseline . . Proc IEEE Conf on Computer Vision and Pattern Recognition , , 2015 . . p.1037 - - 1045 . . DOI: 10.1109/CVPR.2015.7298706 http://doi.org/10.1109/CVPR.2015.7298706 . .

M Iqbal , , , M Morel , , , F Meriaudeau . . A survey on outdoor water hazard detection . . 5$^{\rm th}$ Int Conf on Information and Communication Technology and Systems , , 2009 . . p.33 - - 39 . . . .

X Jing , , , ZC Du , , , F Li . . Obstacle detection by Doppler frequency shift . . Electron Sci Technol , , 2013 . . 26 ( ( 8 ): ): 57 - - 60 . . DOI: 10.3969/j.issn.1007-7820.2013.08.018 http://doi.org/10.3969/j.issn.1007-7820.2013.08.018 . .

N Kaempchen , , , M Buehler , , , K Dietmayer . . Feature-level fusion for free-form object tracking using laserscanner and video . . Proc IEEE Intelligent Vehicles Symp , , 2005 . . p.453 - - 458 . . DOI: 10.1109/IVS.2005.1505145 http://doi.org/10.1109/IVS.2005.1505145 . .

H Karunasekera , , , H Zhang , , , T Xi , , , 等 . . Stereo vision based negative obstacle detection . . Proc 13$^{\rm th}$ IEEE Int Conf on Control and Automation , , 2017 . . p.834 - - 838 . . DOI: 10.1109/ICCA.2017.8003168 http://doi.org/10.1109/ICCA.2017.8003168 . .

JB Kenney . . Dedicated short-range communications (DSRC) standards in the United States . . Proc IEEE , , 2011 . . 99 ( ( 7 ): ): 1162 - - 1182 . . DOI: 10.1109/JPROC.2011.2132790 http://doi.org/10.1109/JPROC.2011.2132790 . .

B Khaleghi , , , A Khamis , , , FO Karray , , , 等 . . Multisensor data fusion: a review of the state-of-the-art . . Inform Fus , , 2013 . . 14 ( ( 1 ): ): 28 - - 44 . . DOI: 10.1016/j.inffus.2011.08.001 http://doi.org/10.1016/j.inffus.2011.08.001 . .

J Kim , , , DS Han , , , B Senouci . . Radar and vision sensor fusion for object detection in autonomous vehicle surroundings . . Proc IEEE 10$^{\rm th}$ Int Conf on Ubiquitous and Future Networks , , 2018 . . p.76 - - 78 . . DOI: 10.1109/ICUFN.2018.8436959 http://doi.org/10.1109/ICUFN.2018.8436959 . .

JH Kim , , , JW Starr , , , BY Lattimer . . Firefighting robot stereo infrared vision and radar sensor fusion for imaging through smoke . . Fire Technol , , 2015 . . 51 ( ( 4 ): ): 823 - - 845 . . DOI: 10.1007/s10694-014-0413-6 http://doi.org/10.1007/s10694-014-0413-6 . .

J Krafcik . . Where the Next 10 Million Miles Will Take Us at Waymo . . 2018 . . https://santansun.com/2018/10/23/where-the-next-10-million-miles-will-take-us-at-waymo/ https://santansun.com/2018/10/23/where-the-next-10-million-miles-will-take-us-at-waymo/ , , [Accessed on Jan. 15, 2020] . .

J Ku , , , M Mozifian , , , J Lee , , , 等 . . Joint 3D proposal generation and object detection from view aggregation . . Proc IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2018 . . p.1 - - 8 . . DOI: 10.1109/IROS.2018.8594049 http://doi.org/10.1109/IROS.2018.8594049 . .

R Labayrade , , , D Aubert , , , JP Tarel . . Real time obstacle detection in stereovision on non flat road geometry through "V-disparity" representation . . Proc IEEE Intelligent Vehicle Symp , , 2002 . . p.646 - - 651 . . DOI: 10.1109/IVS.2002.1188024 http://doi.org/10.1109/IVS.2002.1188024 . .

D Lahat , , , T Adali , , , C Jutten . . Multimodal data fusion: an overview of methods, challenges, and prospects . . Proc IEEE , , 2015 . . 103 ( ( 9 ): ): 1449 - - 1477 . . DOI: 10.1109/JPROC.2015.2460697 http://doi.org/10.1109/JPROC.2015.2460697 . .

J Larson , , , M Trivedi . . Lidar based off-road negative obstacle detection and analysis . . Proc 14$^{\rm th}$ Int IEEE Conf on Intelligent Transportation Systems , , 2011 . . p.192 - - 197 . . DOI: 10.1109/ITSC.2011.6083105 http://doi.org/10.1109/ITSC.2011.6083105 . .

J Levinson , , , S Thrun . . Automatic online calibration of cameras and lasers . . Proc Robotics: Science and Systems , , 2013 . . p.1 - - 8 . . DOI: 10.15607/RSS.2013.IX.029 http://doi.org/10.15607/RSS.2013.IX.029 . .

JQ Li , , , GQ Deng , , , CW Luo , , , 等 . . A hybrid path planning method in unmanned air/ground vehicle (UAV/UGV) cooperative systems . . IEEE Trans Veh Technol , , 2016 . . 65 ( ( 12 ): ): 9585 - - 9596 . . DOI: 10.1109/TVT.2016.2623666 http://doi.org/10.1109/TVT.2016.2623666 . .

QQ Li , , , L Chen , , , M Li , , , 等 . . A sensor-fusion drivable-region and lane-detection system for autonomous vehicle navigation in challenging road scenarios . . IEEE Trans Veh Technol , , 2014 . . 63 ( ( 2 ): ): 540 - - 555 . . DOI: 10.1109/TVT.2013.2281199 http://doi.org/10.1109/TVT.2013.2281199 . .

THS Li , , , YC Yeh , , , JD Wu , , , 等 . . Multifunctional intelligent autonomous parking controllers for carlike mobile robots . . IEEE Trans Ind Electron , , 2010 . . 57 ( ( 5 ): ): 1687 - - 1700 . . DOI: 10.1109/TIE.2009.2033093 http://doi.org/10.1109/TIE.2009.2033093 . .

K Lim , , , KM Tuladhar . . LIDAR: lidar information based dynamic V2V authentication for roadside infrastructure-less vehicular networks . . Proc 16$^{\rm th}$ IEEE Annual Consumer Communications and Networking Conf , , 2019 . . p.1 - - 6 . . DOI: 10.1109/CCNC.2019.8651684 http://doi.org/10.1109/CCNC.2019.8651684 . .

HP Liu , , , FC Sun . . Fusion tracking in color and infrared images using joint sparse representation . . Sci China Inform Sci , , 2012 . . 55 ( ( 3 ): ): 590 - - 599 . . DOI: 10.1007/s11432-011-4536-9 http://doi.org/10.1007/s11432-011-4536-9 . .

JY Ma , , , Y Ma , , , C Li . . Infrared and visible image fusion methods and applications: a survey . . Inform Fus , , 2019 . . 45 ( ( 1 ): ): 153 - - 178 . . DOI: 10.1016/j.inffus.2018.02.004 http://doi.org/10.1016/j.inffus.2018.02.004 . .

S Majumder , , , DK Pratihar . . Multi-sensors data fusion through fuzzy clustering and predictive tools . . Expert Syst Appl , , 2018 . . 107 ( ( 04 ): ): 165 - - 172 . . DOI: 10.1016/j.eswa.2018.04.026 http://doi.org/10.1016/j.eswa.2018.04.026 . .

L Matthies , , , A Rankin . . Negative obstacle detection by thermal signature . . Proc IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2003 . . p.906 - - 913 . . DOI: 10.1109/IROS.2003.1250744 http://doi.org/10.1109/IROS.2003.1250744 . .

L Matthies , , , A Kelly , , , T Litwin , , , 等 . . Obstacle detection for unmanned ground vehicles: a progress report . . Proc Intelligent Vehicles Symp , , 1995 . . p.66 - - 71 . . DOI: 10.1109/IVS.1995.528259 http://doi.org/10.1109/IVS.1995.528259 . .

LH Matthies , , , P Bellutta , , , M McHenry . . Detecting water hazards for autonomous off-road navigation . . Unmanned Ground Vehicle Technology V , , 2003 . . p.231 - - 243 . . DOI: 10.1117/12.496942 http://doi.org/10.1117/12.496942 . .

M Montemerlo , , , S Thrun . . Large-scale robotic 3-D mapping of urban structures . . In: Ang MHJr, Khatib O (Eds.), Experimental Robotics IX. Springer, Berlin , , 2006 . . p.141 - - 150 . . DOI: 10.1007/11552246_14 http://doi.org/10.1007/11552246_14 . .

RD Morton , , , E Olson . . Positive and negative obstacle detection using the HLD classifier . . Proc IEEE/RSJ Int Conf on Intelligent Robots and Systems , , 2011 . . p.1579 - - 1584 . . DOI: 10.1109/IROS.2011.6095142 http://doi.org/10.1109/IROS.2011.6095142 . .

FDP Müller . . Survey on ranging sensors and cooperative techniques for relative positioning of vehicles . . Sensors , , 2017 . . 17 ( ( 2 ): ): 271 DOI: 10.3390/s17020271 http://doi.org/10.3390/s17020271 . .

FDP Müller , , , EM Diaz , , , I Rashdan . . Cooperative positioning and radar sensor fusion for relative localization of vehicles . . Proc IEEE Intelligent Vehicles Symp , , 2016 . . p.1060 - - 1065 . . DOI: 10.1109/IVS.2016.7535520 http://doi.org/10.1109/IVS.2016.7535520 . .

A Napier , , , P Corke , , , P Newman . . Cross-calibration of push-broom 2D LIDARs and cameras in natural scenes . . Proc IEEE Int Conf on Robotics and Automation , , 2013 . . p.3679 - - 3684 . . DOI: 10.1109/ICRA.2013.6631094 http://doi.org/10.1109/ICRA.2013.6631094 . .

H Nguyen , , , V Tran , , , T Nguyen , , , 等 . . Apprenticeship bootstrapping via deep learning with a safety net for UAV-UGV interaction . . 2018 . . https://arxiv.org/abs/1810.04344 https://arxiv.org/abs/1810.04344 , , . .

Y Park , , , S Yun , , , CS Won , , , 等 . . Calibration between color camera and 3D LIDAR instruments with a polygonal planar board . . Sensors , , 2014 . . 14 ( ( 3 ): ): 5333 - - 5353 . . DOI: 10.3390/s140305333 http://doi.org/10.3390/s140305333 . .

D Pfeiffer , , , U Franke . . Modeling dynamic 3D environments by means of the stixel world . . IEEE Intell Trans Syst Mag , , 2011 . . 3 ( ( 3 ): ): 24 - - 36 . . DOI: 10.1109/MITS.2011.942207 http://doi.org/10.1109/MITS.2011.942207 . .

N Pinchon , , , O Cassignol , , , A Nicolas , , , 等 . . All-weather vision for automotive safety: which spectral band . . In: Dubbert J, Müller B, Meyer G (Eds.), Advanced Microsystems for Automotive Applications 2018. Springer, Cham , , 2018 . . p.3 - - 15 . . DOI: 10.1007/978-3-319-99762-9_1 http://doi.org/10.1007/978-3-319-99762-9_1 . .

C Premebida , , , U Nunes . . Fusing lidar, camera and semantic information: a context-based approach for pedestrian detection . . Int J Robot Res , , 2013 . . 32 ( ( 3 ): ): 371 - - 384 . . DOI: 10.1177/0278364912470012 http://doi.org/10.1177/0278364912470012 . .

P Radecki , , , M Campbell , , , K Matzen . . All weather perception: joint data association, tracking, and classification for autonomous ground vehicles . . 2016 . . https://arxiv.org/abs/1605.02196 https://arxiv.org/abs/1605.02196 , , . .

M Raya , , , JP Hubaux . . Securing vehicular ad hoc networks . . J Comput Secur , , 2007 . . 15 ( ( 1 ): ): 39 - - 68 . . DOI: 10.3233/JCS-2007-15103 http://doi.org/10.3233/JCS-2007-15103 . .

F Rosique , , , PJ Navarro , , , C Fernández , , , 等 . . A systematic review of perception system and simulators for autonomous vehicles research . . Sensors , , 2019 . . 19 ( ( 3 ): ): 648 DOI: 10.3390/s19030648 http://doi.org/10.3390/s19030648 . .

AHM Rubaiyat , , , Y Fallah , , , X Li , , , 等 . . Multi-sensor data fusion for vehicle detection in autonomous vehicle applications . . Electron Image , , 2018 . . 2018 ( ( 17 ): ): 257-1 - - 257-6 . . DOI: 10.2352/ISSN.2470-1173.2018.17.AVM-257 http://doi.org/10.2352/ISSN.2470-1173.2018.17.AVM-257 . .

A Sarwal , , , J Nett , , , D Simon . . Detection of Small Water-bodies . . PercepTek Robotics 12395. Perceptek Inc., Littleton Co., MA, USA , , 2004 . . .

S Schneider , , , M Himmelsbach , , , T Luettel , , , 等 . . Fusing vision and LIDAR---synchronization, correction and occlusion reasoning . . Proc IEEE Intelligent Vehicles Symp , , 2010 . . p.388 - - 393 . . DOI: 10.1109/IVS.2010.5548079 http://doi.org/10.1109/IVS.2010.5548079 . .

SM Seitz , , , B Curless , , , J Diebel , , , 等 . . A comparison and evaluation of multi-view stereo reconstruction algorithms . . IEEE Computer Society Conf on Computer Vision and Pattern Recognition , , 2006 . . p.519 - - 528 . . DOI: 10.1109/CVPR.2006.19 http://doi.org/10.1109/CVPR.2006.19 . .

H Seraji . . New traversability indices and traversability grid for integrated sensor/map-based navigation . . J Robot Syst , , 2003 . . 20 ( ( 3 ): ): 121 - - 134 . . DOI: 10.1002/rob.10074 http://doi.org/10.1002/rob.10074 . .

PY Shinzato , , , DF Wolf , , , C Stiller . . Road terrain detection: avoiding common obstacle detection assumptions using sensor fusion . . IEEE Intelligent Vehicles Symp , , 2014 . . p.687 - - 692 . . DOI: 10.1109/IVS.2014.6856454 http://doi.org/10.1109/IVS.2014.6856454 . .

A Shirkhodaie , , , R Amrani , , , E Tunstel . . Soft computing for visual terrain perception and traversability assessment by planetary robotic systems . . IEEE Int Conf on Systems, Man and Cybernetics , , 2005 . . p.1848 - - 1855 . . DOI: 10.1109/ICSMC.2005.1571416 http://doi.org/10.1109/ICSMC.2005.1571416 . .

P Siritanawan , , , MD Prasanjith , , , DW Wang . . 3D feature points detection on sparse and non-uniform pointcloud for SLAM . . 18$^{\rm th}$ Int Conf on Advanced Robotics , , 2017 . . p.112 - - 117 . . DOI: 10.1109/ICAR.2017.8023504 http://doi.org/10.1109/ICAR.2017.8023504 . .

J Sock , , , J Kim , , , JH Min , , , 等 . . Probabilistic traversability map generation using 3D-LIDAR and camera . . Proc IEEE Int Conf on Robotics and Automation , , 2016 . . p.5631 - - 5637 . . DOI: 10.1109/ICRA.2016.7487782 http://doi.org/10.1109/ICRA.2016.7487782 . .

J Son , , , H Yoo , , , S Kim , , , 等 . . Real-time illumination invariant lane detection for lane departure warning system . . Expert Syst Appl , , 2015 . . 42 ( ( 4 ): ): 1816 - - 1824 . . DOI: 10.1016/j.eswa.2014.10.024 http://doi.org/10.1016/j.eswa.2014.10.024 . .

JW Starr , , , B Lattimer . . Evidential sensor fusion of long-wavelength infrared stereo vision and 3D-LIDAR for rangefinding in fire environments . . Fire Technol , , 2017 . . 53 ( ( 6 ): ): 1961 - - 1983 . . DOI: 10.1007/s10694-017-0666-y http://doi.org/10.1007/s10694-017-0666-y . .

H Su , , , S Maji , , , E Kalogerakis , , , 等 . . Multi-view convolutional neural networks for 3D shape recognition . . Proc IEEE Int Conf on Computer Vision , , 2015 . . p.945 - - 953 . . DOI: 10.1109/ICCV.2015.114 http://doi.org/10.1109/ICCV.2015.114 . .

V Subramanian , , , TF Burks , , , WE Dixon . . Sensor fusion using fuzzy logic enhanced Kalman filter for autonomous vehicle guidance in citrus groves . . Trans ASABE , , 2009 . . 52 ( ( 5 ): ): 1411 - - 1422 . . DOI: 10.13031/2013.29121 http://doi.org/10.13031/2013.29121 . .

S Thrun , , , M Montemerlo , , , H Dahlkamp , , , 等 . . Stanley: the robot that won the DARPA grand challenge . . J Field Robot , , 2006 . . 23 ( ( 9 ): ): 661 - - 692 . . DOI: 10.1002/rob.20147 http://doi.org/10.1002/rob.20147 . .

Z Tian , , , Y Cai , , , S Huang , , , 等 . . Vehicle tracking system for intelligent and connected vehicle based on radar and V2V fusion . . Proc Chinese Control and Decision Conf , , 2018 . . p.6598 - - 6603 . . DOI: 10.1109/CCDC.2018.8408291 http://doi.org/10.1109/CCDC.2018.8408291 . .

J van Brummelen , , , M O'Brien , , , D Gruyer , , , 等 . . Autonomous vehicle perception: the technology of today and tomorrow . . Trans Res Part C , , 2018 . . 89 ( ( 3 ): ): 384 - - 406 . . DOI: 10.1016/j.trc.2018.02.012 http://doi.org/10.1016/j.trc.2018.02.012 . .

TD Vu . . Vehicle Perception: Localization, Mapping with Detection, Classification and Tracking of Moving Objects . . PhD Thesis, Institut National Polytechnique de Grenoble, Grenoble, France , , 2009 . . .

J Wang , , , Q Song , , , Z Jiang , , , 等 . . A novel InSAR based off-road positive and negative obstacle detection technique for unmanned ground vehicle . . Proc IEEE Int Geoscience and Remote Sensing Symp , , 2016 . . p.1174 - - 1177 . . DOI: 10.1109/IGARSS.2016.7729297 http://doi.org/10.1109/IGARSS.2016.7729297 . .

JG Wang , , , SJ Chen , , , LB Zhou , , , 等 . . Vehicle detection and width estimation in rain by fusing radar and vision . . 15$^{\rm th}$ Int Conf on Control, Automation, Robotics and Vision , , 2018 . . p.1063 - - 1068 . . DOI: 10.1109/ICARCV.2018.8581246 http://doi.org/10.1109/ICARCV.2018.8581246 . .

P Wei , , , L Cagle , , , T Reza , , , 等 . . Lidar and camera detection fusion in a real-time industrial multi-sensor collision avoidance system . . Electronics , , 2018 . . 7 ( ( 6 ): ): 84 DOI: 10.3390/electronics7060084 http://doi.org/10.3390/electronics7060084 . .

L Xiao , , , R Wang , , , B Dai , , , 等 . . Hybrid conditional random field based camera-lidar fusion for road detection . . Inform Sci , , 2018 . . 432 ( ( 03 ): ): 543 - - 558 . . DOI: 10.1016/j.ins.2017.04.048 http://doi.org/10.1016/j.ins.2017.04.048 . .

M Yamada , , , K Ueda , , , I Horiba , , , 等 . . Detection of wet-road conditions from images captured by a vehicle-mounted camera . . J Robot Mech , , 2005 . . 17 ( ( 3 ): ): 269 - - 276 . . DOI: 10.20965/jrm.2005.p0269 http://doi.org/10.20965/jrm.2005.p0269 . .

HW Yoo , , , N Druml , , , D Brunner , , , 等 . . MEMS-based lidar for autonomous driving . . Elektrotech Inftech , , 2018 . . 135 ( ( 6 ): ): 408 - - 415 . . DOI: 10.1007/s00502-018-0635-2 http://doi.org/10.1007/s00502-018-0635-2 . .

YF Yue , , , DW Wang , , , PGCN Senarathne , , , 等 . . Robust submap-based probabilistic inconsistency detection for multi-robot mapping . . Proc European Conf on Mobile Robots , , 2017 . . p.1 - - 6 . . DOI: 10.1109/ECMR.2017.8098660 http://doi.org/10.1109/ECMR.2017.8098660 . .

YF Yue , , , PGCN Senarathne , , , C Yang , , , 等 . . Hierarchical probabilistic fusion framework for matching and merging of 3-D occupancy maps . . IEEE Sens J , , 2018 . . 18 ( ( 21 ): ): 8933 - - 8949 . . DOI: 10.1109/JSEN.2018.2867854 http://doi.org/10.1109/JSEN.2018.2867854 . .

YM Zhan , , , H Leung , , , KC Kwak , , , 等 . . Automated speaker recognition for home service robots using genetic algorithm and Dempster-Shafer fusion technique . . IEEE Trans Instrum Meas , , 2009 . . 58 ( ( 9 ): ): 3058 - - 3068 . . DOI: 10.1109/TIM.2009.2016870 http://doi.org/10.1109/TIM.2009.2016870 . .

J Zhang , , , P Siritanawan , , , Y Yue , , , 等 . . A two-step method for extrinsic calibration between a sparse 3D LiDAR and a thermal camera . . 15$^{\rm th}$ Int Conf on Control, Automation, Robotics and Vision , , 2018 . . p.1039 - - 1044 . . DOI: 10.1109/ICARCV.2018.8581170 http://doi.org/10.1109/ICARCV.2018.8581170 . .

GQ Zhao , , , XH Xiao , , , JS Yuan , , , 等 . . Fusion of 3D-LIDAR and camera data for scene parsing . . J Visual Commun Imag Represent , , 2014 . . 25 ( ( 1 ): ): 165 - - 183 . . DOI: 10.1016/j.jvcir.2013.06.008 http://doi.org/10.1016/j.jvcir.2013.06.008 . .

Y Zhou , , , O Tuzel . . VoxelNet: end-to-end learning for point cloud based 3D object detection . . Proc IEEE/CVF Conf on Computer Vision and Pattern Recognition , , 2018 . . p.4490 - - 4499 . . DOI: 10.1109/CVPR.2018.00472 http://doi.org/10.1109/CVPR.2018.00472 . .

H Zhu , , , KV Yuen , , , L Mihaylova , , , 等 . . Overview of environment perception for intelligent vehicles . . IEEE Trans Intell Trans Syst , , 2017 . . 18 ( ( 10 ): ): 2584 - - 2601 . . DOI: 10.1109/TITS.2017.2658662 http://doi.org/10.1109/TITS.2017.2658662 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰