[논문 리뷰] CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes

Tao Ma, Zhizheng Liu외 2명|arXiv (Cornell University)|2021. 03. 08.

Robotics and Sensor-Based Localization참고 문헌 21인용 수 28

한 줄 요약

CRLF는 도로 차선과 기둥의 선 특징을 이용한 완전 자동 LiDAR-Camera extrinsic calibration 방법으로, 거친 P3L 기반 초기화에 이어 시맨틱 선 기반 비용 함수로 정교화합니다.

ABSTRACT

For autonomous vehicles, an accurate calibration for LiDAR and camera is a prerequisite for multi-sensor perception systems. However, existing calibration techniques require either a complicated setting with various calibration targets, or an initial calibration provided beforehand, which greatly impedes their applicability in large-scale autonomous vehicle deployment. To tackle these issues, we propose a novel method to calibrate the extrinsic parameter for LiDAR and camera in road scenes. Our method introduces line features from static straight-line-shaped objects such as road lanes and poles in both image and point cloud and formulates the initial calibration of extrinsic parameters as a perspective-3-lines (P3L) problem. Subsequently, a cost function defined under the semantic constraints of the line features is designed to perform refinement on the solved coarse calibration. The whole procedure is fully automatic and user-friendly without the need to adjust environment settings or provide an initial calibration. We conduct extensive experiments on KITTI and our in-house dataset, quantitative and qualitative results demonstrate the robustness and accuracy of our method.

연구 동기 및 목표

• Automate LiDAR-camera extrinsic calibration without calibration targets or prior initialization.
• Leverage static straight-line road-world features (lanes and poles) as calibration anchors.
• Provide a robust initial calibration via perspective-3-lines (P3L) and refine using semantic line constraints.
• Demonstrate effectiveness and efficiency on KITTI and in-house datasets in realistic road scenarios.

제안 방법

• Extract line features from both image and LiDAR data focusing on lanes and poles.
• Formulate coarse calibration by solving a P3L problem using line correspondences.
• Compute a cost function under semantic line constraints to refine calibration by matching line masks after projection.
• Refine the extrinsics by optimizing the cost function with a stochastic search around the coarse solution.
• Use a ground-parallel intermediate step to simplify initial P3L solving and then remove the parallel assumption in refinement.

실험 결과

연구 질문

• RQ1 How can LiDAR-Camera extrinsic calibration be achieved automatically in road scenes without calibration targets or prior initialization?
• RQ2 Can line features from static road objects (lanes and poles) provide sufficient constraints for accurate coarse calibration and robust refinement?
• RQ3 What is the effectiveness of a P3L-based initialization followed by semantic-line refinement on real datasets?
• RQ4 How does CRLF perform compared with reference calibrations on KITTI and in-house data in terms of translation and rotation accuracy?

주요 결과

• CRLF achieves automatic LiDAR-Camera extrinsic calibration using line features within road scenes.
• A coarse calibration from line correspondences is obtained by solving the P3L problem and transformed via a ground-parallel intermediate frame.
• The refinement leveraging a semantic line-based cost function significantly improves accuracy over the coarse result.
• On KITTI, coarse calibration yields translation errors around 0.121–0.182 m and rotation errors around 0.628–1.043 degrees; refinement reduces these errors substantially.
• On in-house data, coarse calibration yields translation errors around 0.053–0.074 m and rotation errors around 0.684–1.092 degrees; refinement reduces these to 0.018–0.015 m and 0.332–0.613 degrees respectively.
• The end-to-end CRLF process runs in about 0.3 seconds per frame, demonstrating efficiency for large-scale deployment.