ViKi-HyCo: A Hybrid-Control Approach for Complex Car-Like Maneuvers

While Visual Servoing is deeply studied to perform simple maneuvers, the literature does not commonly address complex cases where the target is far out of the camera’s field of view (FOV) during the maneuver. For this reason, in this paper, we present ViKi-HyCo (Visual Servoing and Kinematic Hybrid-Controller). This approach generates the necessary maneuvers for the complex positioning of a non-holonomic mobile robot in outdoor environments. In this method, we use LiDAR-camera fusion to estimate objects bounding boxes using image and metrics modalities. With the multi-modality nature of our representation, we can automatically obtain a target for a visual servoing controller. At the same time, we also have a metric target, which allows us to hybridize with a kinematic controller. Given this hybridization, we can perform complex maneuvers even when the target is far away from the camera’s FOV. The proposed approach does not require an object-tracking algorithm and can be applied to any robotic positioning task where its kinematic model is known. ViKi-HyCo has an error of <inline-formula> <tex-math notation="LaTeX">$\mathbf {0.0428\pm 0.0467}$ </tex-math></inline-formula> m in the X-axis and <inline-formula> <tex-math notation="LaTeX">$\mathbf {0.0515\pm 0.0323}$ </tex-math></inline-formula> m in the Y-axis at the end of a complete positioning task.