pykitti | Python tools for working with KITTI data

Update: PyKitti version 0.2.1 exposes projection matrices for all cameras.

I recently faced the same problem. For me, the problem was that pykitty didn't expose P_rect and R_rect matrices for all cameras.

For Pykitti > 0.2.1, use P_rect and R_rect from calibration data.

For previous versions, you have two options:

1. Enter the matrices by hand (data is in the .xml calibration file for each sequence).
2. Use this fork of pykitti: https://github.com/Mi-lo/pykitti/

Then, you can use equation 7 to project a velodyne point into an image. Note that:

• You will need 3D points as a 4xN array in homogeneous coordinates. Points returned by pykitti are a Nx4 numpy array, with the reflectance in the 4th column. You can prepare the points with the prepare_velo_points function below, which keeps only points with reflectance > 0, then replaces reflectance values with 1 to get homogeneous coordinates.

• The velodyne is 360°. Equation 7 will give you a result even for points that are behind the camera (they will get projected as if they were in front, but vertically mirrored). To avoid this, you should project only points that are in front of the camera. For this, you can use the function project_velo_points_in_img below. It returns 2d points in homogeneous coordinates so you should discard the 3rd row.

Here are the functions I used: