Abstract
This paper describes a dataset collected along a 1 km section of beach near Katwijk, The Netherlands, which was populated with a collection of artificial rocks of varying sizes to emulate known rock size densities at current and potential Mars landing sites. First, a fixed-wing unmanned aerial vehicle collected georeferenced images of the entire area. Then, the beach was traversed by a rocker-bogie-style rover equipped with a suite of sensors that are envisioned for use in future planetary rover missions. These sensors, configured so as to emulate the ExoMars rover, include stereo cameras, and time-of-flight and scanning light-detection-and-ranging sensors. This dataset will be of interest to researchers developing localization and mapping algorithms for vehicles traveling over natural and unstructured terrain in environments that do not have access to the global navigation satellite system, and where only previously taken satellite or aerial imagery is available.
Keywords
1. Introduction
This paper describes a large dataset collected on a section of beach near Katwijk, The Netherlands. The beach was chosen as a Mars analog since it is a natural, unstructured, and sandy terrain that is also located near the European Space and Technology Research Center where the heavy-duty planetary rover (HDPR) research platform used in this paper was developed (shown in Fig. 1). The development of HDPR and the creation of this dataset has served to build up and evaluate capabilities for future field experiments at analog sites with this platform, similar in scope to Bakambu et al. (2016), in advance of the ExoMars rover mission that is currently scheduled for 2020.

Heavy-duty planetary rover (HDPR) platform used to collect data from the ground (GPS: global positioning system; RTK: real-time kinematic; IMU: inertial measurement unit).
This dataset is intended for research on localization and mapping in global navigation satellite system (GNSS)-denied environments, especially with respect to planetary rovers or similar operational scenarios. In the past, field campaigns have been performed to support this type of research (Bakambu et al., 2014; Wettergreen et al., 2005; Woods et al., 2014a,b) but the datasets generated were not made with the intention of being broadly reusable. Other datasets have presented longer traverses in more Mars-like terrain (Furgale et al., 2012). In contrast, this dataset aims to include new types of measurements that will be useful for research on a platform that is more representative of planetary rovers. Its distinguishing features are as follows.
The HDPR has an instrumented rocker-bogie suspension system, similar to the chassis designs of all current Mars rovers, including NASA’s Mars Science Laboratory.
A Sensefly eBee unmanned aerial vehicle (UAV) was flown before each traverse to capture georeferenced images with a resolution of approximately 2 cm. Digital elevation maps were also created with an accuracy in the elevation direction of approximately 20 cm. This was done to simulate images taken by the HiRise camera on-board the Mars Reconnaissance Orbiter (MRO).
Like ExoMars, HDPR includes localization and PanCam stereo-benches (mounted on a pan–tilt unit). The sensor specifications and the design of the custom stereo-bench were chosen to closely approximate the ExoMars camera systems, using commercially available hardware (Coates et al., 2015).
Two active sensors—a Velodyne VLP-16 three-dimensional (3D) scanning light detection and ranging (LiDAR) and an outdoor-rated MESA SwissRanger 4500 time-of-flight (ToF) camera—were positioned above the localization cameras. To the authors’ knowledge, this is the first published dataset that includes long traverses with an outdoor ToF camera.
Artificial rocks were made in three sizes, to approximate known rock size densities at current and potential future Mars landing sites (Golombek et al., 2012). These rocks are visible in both the HDPR and eBee images. The ground-truth position of these rocks was obtained from the georeferenced UAV images. Dimensions of the three rock types are also included.
The dataset is partitioned into two parts: (1) rover traverse data with two sets of stereo images, pan and tilt orientations from a pan–tilt unit, scanning LiDAR and ToF measurements, inertial measurement unit (IMU) data, real-time kinematic (RTK) global positioning system (GPS) position; and (2) fixed-wing UAV eBee georeferenced images and digital elevation maps (DEMs) taken before each traverse. The full dataset is available for download at https://robotics.estec.esa.int/datasets/katwijk-beach-11-2015.html.
This webpage also includes descriptions of all available data and file formats and provides some tools to make use of the data.
The remainder of this paper is organized as follows. Section 2 introduces the rover traverse data, including frame conventions and calibration values. Section 3 describes the eBee georeferenced images and DEMs and Section 4 discusses ways this dataset can be used and some lessons learned during the creation of this dataset.
2. HDPR traverse data
Stereo imagery, pan–tilt encoders, active sensor (ToF and scanning LiDAR), IMU, wheel encoder, and RTK GPS measurements were all taken using the HDPR research platform described first in Boukas et al. (2016). GPS measurements were recorded in both the World Geodetic System 84 (WGS 84) and Universal Transverse Mercator Zone 31 North (UTM 31 N) reference frames. Details about these data are presented in Table 1. A single on-board computer logged and timestamped all sensor data as it arrived, including GPS data (which includes a GPS-derived timestamp). All sensors operate independently (i.e. the sensors were not time-synchronized). However, stereo camera image pairs (or triples in the case of the Velodyne VLP-16) were acquired simultaneously.
Overview of the sensors and data collected over the traverse.
Three traverses took place on 26 November 2015 and are shown in Figure 2. The density of rocks greater than 1.2 m for the first two traverses was chosen to match an area of Medium-Low to Medium-High density of rocks north-west of the Bagnold Dunes in Gale Crater on Mars described in Golombek et al. (2012), where the Mars Science Laboratory landed in 2012 and has since spent its time traversing. At these locations, rocks greater than 1.2 m in diameter have a density of 0.0031

UTM 31 N projection of all traverses.

The three rock models used for construction and included in this dataset.
The first traverse, approximately 1.026 km in length, took place between 12:53 and 13:33 where the rover traversed through a “rock field” made up of the 212 artificial rocks at a median speed of 0.5077 m∕s (speed profiles over all traverses are shown in Figure 4). The second traverse contains data from the return journey to the starting location over a 0.797 km traverse and took place from 13:39 to 14:06 at a median speed of 0.5057 m∕s. Short stops occurred twice in the first traverse, and once in the second traverse due to a loss of GPS RTK measurements, but resumed shortly after these measurements returned. Both traverses are shown in Figure 2(a).

Speed profile for all three traverses.
The reason this dataset is split into two parts is due to poor lighting conditions on the return traverse, which caused blooming in some of the stereo images. These variations in lighting may be useful to some researchers who wish to test under such conditions. The third traverse is shown in Figure 2(b) and took place from 15:00 until 15:22. It was driven at a slower median speed of 0.1813 m∕s for a distance of approximately 0.221 km over an area of 100 m× 25 m. In this traverse 27 artificial rocks were placed such that a High density of 0.011
Two sets of stereo pairs were taken, and serve different roles which correspond to the two stereo cameras on the upcoming ExoMars rover mission. The first set was taken using a PointGrey Bumblebee2 stereo camera, mounted at the same height and angle as the ExoMars rover LocCam. Its intended primary use is for visual odometry. The second set was taken using a custom 50 cm baseline stereo camera, mounted at the same height as the ExoMars PanCam on a pan–tilt unit. This set is intended for scene reconstruction and was periodically taken at varying pan angles throughout the traverses.
For ground truth, a pair of Trimble GPS units were used for the rover’s position. One was set up as a base station near the beginning of the traverse; the second was mounted on the rover. The base station provided DGPS differential GPS and RTK corrections throughout the traverse, resulting in a position estimate with an accuracy as high as 2 mm at approximately 0.3 Hz.
The terrain, multitude of sensors, and use of a representative research platform make this a unique dataset that is relevant to future planetary rover missions (Boukas et al., 2015), as well as being useful to mobile robotics researchers developing localization algorithms that do not rely on GNSS measurements and/or that must be lighting-invariant (e.g. algorithms for mining or military vehicles). In addition, the SwissRanger ToF sensor was used to collect both range and intensity images. The intensity images can be used to perform feature-tracking for visual odometry (McManus et al., 2013) and advanced photometric techniques (Hewitt and Marshall, 2015) that are currently of interest to the European Space Agency for future missions.
2.1. Transformations and data format
HDPR and all relevant sensor frames are shown in Fig. 5 and explained in Table 2. All sensors were mounted according to a reference design, with the mounting position and rotation measured by hand with an uncertainty of a few mm (one standard deviation) and an uncertainty in rotation of approximately

HDPR and sensor coordinate frames. Not shown are the coordinate frames associated with the right side of the rover chassis:
Coordinate frames associated with each sensor.
For consistency, we adopt the transformation representations described by Furgale et al. (2012). Thus, rotations are described by an axis angle representation, with a unit vector axis,
where (⋅)× is the skew-symmetric matrix operator
A translation is expressed as
The ground-truth pose of a given sensor is determined by transforming the GPS measurements and IMU orientation estimates into the sensor frame by using the provided MATLAB® tools. An overview of many inter-sensor transformations is shown in Table 3, and through successive transformations they can be used to transform any measurement to the IMU frame. For instance, a point,
Transformations between sensor frames.
Overview of the data collected by the eBee UAV.
Note that the PanCam sensors are mounted on a pan–tilt unit that periodically rotated the stereo-bench during the traverse to cover a wider field of view. Therefore, the transformation that describes this sensor is dependent on the corresponding pan–tilt unit’s measurements at each image’s time stamp, found in the
where
Overview of the file formats for all data collected. In stereo images, {0,1} corresponds to the left and right images respectively.
Similarly, the transformations to each of the wheel encoder frames are dependent on the measured rocker,
The Velodyne and ToF camera data are stored as 16-bit grayscale images (except in the case of the 8-bit Velodyne intensity image). Storing this data in a structured way can be useful when computing nearest neighbor points, applying 2D feature-tracking algorithms, or for compression. To convert these to 3D point clouds, the Velodyne range images should be multiplied by 1.0 mm to obtain the absolute range. The azimuth image should be divided by 100.0 to obtain the azimuth in degrees. Each of the 16 rows in the image corresponds to a specific elevation value in degrees that can be found in the VLP-16 manual. Similarly, the ToF range image,
By using the intrinsic parameters of the ToF camera included on the dataset website, a 3D point that corresponds to each range value can be computed. Alternatively a MATLAB® script (
Table 1 summarizes the data collected over each traverse and Table 5 summarizes the file formats. Note that each traverse is partitioned into five-minute intervals to make downloading the dataset more manageable.
3. UAV flight data
The eBee UAV is a fixed-wing aircraft with a camera mounted to its belly. It also includes an integrated sensor suite with inertial sensors and a GPS receiver that are used to estimate its orientation and position. By imaging multiple overlapping areas, the eBee’s proprietary software uses offline bundle adjustment to create a geotiff—a single image that covers the entire area of the traverse—where each pixel has a corresponding 2D position in the global UTM reference system, as well as a digital surface model image where each pixel provides an estimate of elevation according to the WGS 84 ellipsoid. This information is useful to researchers because it provides an analog to satellite imagery that exists on Mars and on Earth, and has shown promise for use in global localization in GNSS-denied environments (Boukas et al., 2015; Hourdakis and Lourakis, 2015) by matching regions of interest in satellite imagery to imagery obtained from the ground (Boukas and Gasteratos, 2016).
Because the source data is of a much higher resolution, it is possible to create simulated satellite imagery when knowing the resolution and the point spread function (PSF) of the satellite in question (Hlavka, 1986). In the case of the HiRise camera on-board MRO, the PSF is between one and two pixels wide at full width half maximum, and the resolution is between 25 cm ∕pixel and 30 cm ∕pixel (McEwen et al., 2007). An example of this is shown in Fig. 6, where an image has been processed to replicate the satellite imagery available on Mars by convolving the high-resolution image with a Gaussian kernel that approximates the PSF, and then resizing the image using nearest-neighbor interpolation.

Images covering an 80 m ×20 m area. Top: HiRise imagery of rocks in Gale Crater, Mars. Middle: raw UAV imagery of artificial rocks. Bottom: processed UAV imagery of artificial rocks simulating the specifications of the HiRise camera.
4. Discussion
This section provides some further discussion and “lessons learned” throughout and following the field campaign in which the presented data was collected and compiled.
In total, HDPR traversed 2.044 km in this field campaign; its mobility system, computer and all sensors were powered by a 1000 W, Honda EU10i generator. At a nominal speed of 0.6 m/s on flat, sandy terrain, HDPR draws approximately 550 W. The 450 W margin allows it to safely drive over undulating terrain and up slopes of at least 10°.
This level of performance on sandy terrain was needed as the mechanical properties of sand are similar to those of planetary soil and it is often used as a planetary soil simulant (Cross et al., 2013; Ding et al., 2009; Setterfield and Ellery, 2012). Having a dataset collected at a relatively fast speed is useful for testing algorithms meant for a future Sample Fetch Rover concept that will require much faster traverses than those conducted in past missions. It also enables long traverses to test the accuracy of localization algorithms.
The dataset provided is representative of the ExoMars rover due to its similar sensor suite while also including modern 3D LiDAR sensors that have not been used on a rover mission to date. This has allowed comparison between the two sets of sensors to evaluate their relative advantages and disadvantages. For instance, the lighting conditions are particularly challenging for visual odometry algorithms in Traverse 2, whereas this has little affect on the LiDAR data.
The provided
The data has also helped the team identify areas for improvement in preparing for future field campaigns. For example, the utilized IMU was selected for its high-accuracy gyroscope and accelerometer, but it did not include a magnetometer. This is similar to the ExoMars rover (on Mars there is no global magnetic field to measure). However, the addition of a magnetometer (on Earth) would serve to provide better ground truth for the rover’s heading than one derived solely from GPS measurements. Wi-Fi was utilized for communication between a base station located at the beginning of the traverse and the rover, allowing images from the rover to be displayed over the high-bandwidth connection in real time for use in operations. However, Wi-Fi connectivity issues caused missed RTK updates, resulting in small parts of the traverse that have a less accurate ground-truth GPS measurement. The signal quality is label led in the dataset as either RTK_FIXED, RTK_FLOAT, or DIFFERENTIAL and their respective accuracies are reflected in each measurement’s recorded standard deviation. This has been improved for future tests by extending the Wi-Fi network across the traverse area to reduce dropouts.
5. Summary
This paper presents a time-registered multi-sensor rover traverse dataset captured in a unique outdoor Mars-analog environment, along with georeferenced high-resolution imagery of the traversed terrain. This dataset will be useful to the robotics research community, particularly those interested in navigation in GNSS-denied environments, as in the case of planetary rovers. The data can be used to test algorithms that aim to combine various forms of perception. Because three of the sensors were mounted together such that much of their field of view overlapped, comparisons (for instance, running visual odometry algorithms) between the different sensors is facilitated.
Footnotes
Acknowledgements
The authors would like to thank Erik Wildeman for his help designing and procuring the artificial rocks, Robin Nelen who made the sensor mounts, Martin Zwick who troubleshooted wheel motor problems and helped design the artificial rocks, Jakub Tomášek who gathered the eBee data, Carlos Crespo who helped design the Wi-Fi network, and Simon Wyss and Jorge Chamorro for various contributions that made this experiment possible.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the European Space Agency through the Networking/Partnering Initiative (contract numbers 4000108490/13/NL/PA and 4000109064/13/NL/PA).
