Professional Documents
Culture Documents
1
Horizontal RMS error measured over 23 test flights in the USA and Switzerland, Summer 2018. RMS error has a standard deviation of 0.4 cm
(0.16 in) over all flights.
2
Best possible results of other market leading drones with a 20 megapixel camera according to the manufacturer’s technical specifications.
wingtra.com
W I N GT R A W H I T E PA P E R
Content
Accuracy FAQ 2
Influencing factors 7
Appendix 11
Orthomosaic map of the ETH Zurich facility where WingtraOne reached its best absolute horizontal accuracy result — 0.7 cm (0.3 in). Switzerland, 2018.
1
W H I T E PA P E R
Accuracy FAQ
Wondering about Wingtra’s 1 cm (0.4 in) absolute accuracy and how the
results were validated? Below you will find a summary of the most frequently
asked questions we get related to accuracy. To get the full picture, please
read Wingtra‘s accuracy white paper available at
wingtra.com/drone-survey-accuracy
What equipment was used to perform the survey? What measurement of accuracy were you using?
WingtraOne PPK drone with a 42 MP Sony RX1R II We used root mean square error (RMSE) on five (ETH) and
camera. nine (Phoenix) checkpoints and measured not just for one
but over 14 flights.
Did you use GCPs for processing?
No, we did not use GCPs for processing as Is this accuracy valid for every point of the point cloud?
photogrammetry software is sensitive to the accuracy Due to the variable quality of photogrammetry, we can
and distribution of GCPs, i.e., they can introduce tensions only qualify validated control points to achieve this level
in the block adjustment. of accuracy and not all points in the point cloud. Some
individual points might have varying accuracy which can
i be observed as noise in the point cloud (e.g. over asphalt
Targets on the ground with known locations or close to water).
are called either ground control points (GCPs),
when used for georeferencing, or checkpoints, What GSD is your accuracy based on?
when used only to validate accuracy after
0.8 cm (0.3 in)
georeferencing. We used checkpoints, which
have no influence on the outputs (point clouds,
How are you extracting the position of the checkpoints?
orthomosaics, etc.).
Orthophoto, point cloud, DEM, or a mixture of the above?
Checkpoints are manually measured in the aerial
How exactly did you validate the accuracy? triangulation, and are part of the tie points (= coarse
We performed two independent tests in the US point clouds). This is the common method based on the
and Switzerland. In Switzerland, we used a set of usual SfM software.
five checkpoints from the Institute of Geodesy and
Photogrammetry at ETH Zurich. For research purposes, Is this accuracy claim with respect to a global or local
the institute defined the locations of these points within CRS?
2 mm (0.08 in) horizontal and 4 mm (0.16 in) vertical All calculations have been done in WGS84 and CH1903+,
accuracy. Their accuracy is based on a high-accuracy the latter being local but derived from CHTR95 and
network combining total stations and static long-time ETRS89, which are global.
GNSS measurements. These measurements are then
integrated into a stochastic model that Is this accuracy claim valid for height, plan or 3D? The 1
takes into account the accuracy of each device (Januth, cm (0.4 in) accuracy claim refers to horizontal accuracy.
T. (2017), chapter three*). As known from GPS technology and photogrammetry
algorithms, the vertical accuracy lies between two and
In the US (Phoenix), Wingtra used two three times the horizontal accuracy.
HiPer V GNSS antennas from Topcon. One was set up
as a base station and was logging for around three Where can I get more details?
hours. The second was set up as a rover using the You can read the white paper and download the raw data
correction data from the local base to measure the nine at wingtra.com/drone-survey-accuracy. Or contact us at
checkpoints. Due to the small baseline between the rover support@wingtra.com for further questions.
and the base station the coordinates were defined at a
subcentimeter level relative to the base.
* Januth, T. (2017) ”Robot validation with the QDaedalus system: Integration of a robot in a global reference frame“.
Master Thesis, HES-SO, Yverdon, Switzerland.
2
W I N GT R A W H I T E PA P E R
In the fixed-wing world, this is not the case. The heavier Along these lines, a high density of pixels greatly affects
the sensor, the heavier the drone, resulting in an increased the accuracy. During the post processing, the coordinates
impact energy during a bellylanding. Therefore, most fixed- are defined for each pixel on the map. Thus, the more pixels
wing drones are equipped with 20 MP or lower resolution there are, the more accurate the final map or 3D model is.
cameras since high-end cameras are too heavy and For example, if you fly with a GSD of 3 cm/px (1.2 in/px),
would require a catapult for take-off. 3 cm (1.2 in) is also the best possible accuracy. In contrast,
WingtraOne with the Sony RX1RII offers a ground sample
The VTOL WingtraOne‘s flagship camera is the 42 MP full- distance (GSD) as low as 0.7 cm/px (0.3 in/px) that also
frame Sony RX1RII. Such a camera takes high-resolution allows subcentimeter level absolute accuracy.
images as the number of total pixels is more than
double that of a 20 MP camera. Other 20 MP camera Sony RX1RII 42 MP camera
(with a WingtraOne drone)
Both the accuracy and GSD of a map highly depend on the resolution
of the pictures the drone collects. The better the resolution, the more
pixels in the image. This leads to better GSD and higher accuracy.
3
W I N GT R A W H I T E PA P E R
In order to verify down to 1 cm (0.3 in) accuracy, Wingtra The Institute of Geodesy and Photogrammetry of ETH
partnered with RDO Integrated Controls, one of the lar- Zurich facility provided two unique setups that were
gest Topcon dealers and the largest Wingtra distributor in perfect for Wingtra‘s project:
the US. In Switzerland, Wingtra worked with the Institute 1.
The ongoing research yielded a high-precision
of Geodesy and Photogrammetry of ETH Zurich, one of fixed-point network. The locations of these points
the top science universities in the world (Top universities, were defined within 2 mm (0.08 in) horizontal and
2018). 4 mm (0.16 in) vertical accuracy. Their accuracy was
based on a high-accuracy network combining total
To validate the data Wingtra needed a setup capable of stations (tachymeter) and static long-time GNSS
measuring accuracy even lower than 1 cm (0.3 in). But as measurements. To learn more about these checkpoints
every surveyor will know, it is not that simple to get a glo- and how their accuracy was defined, read the research
bal position with an accuracy in the millimeter range. The paper by Januth and Guillaume* (chapter 3).
usual measurement methods using a GNSS receiver in 2. Part of the highly accurate Swiss national continuously
RTK mode are not precise enough. So how could Wingtra operating reference stations (CORS) network (swipos),
overcome this challenge? a continuously measuring GNSS station provided
optimal correction data for PPK geotagging and
allowed absolute position reading at the centimeter
i
level via GPS and GLONASS.
Test setup ETH Zurich, Switzerland
+ 14 flights In this setting, the Wingtra team conducted 14 flights
+ PPK correction using swipos CORS network 62 m (203 ft) above home with a GSD of 0.7 cm (0.3 in). The
+ Area: 7 ha (17.3 ac) collected images and the raw measurements of the
+ Altitude above takeoff: 62-78 m (203-256 ft) onboard dual-frequency GNSS receiver were auto-
+ GSD: 0.8-1.0 cm (0.3-0.4 in) matically saved to the camera SD card after each flight.
+ Overlap: 80% | 80% In addition to the flight data, the raw GNSS
+ 5 checkpoints measurements of the continuously operating reference
+ Checkpoint accuracy (horz/vert): 2/4 mm station (CORS) at ETH were used to geotag the images in
+ Checkpoint accuracy based on WingtraHub at centimeter-level accuracy.
measurements combining total stations
(tachymeter) and static long-time GNSS Because of the high-precision, fixed-point network
(0.08/0.16 in) provided by ETH Zurich, the 14 projects could be
compared to checkpoints at the accuracy of 2 mm
(0.08 in). The ETH network was used to assess the difference
from the point cloud generated within Pix4Dmapper. On
* Januth, T. (2017) Robot validation with the QDaedalus system: Integration of a robot in a global reference frame». 4
Master Thesis, HES-SO, Yverdon, Switzerland.
W I N GT R A W H I T E PA P E R
Phoenix, USA
correction data from the local base station. These targets centimeter accuracy comparison when testing the WingtraOne.
RDO Integrated
supports positio-
equipment from
manufacturers
including John
Topcon. With 78
is the biggest
WingtraOne
distributor on the 5
West Coast.
W I N GT R A W H I T E PA P E R
Results
+ Tests at ETH Zurich, Switzerland, and Phoenix, Arizona, Such results have never been achieved with a high coverage
showcased that in optimal conditions, the WingtraOne fixed-wing drone as to the best of our knowledge.
drone consistently achieved an accuracy of 1 cm
(0.4 in) and below. The very small standard deviation
Number of Horizontal Vertical
value (see appendix) of 0.6 cm (0.2 in) shows that the
flights in RMS error RMS error
high accuracy is repeatable in every flight. dataset
+ The millimeter-precision setup at ETH Zurich revealed ETH Zurich 14 0.7 cm 2.6 cm
(0.3 in) (1.0 in)
the best horizontal absolute accuracy result, which was
0.7 cm (0.3 in). Phoenix, 9 1.0 cm 2.5 cm
Arizona (0.4 in) (1.0 in)
+ The resulting horizontal and vertical RMS errors were as Horizontal and vertical RMS (root mean square) values
expected. These numbers lie within the general rule of illustrating absolute accuracy achieved with WingtraOne when
thumb for accuracies in photogrammetry, i.e., horizontal processing the aerial images without using GCPs. Detailed
1x GSD and vertical 2-3x GSD. results can be found in the appendix.
3
Horizontal RMS error over 14 test flights at ETH Zurich in Summer 2018. RMS error has a standard deviation of 0.5 cm (0.2 in) over all
14 flights
4
Horizontal RMS error over 9 test flights as measured in Phoenix in Summer 2018. RMS error has a standard deviation of 1 cm (0.4 in)
over all 9 flights
5
Best possible results of other market leading drones with a 20 megapixel camera according to their manufacturer’s technical
specifications
6
W I N GT R A W H I T E PA P E R
Influencing factors
What happens when the conditions are not optimal? While mapping with the WingtraOne PPK, GCPs are not
Different scenarios showcased that with intervening needed to achieve high accuracy results. Instead the same
factors such as a long baseline—being far away from a photogrammetric targets usually used for establishing
base station—the absolute accuracy might vary. As a GCPs are used as checkpoints to evaluate the achieved
rule of thumb, every 10 km (6.2 mi) in distance adds 1 cm accuracy of the drone.
(0.4 in) to the RMS error. Vertical accuracy suffers greater
effect than horizontal accuracy. In Wingtra‘s case, these checkpoints have to have a
subcentimeter accuracy. It is a very complicated task
In case of a vertical baseline of more than 500 m (1640 ft), to accurately measure checkpoints at this level, so how
horizontal accuracy also becomes notably worse. do we achieve that? First of all, good photogrammetric
targets are needed. The marks should be fixed so
that they do not move from the time you measure
The closer the base station, them, until the flights are finished. They need to be
the better the accuracy placed on an open area to ensure that they are visible
1 cm > 1 cm > 2 cm
on as many images as possible. The marks should have
accuracy accuracy accuracy
high contrasting colors and a clearly defined center point.
7
W I N GT R A W H I T E PA P E R
When establishing a new base station, log GPS data for at least a
couple of hours
2. Be aware of the distance to a base station Note that if a new base station is established on a known
Achieving absolute accuracy depends on the correction point, the results depend on how accurately the point was
data derived from static base station logging. The closer measured before.
a base station is to the flight location, the better the
corresponding correction data will be to the onboard Important! Don‘t forget to check minimum base station
GNSS logging of the WingtraOne. requirements, which are:
When using a continuously measuring GNSS station, + Possibility of continuous logging with logging interval
make sure it is close enough. The accuracy results will of 15s or faster (1s is recommended for the highest
reduce gradually the further you are from the station. Rule accuracy)
of thumb—every 10 km (6.2 mi) adds 1 cm (0.4 in) to the + Logging at least two frequencies L1 and L2
RMS error. + Receiving Constellations GPS + GLONASS (optional for
high precision)
In case the GNSS station is further away, use your own
base station. L1 & L2
GPS, GLONASS
3. Be aware of elevation influence
A long baseline most of all affects the vertical accuracy. In Your base station should log both L1 and L2 frequencies and receive
the case of a height difference between base station and data from GPS and GLONASS.
+1 cm (0.4 in)
500 m
8
W I N GT R A W H I T E PA P E R
5. Establish checkpoints to prove the accuracy to your 6. Be careful with different coordinate systems
customer
WingtraOne images can be geotagged in any Earth-
centered, Earth-fixed coordinate system such as WGS84.
When a local projected coordinate system is desired as an
output, the transformation can be performed either in the
post-processing toolchain or externally using a conversion
tool suitable for the desired coordinate system. Be aware
that the final results in local coordinate systems are
only as good as the provided conversion tools for those
To ensure bulletproof accuracy evaluation, make sure that your systems.
checkpoints are measured precisely.
Y
Transformation might
introduce errors
9
W I N GT R A W H I T E PA P E R
Environmental obstacles might block the GNSS satellite signal to your GNSS receiver. Such interference would have a negative impact on your
accuracy results. Be aware of that when planning your projects in valleys, canyons or next to tall buildings.
8. Contact us
If you have any questions about planning your next
project, contact the Wingtra team at sales@wingtra.com
and we will make sure to help you out!
i
To access raw data of the accuracy tests please go to the Wingtra downloads section at
https://knowledge.wingtra.com/data-samples-and-maps
W I N GT R A W H I T E PA P E R
Appendix
Table 1: Results of an exemplary flight at ETH Zurich, Switzerland (flight 5). Error of checkpoints relative to the point cloud processed in Pix4D
Table 2: Comparison of point cloud to check points. Average over all 14 flights at ETH Zurich, Switzerland.
Average of 14 flights X Y Z
Mean 0.26 cm 0.50 cm -2.09 cm
11
W I N GT R A W H I T E PA P E R
Table 3: Results of an exemplary flight in Phoenix, US (flight 7). Error of checkpoints relative to the point cloud processed in Pix4D without
using GCPs.
Table 4: Comparison of point cloud to check points. Average over all 9 flights in Phoenix, US.
Average of 14 flights X Y Z
Mean 0.22 cm 0.23 cm 2.16 cm
12