This action might not be possible to undo. Are you sure you want to continue?
Report on Performance of DEM Generation Technologies in Coastal Environments
Clive Fraser and Mehdi Ravanbaksh Cooperative Research Centre for Spatial Information
CRCSI is established and supported under the Australian Government’s Cooperative Research Centres Program
Table of Contents Page Executive Summary 1. Introduction 2. Project Overview 3. Overview of DEM Generation Technologies 3.1 Technology Options 3.2 Accuracy Considerations 3.3 LiDAR 3.4 Photogrammetry 3.5 IfSAR 4. Project Work Plan 5. Test Area Locations 6. Specifications for DEM Data Sets 7. Benchmark Elevation Data 7.1 Permanent Survey Marks 7.2 GPS Survey of Height Profiles 7.3 Comparison of GPS and Ground Survey Elevations 7.4 GPS Heighting versus LiDAR DEMs 8. Analysis of Different DEMs Against LiDAR Reference DEM 8.1 Discrepancies in Elevation 8.2 SRTM DEM 8.3 SPOT5 DEM 8.4 Topo DEM (from 1:25,000 map data) 8.5 Airborne IfSAR DEM 8.6 ADS40 DEM 9. Impact of Land Cover on DEM Accuracy 9.1 Urban areas 9.2 Open Rural Areas 9.3 Forest/Bushland Areas 9.4 Mixed Coastal Land Cover 10. Influence of Terrain Slope 11. Conclusions 3 5 5 5 5 6 7 8 8 9 11 15 16 16 16 16 20 23 23 26 28 28 28 31 31 31 35 36 38 39 40
Executive Summary Reliable digital elevation models (DEMs) are vital to better understand and prepare for the impacts of sea level rise and storm surges caused by climate change. A number of satellite and airborne remote sensing technologies can be used to generate digital elevation models, however each technology possesses its own advantages and limitations. The primary aim of this project has been to evaluate the performance of different technologies for the generation of digital elevation models, specifically in coastal environments. The accuracy characteristics of six such technologies have been assessed within four test areas on the mid north coast of New South Wales. These test sites were chosen as being representative of low-lying coastal zones of differing land cover, topography and geomorphology. The DEM technologies investigated were: Airborne LiDAR (airborne laser scanning) Airborne IfSAR (interferometric synthetic aperture radar) SPOT5 HRS satellite imagery 1-second SRTM-based national DEM Aerial photography: o with the DEM sourced from existing 1:25,000 digital topographic mapping o with the DEM derived from recent ADS40 digital imagery An objective of the project was to look beyond differences in vertical resolution, cost and productivity, and to consider the overall performance of different DEMs in the context of fulfilling anticipated requirements for fit-for-purpose elevation data in Australia’s vulnerable coastal zones. Outcomes of the project can be used to inform the development of future guidelines covering optimal DEM generation technologies for programs such as UDEM and the National Digital Elevation Framework (NEDF). Recent forecasts of sea level rise are in the range of 0.5m to upwards of 1m over the remainder of this century. Digital elevation modelling in support of prediction and monitoring of the inundation impacts of sea level rise and storm surges will therefore require vertical resolution at the sub-metre and even decimetre level. A principal finding of this project has been to reinforce the prevailing view that LiDAR is the optimal DEM generation technology for this application. While DEMs produced photogrammetrically from aerial imagery can match the vertical resolution of LiDAR, namely around 10cm, they are invariably more expensive and exhibit significant shortcomings in bare-earth elevation modelling if automated classification and filtering are solely relied upon. Beyond highlighting the recognized superiorities of LiDAR, this project has identified DEM characteristics that are perhaps not as widely appreciated, but are nevertheless important in the context of producing accurate bare-earth DEMs of coastal terrain. One of these concerns the accuracy gap between LiDAR DEMs and those derived from airborne IfSAR and aerial photography. Comparing LiDAR accuracy (10cm) to IfSAR and ADS40 accuracy (50100cm), one would expect LiDAR DEMs to be at least 5 times better. However the difference are accentuated by shortcomings in the automated classification and filtering of both vegetation and, to a lesser extent, man-made structures, within the process of producing a bare-earth DEM from the latter two technologies. Multiple-return LiDAR on the other hand displays significant advantages by way of last-pulse ground definition, which cannot be
matched in densely vegetated areas by radar and photogrammetry techniques, except through skill-intensive and expensive manual editing processes. The results obtained for DEM performance in open areas, largely free of trees and buildings, highlighted the fact that distinctions in DEM accuracy are as much due to different terrain and land cover, and consequently to filtering, as to differences in the basic metric resolution of DEM technologies. In the case of open pasture, sub-metre accuracy was obtained for the SRTM DEM while the 1:25,000 mapping, the IfSAR DEM and the aerial imagery DEM all displayed sub-half metre accuracy. Although the accuracy of all these lower-resolution DEMs exceeded specifications, they are nevertheless still not likely to fulfill requirements for fit-for-purpose high-resolution elevation models for decision support and risk analysis associated with sea level rise.
3. and to the presence of cities and urban land cover. High-resolution airborne IfSAR. The focus of the analyses required to evaluate the performance of different Digital Elevation Model (DEM) technologies has been upon detailed assessments of the heighting accuracy produced by six DEM generation technologies within four test areas representing typical low-lying Australian coastal environments. and also their cost-benefit ratios in relation to producing fit-for-purpose elevation models for coastal assessments. Introduction This report summarises the objectives. originally from manual stereo-compilation of analog 5 . which formed a research project under the Urban Digital Elevation Modelling in High Priority Regions Program(UDEM). namely: Airborne LiDAR (Light Detection and Ranging technology). work plan. generated from these four data sources. rural and forest. the data having been generated over several decades. In addition to comparing DEMs. Results will therefore inform the development of guidelines covering optimal DEM generation technologies for vulnerable coastal zones.1. DEMs produced from different imaging and ranging sensors need to be analysed in order to better understand their characteristics and accuracy. 2. The new national Australian mid-resolution SRTM 1 DEM (derived from the Shuttle Radar Topography Mission IfSAR data). conduct and outcomes of the project Performance of DEM Generation Technologies in Coastal Environments. and specifically automatically produced DEMs from the Leica ADS40 3-line scanning system. with land cover types including urban. Outcomes of the project will provide an increased understanding of the characteristics of different elevation data technologies and how well they perform in Australian coastal environments. but also of the characteristics of the terrain being mapped. Project Overview The objective of this project has been to investigate the performance of different DEM generation technologies within a range of coastal environments. The quality of DEMs is a function not only of the data acquisition and subsequent data processing.000 topographic mapping. the work plan was extended to also encompass analysis of DEMs derived from the following sources: Photogrammetrically derived DEMs from digital aerial imagery. especially in regard to topography and vegetation. and in cases DSMs (digital surface models). Results will also be of benefit to producers of DEMs. Overview of DEM Generation Technologies 3. particularly to those producing elevation models under the National Digital Elevation Framework (NEDF) and UDEM.1 Technology Options It was initially envisaged that the research would investigate the accuracy capabilities of four categories of DEMs/DEM generation technologies. DEM data from current 1:25. The mid-resolution SPOT DEM (derived from approximately 5m resolution stereoscopic SPOT5 HRS satellite imagery).
3. 6 . This elevation model is referred to throughout this report as the Topo DEM. in the IfSAR case. which is indicated by the dashed line in the figure. LiDAR. and their purpose is to highlight the order of magnitude and more difference between the representative 15cm vertical accuracy of LiDAR and the 8-9m accuracy of the SPOT5 HRS and SRTM DEMs. of let us say a standard error (1-sigma value) of +/. it is still possible to infer to some degree the overall performance of these two technologies from the results obtained for the SPOT5 HRS and airborne IfSAR DEMs. with commercial operations not anticipated to commence for several months. Another important aspect related to DEM quality is the presence or absence of height bias. as a consequence of systematic errors in sensor positioning and orientation. Prior to describing the methodology and workflow of the project.5-1m expected accuracy for airborne IfSAR DEMs. Also ALOS PRISM DEMs should display higher overall accuracy than those from SPOT5 HRS. ADS40. These are briefly summarized in the following sections.2 Accuracy Considerations Associated with each DEM technology is an accuracy specification.15cm. this range being shown in Figure 1. More will be said in the following paragraphs about the accuracy specifications for each of the DEM technologies considered in this investigation. since DEM accuracy is a function of both sensor and topographic/land cover characteristics.aerial imagery and subsequently from digitisation of the resulting contour maps. DEM data from six of the above technologies was successfully sourced for the project. which can be local. which lessened the imperative to examine this DEM data source. and Geoscience Australia supplied the SPOT5 and SRTM DEMs. 2011. In the absence of PRISM and TanDEM-X data. IfSAR derived DEMS from the TerraSAR-X/TanDEM-X satellite radar system. Through reference to Figure 1 the reader can visualize that whereas a DEM may have high precision. but it is initially useful to appreciate the range of accuracy anticipated. The considerable variation in vertical resolution needs to be kept in mind when comparing the merits of different DEM generation options. or large-area. airborne IfSAR and Topo DEM data was made available by LPMA (NSW Dept. and in the case of LiDAR and photogrammetry it can vary according to project design requirements. This is generally expressed as a bound. the system is still within its initial commissioning phase. for example as a consequence of incomplete filtering of above-ground features in the DSM-to-DEM conversion process. However. it is useful to recall the accuracy associated with each DEM technology and salient characteristics of the DEM sources considered. Photogrammetrically derived DEMs from 3-line ALOS PRISM satellite imagery. The project team was unable to source both ALOS PRISM and TanDEM-X DEM data. The bounds shown are indicative only. In the case of tandem-X. respectively. The ALOS satellite unfortunately ceased to operate in late April. of Lands). since PRISM has double the spatial resolution and 3line scanner geometry. The figure shows representative 1-sigma accuracy bounds (68% confidence level) for each of the six DEM technologies. it may be inaccurate by the extent of the bias. TanDEM-X is anticipated to produce vertical accuracies at the 2m level as opposed to the 0.
This high point density greatly assists in filtering out non-ground artefacts in the conversion from the directly acquired DSM to the final bare-earth DEM. where the first return of a pulse indicates the highest point encountered and the last the lowest point. LiDAR stands alone in most practical respects as the most accurate and comprehensive means to produce highest resolution DEMs of coastal environments. In practice. and it can be operated ‘locally’. the resulting imagery being used both to assist in the artefact removal process and for orthoimage production. day or night. Thus. LiDAR has high productivity of around 300 km2 of coverage per hour. in the context of UDEM. One of the most significant attributes of LiDAR is multiple-return sensing. There may also be mid pulse returns.3 LiDAR Airborne laser scanning or LiDAR is today the clear ‘technology of choice’ for the generation of high-resolution DEMs with post spacings of of 1-3m. Moreover.Figure 1. it is generally not economical to opt for photogrammetry over LiDAR for DEM generation at vertical resolutions of 10-20cm. Whereas aerial photogrammetry techniques can yield DSMs of vertical accuracy equivalent to LiDAR. The advantages of LiDAR centre upon its relatively high-accuracy of generally 10-15cm in height and around 1/2000th of the flying height in the horizontal. LiDAR has been chosen in 7 . it can be safely assumed that a good number of the last returns will be from bare earth. Whereas it might not be certain from where in the canopy the first pulse was reflected. Representative 1-sigma vertical accuracy bounds for DEM technologies. 3. This greatly simplifies the DSM-to-DEM conversion process in vegetated areas. For this reason. As a consequence. data acquisition is generally confined to daylight hours since most LiDAR units nowadays come with dedicated digital cameras (usually medium format). and upon the very high mass point density of nowadays around 4 points/m2. LIDAR has the ability to ‘see through’ all but thick vegetation.
All satellite imaging systems used for 3D terrain modelling use line scanner technology. spatially separated from the first. and thus the ADS40 data should be thought of as constituting a bare-earth DEM over open terrain.5-1m has been adopted as representative of the capabilities of fully automated DSM production from digital aerial imagery. The latter is exemplified to some extent by current programs to create high definition.000 topographic map data. Also. The resulting Interferometric Synthetic Aperture Radar (IfSAR) system determines the relative heights of imaged ground points as a 8 . 3. which was obtained from 1:25. For example. Broad area DEM generation via photogrammetry is presently not the preferred approach. it is noteworthy that the final stage. Satellite imaging systems have gained popularity for DSM generation at vertical resolutions within the range of 1m to 10m. with the resulting elevation model often being employed to support orthoimage generation.5 IfSAR Synthetic Aperture Radar (SAR) has been employed for a few decades as an imaging technology in remote sensing. the dedicated DEM generation program of SPOT Image. one approach employs the Vexcel Ultracam digital camera flown in a block configuration of 80% forward overlap and 60% side overlap at an imaging scale that yields a 15cm ground sample distance (GSD). but only as a smoothed DSM for land cover comprising dense vegetation. followed up with initial stage automated DSM-to-DEM conversion. DEM data generated from 50 cm GSD imagery recorded by LPMA’s Leica ADS40 line scanning camera to a nominal vertical resolution of 0. DSM generation was automated with the advent of analytical stereoplotters and then further process automation accompanied the introduction of digital aerial imagery. DEMs produced from ALOS PRISM can be expected to display height accuracies of around 3-5m. Traditionally elevation data was extracted from stereo aerial photography in the form of contours. In order to quantify the accuracy of LiDAR against ground-truth. Through an augmentation of a conventional airborne or spaceborne SAR system with a second receiving antenna. photogrammetry has a long history.this project as the ‘standard’ against which the other DEM generation technologies are compared. except in special circumstances such as very high accuracy DSMs for 3D city modelling.4 Photogrammetry As a tool for topographic mapping. elevation data from a kinematic GPS survey of several thousand points has been used. DSM and subsequently DEMs to around 30cm vertical and 2-3m horizontal resolution can be generated with a high degree of automation through such a process. photorealistic models of major cities. the GeoEye-1 and World View-1 and -2 satellites have a 50cm GSD. For example. with the 2. For the present project. it has been possible to utilise the principles of interferometry to extend SAR from a 2D imaging system to a 3D topographic modelling technology. which uses the SPOT 5 HRS system. and to some extent in urban areas. yields DEMs with a nominal 5-10m height accuracy (1-sigma) and 2030m horizontal resolution.5m resolution ALOS PRISM satellite having a 3-line scanner geometry similar to that in the ADS40 aerial camera. as exemplified in this project by the Topo DEM. which will support DSM extraction to around 1-2m vertical accuracy. manually intensive classification and filtering was not carried out. along with data from permanent survey marks. The generation of a DSM from digital aerial or satellite imagery is today a fully automatic batch process. However. 3.
which is some 10-20 times the area acquisition rate of LiDAR (the IfSAR swath width is generally 8-20km). Recall that nominal vertical resolutions of the DEMS are: approximately 5-15m for SRTM and SPOT5 HRS. Thus. With the orbits of the two satellites being tightly controlled. after which interpolation was adopted to generate the final grid of 2m horizontal spacing.function of the phase difference of the coherently combined signals received at the two antennas. data collection in not impeded by clouds. appeared in the mid 1990s and global focus was brought onto the capabilities of IfSAR to produce DEMs with the successful completion of the Shuttle Radar Topography Mission (SRTM) in 2000. single-pass IfSAR operation is possible. as is vegetation removal using new techniques for polarmetric radar interferometry. full commercial operation of TanDEM-X had not commenced. Also shown in Figure 2 is the work flow adopted for the production of the reference LiDAR DEM from the measured mass points. it is useful to keep in mind that the DEMs being compared have accuracy ranges that differ by more than an order of magnitude. the Australian terrain can be characterized as being ideal for DEM generation via airborne radar.5–1m for airborne IfSAR and the ADS40 DEM. The intended elevation model product from TanDEM-X is a global DTED3 DEM of 12m post spacing and 2m vertical accuracy.5 . the principal aim of the analysis to be conducted is to better characterize the performance of these different DEM technologies within a typical Australian coastal environment. the current TerraSAR-X satellite has been joined in space by a second X-band SAR unit. The first commercial IfSAR system for DEM generation. to the point where an updated DTED 2 DEM with a post spacing of 1 second (30m) and a nominal vertical accuracy in the range of 6-12m has recently been released. Given that a main focus of this analysis is upon DEM accuracy.1m vertical accuracy. As at late May 2011. and 15cm for LiDAR. Project Work Plan Shown in Figure 2 is the workflow designed for the DEM analysis. Moreover. 4. though initial results from the system are reported as being very encouraging. TanDEM-X has considerable potential. Intermap Technologies have recently completed a large project within the Murray Darling Basin with their STAR system and produced DSMs with a stated 0. A second source of radar DEMs is single-pass spaceborne IfSAR. with national DEMs being commercially available through Intermap’s Nextmap product line. and a post spacing of 5m. 9 . rather than to reinforce wellrecognised differences in resolution and accuracy. Automated classification and filtering was based upon analysis of the multiple-pulse returns. From the standpoint of a DEM generation system that can economically provide 2m accuracy elevation models of Australia to horizontal resolutions of 10m. Beyond the heavily built-up areas of major cities and very rough mountainous areas. 3-5m for the 1:25000 Topo DEM (referred to here as the Topo DEM). Under the TanDEM-X program of Germany’s DLR and the Infoterra company. Moreover. Airborne IfSAR can record data at the very rapid rate of around 100-200 km2 per minute. This new SRTM DEM data was accessed for the current project from Geoscience Australia. 0. Over the past two or three years. the Intermap STAR 3i system. There have been a number of refinements made to the SRTM DEM of Australia over the past few years. use of stereo radar imagery as a complement to the process allows for semi-automated DSM-to-DEM conversion. there has been a considerable upsurge in 1m-accurate DEM generation via IfSAR.
at least when all DEMs are nominally referenced to AHD. Within the current project the principle adopted is that the interpolation should occur in the higher 10 . localized distortions in AHD will have no significant impact in the accuracy analysis for two reasons. involves bringing all DEM datasets into a uniform reference coordinate system. Especially important is uniformity within the height datum. height differences are being determined.As can be seen from Figure 2. In order to compare height values from different DEMs at specific positions. Project workflow. AusGEOID09 was employed to facilitate a one-step WGS84-to-AHD reference datum conversion. Firstly. A height conversion from ellipsoidal to orthometric is then carried out using both geoid height information from AusGEOID09 and. In the conversion of height data recorded in the kinematic GPS survey conducted as part of the project. the local relationship between AusGEOID09 and the Australian Height Datum (AHD) to facilitate a transformation of the DEM to AHD. interpolation is needed because of the multiple horizontal resolutions (post spacings) involved. Figure 2. All current DEM data acquisition technologies utilize GPS for absolute positioning and consequently the DEM datum is initially referenced to the WGS84 ellipsoid. the anticipated localized MSL versus AHD biases can be anticipated to be very small in relation to the overall error budget for all DEM data other than the LiDAR reference data. However. Secondly. the initial step in the accuracy assessment and analysis of differently sourced DEMs of varying resolution against the reference dataset. where applicable and if known. It is noteworthy that there can be discrepancies in actual ‘local’ MSL and AHD amounting to 70cm or more as a consequence of sea-surface topography. which is taken to be LiDAR data. which nullifies the effect of absolute biases in the datum.
2) Topographic variation. in order to minimize smoothing effects. this factor has only been briefly analysed here.resolution DEM. ranging from grassland to scrubland and forest. Fulfilment of the latter criterion turned out to be the factor that most influenced the selection of test area locations.and medium level hills. it was necessary to select specific test sites.and high-resolution DEMs from airborne IfSAR. Moreover. 3) Variation in landcover. which in combination fulfilled the following requirements: 1) Coastal zone with mixed vegetation. for example. LiDAR and photogrammetry (from ADS40 aerial imagery). In accordance with the different height resolutions of the DEMs being considered. there was coverage from SRTM. the fact that photogrammetry techniques beneficially support manual artefact removal in a visual 3D environment. ADS40 and LiDAR were not available. A result of this approach is that the number of sample points will vary proportionally to the horizontal resolution of the DEM being compared to the LiDAR reference data. Thus. Shown in Figure 3 are the four selected test areas: Area 1 (128 km2) extends from South West Rocks to the Stuarts Point/Grassy Head area and comprises varied coastal topography and 11 . The reasons for this are. from urban to rural to bushland and forests. where there had been recent production of medium. 4) Containing extensive areas below 10m elevation and open to the coastline. It is important to keep in mind that the characteristics of both the underlying terrain and the particular sensor technology will dictate the degree of complexity of the DSM-to-DEM process. IfSAR DSMs can be accompanied by intensity images that support stereo visual interpretation to aid in the DSM-to-DEM conversion. whereas removal of above ground features in LiDAR DSMs is greatly aided by both the high density and vertical resolution of the mass points and the provision of multiple returns (ranges) which allow penetration of the vegetation layer. especially as a function of ground slope. Test Area Locations Two criteria governed selection of geographic location for the DEM analysis: 1) suitability in the context of overall assessment of coastal zone vulnerability to climate change. and. since the choice was essentially limited to the mid north coast of NSW. and different land and vegetation cover. 1:25000 topographic mapping and SPOT5 HRS. the metadata necessary to comprehensively consider slope and aspect for the IfSAR. to undulating low-level coastal sand dunes to low. height comparisons require interpolation within the 2m horizontal resolution LiDAR DEM. The analysis was thus limited to gridded DEM data only. with only mild topographic variation. on the accuracy and integrity of bare-earth DEMs. secondly. Also. and 2) availability of elevation model coverage from as many data acquisition sources as possible. ranging from floodplains. this interpolation being bilinear as opposed to bicubic. 5. firstly. different levels of initial artefact removal and filtering have been applied in the DSM-to-DEM conversion. Issues include. Although there have been a number of published reports on the performance of different DEM generation techniques in different topography. that by its very nature the vulnerable coastal zone is low-lying. A principal aim of the project was to assess the influence of both man-made structures in an urban environment. with automated processes alone being largely relied upon. Following the selection of the general test area based on data availability.
vegetation cover. 12 . namely the settlement of Scotts Head. and Figure 5 highlights the areas below 10m elevation within each of the four test sites. Area 2 (76 km2). Area 4 (72 km2 ) was added to the initial three in order to provide further coverage of dense coastal forest areas. Area 3 (24 km2) covers Crescent Head and this was selected based on the varying terrain of the headland. with locations shown for 9 permanent survey marks used as GPS checkpoints. as well as an additional urban area. constitutes the sample low-lying urban area. which is centred on the town of Kempsey. Area 4 Area 1 Area 2 10 km Area 3 Figure 3: Test areas. The DEMs within each of the test areas are shown in Figure 4.
(d) Area 4 13 .(a) Area 1 (b) Area 2 (c) Area 3 Figure 4: LiDAR DEMs for each test area.
(a) Area 1 (b) Area 2 (c) Area 3 (d) Area 4 Figure 5: Areas below 10m elevation (black areas are >10m or outside area). 14 .
were used in a comparison of GPS-derived AHD heights versus those of the permanent survey marks.03m 3m 0.IMG) ASCII Horizontal accuracy (RMSExy) 10m Vertical accuracy (RMSEz) 5-10m SPOT5 DEM Space photogrammetry Aerial photogrammetry (50 cm GSD) Intermap STAR 3 & 4 IfSAR Space-borne IfSAR Airborne Laser Scanning Aerial photogrammetry.5m 0.15m Topo DEM Ground check points 6m 0.03m 7. With the exception of the 1-second SRTM and SPOT5 data. 15 . however time constraints and difficulties imposed in locating the permanent survey marks beyond township areas meant that the number of checkpoints was restricted to nine. Table 1.IMG) 5 m grid (.BIL) ESRI binary 30m grid (. Dataset Technology Data format ESRI binary 30m grid (. This number would be sufficient to indicate the presence of any localized biases in the AHD reference system that were not modeled via the AusGEOID09 Geoid model.6.5m 0.ADF) ERDAS 8 m grid (.LAS) ERDAS 25m Grid (.5 . Specifications of DEM Datasets and GPS survey data. Specifications of DEM Datasets Shown in Table 1 is a summary of the specification for the different DEM datasets employed in the project. Benchmark Elevation Data 7. which was crucial to realization of the project objectives. In order to assess the quality of the LiDAR ‘standard’ against ground survey data that is directly referenced to AHD to a nominal accuracy of better than 10cm.3m 0. 1:25000 mapping Kinematic GPS ADS40 DSM Airborne IfSAR DEM SRTM DEM 0. which were made available by Geoscience Australia (GA) . The elevations of nine benchmarks.1m 7m 6-12m LiDAR mass points 0.ADF) 2m grid (.1 Permanent Survey Marks The reference elevation model against which DEMs from different data sources are compared is taken as the LiDAR DEM. It had originally been intended to employ additional benchmarks as ground checkpoints. the locations of which are indicated in Figure 3. surveyed benchmark data within the test area was accessed.5-1m 1. The project is indebted to LPMA and GA for this support. all DEM data was kindly provided to the project by the Land and Property Management Authority (LPMA) of the NSW Department of Lands.
An illustration of the problems posed by vegetation in the RTKGPS surveys is provided in Figure 12. there are practical limitations to utilization of thinly distributed benchmark and permanent survey mark data as an accurate base against which to assess LiDAR DEMs. The most practical way of acquiring such data is through the use of real-time kinematic GPS (RTKGPS) surveying where a GPS receiver is mounted in a vehicle and 3D positions to an accuracy of a few cm are determined through the use of either a nearby radio-linked base station or a CORS network. roads tended to be ‘covered’ by overhanging trees. in the first instance. 7. GPS surveyed AHD heights can then be directly compared to elevations of benchmarks (BMs) and permanent survey marks (PMs). for two reasons. the mode of operation was to utilize a base station that broadcast corrections to the vehicle-borne roving receiver via a radio link. Stuarts Point. The only feasible approach for assessing the absolute accuracy of LiDAR DEM data covering the UDEM test areas is through the provision of GPS surveyed bare-earth elevations. Not only are there uncertainties of several cm in the height relationship between the ellipsoidal WGS84 and AHD reference systems. since the only available basis for comparison is elevation data acquired from ground surveys. of the ground surveyed elevations. either via GPS or standard surveying techniques of spirit or trigonometric levelling. The vegetation cover is indicative of most of the native forest areas within the region. South West Rocks. One benefit of being restricted to open roadways was that heights to the same points would have been readily recorded within the LiDAR survey. Secondly. Kempsey and Crescent Head. Notwithstanding these shortcomings.7.2 GPS Survey of Height Profiles Prior to the adoption of airborne LiDAR as the highest accuracy ‘master’ elevation data set against which other DEM generation technologies are compared. For the conversion of both LiDAR and GPS surveyed heights to elevations referenced to AHD. which shows favourable and unfavourable areas for data collection within the Stuarts Point area. beyond townships. RTKGPS surveys were conducted in five areas: Scotts Head. comparisons were to be made with the elevation data recorded within the vehicle-borne Real-Time Kinematic GPS (RTKGPS) Survey. some 27. within an ellipsoidal height reference system. which blocked reception of the GPS signals. namely WGS84. This accounts for most of the ‘broken’ height profiles shown in Figures 6-11. discrepancies between the RTKGPS heights and those determined from LiDAR yield an indication of the accuracy of the LiDAR system free of the effects of uncertainty in the relationship between the ellipsoidal and the orthometric height datums. Firstly. it is necessary to apply a geoid correction. it was necessary to validate the absolute accuracy of the LiDAR DEM. and the effective maximum distance for radio reception was about 4km depending upon topography. which have traditionally been established via spirit leveling. Both technologies yield elevations. with only the low-lying test area around Kempsey (Area 2) being largely free of forest cover.3 Comparison of GPS and Ground Survey Elevations In order to ascertain the absolute accuracy of the LiDAR DEM data.000 elevation readings at generally 3-5m intervals were made to 2-4cm accuracy over the roads indicated in the figures. As will be explained in a following section. again several cm. For the present project. The surveyed height profiles were mainly restricted to areas in or near townships. This is by no means a simple matter in practise. in this case via the AUSGeoid09 correction model. 16 . but there is also the inherent accuracy limitation. In this sense.
Scotts Head Stuarts Point SW Rocks Kempsey Crescent Head Figure 6. Elevation profiles recorded by kinematic GPS in Scotts Head (Area 4). Elevation profiles recorded by real-time kinematic GPS in the four test areas. Figure 7. 17 .
Elevation profiles recorded by kinematic GPS in South West Rocks (Area 1). Figure 9. Elevation profiles recorded by kinematic GPS in Stuarts Point (Area 4). Figure 10. Elevation profiles recorded by kinematic GPS in Kempsey (Area 2).Figure 8. 18 .
A principal cause of discrepancies between GPS surveyed AHD heights and those for BMs/PMs can be anticipated to be localized biases in Geoid modeling. Either way.1m over the 50km from Crescent Head to Scotts Head. coupled with the anticipated accuracy (95% confidence) level of only 5-8cm for ground surveyed BM/PM elevations suggests that RMS discrepancies in the order of 10cm might well be expected between GPS and ground surveyed elevations.4cm and it is noteworthy that there is a systematic trend in the discrepancy values at two of the locations. The overall RMS value of height discrepancies is 9. it is more appropriate to use RTK GPS heights rather than benchmark data. the results suggest that in order to independently ascertain the accuracy of the LiDAR data.Figure 11. In the case of the test areas considered. Table 2 lists the results of the GPS to BM/PM height data comparison for nine survey marks in the Kempsey. from 30. Scotts Head and Crescent Head areas. These are indicative of either one or two factors: firstly. and by 0. Constraints on kinematic GPS surveying: unfavourable vegetation conditions (left) and generally favourable conditions (right). 19 .7m to 31. Elevation profiles recorded by kinematic GPS in Crescent Head (Area 3). the geoid correction value N varies by 1. This fact. systematic errors in the BM/PM data. Figure 12.8m.4m over the 20km from Crescent Head to Kempsey. localized biases in AUSGeoid09 or. secondly.
92 41. whereas Table 4 lists the corresponding results when height discrepancy values of greater than three times the standard deviation (ie 99% confidence level) of H values are omitted.83 -0. Subsequent comparisons of the LiDAR DEM heights to ground surveyed data will utilize only RTKGPS data.91 3.78 31.35 23.86 -0.07 3.93 23.36 31.24 39.04 GPS11 GPS14 GPS17 Crescent Head PM12869 PM12867 PM12884 41.65 11.61 29.77 13.84 13.4 GPS Heighting versus LiDAR DEMs The LiDAR DEM has been adopted as the reference DEM in view of its significantly higher accuracy.77 -0.89 8.08 23.03 9.28 0.04 0.63 45.12 -0.09 1.64 91.75 30. as compared to the other DEM generation technologies.11 29.79 31.80 10. The resulting discrepancies in elevation are summarized in Tables 3 and 4.04 -0. namely 10-15cm.000 individual RTKGPS height measurements were compared to elevations interpolated from the gridded LiDAR DEM via bilinear interpolation.88 8. the RMS discrepancy.70 -0.39 120.76 30.61 10. as far as was practical. a comparison with the profiles of RTKGPS data described above was conducted. Table 3 shows results when all RTKGPS points are included. some 27.10 -0.01 0.54 91.39 61. the bias-free standard deviation of the discrepancies H and the size of the sample within each of the four test areas is listed. Comparison between GPS surveyed and published elevations for nine benchmarks/permanent survey marks (units are metres). and the fact that both data sets were transformed from ellipsoidal to orthometric heights via the AusGeoid09 geoid model.02 9.12 31. GPS Point PM Ellipsoidal Height from GPS Geoid Separation Orthometric height ΔH from Levelling Height of PM from GPS True height of PM Error in Height (m) Kempsey GPS06 GPS10 GPS16 PM25886 PM25983 PM26032 54.77 4.78 30. In assessing the heighting discrepancies between the RTKGPS and corresponding points from the LiDAR DEM.06 31.18 8. and generally also resolution.12 -0.46 -0.04 -0. In order to validate.73 6.01 0.For the purposes of this study it suffices to note that the level of agreement between BM and PM data and RTKGPS is of a similar magnitude to the 1-sigma elevation accuracy anticipated from airborne LiDAR data.63 1.65 13.07 Scotts Head GPS10 GPS12 GPS13 PM56083 PM93242 PM72384 36.19 0.74 10. the absolute accuracy of the LiDAR derived elevations.95 3.40 31.77 -0. Table 2. where the heighting bias of LiDAR (-ve value indicates higher LiDAR elevation). it should be kept in mind that given the 2-3cm accuracy of the laser ranging component.10 6.18 7.63 90. elevation differences will primarily be a function of: 20 . Within this process.07 29.66 34.
07 0. Scotts Hd No.04 0. which is consistent with a normal distribution. Kempsey 3.22 Test Area 1. Shown in Figure 13 are plots of the positions of RTKGPS points. in Area 3 because of a higher than expected positive height bias for the LiDAR.12 Std. Table 3. Stuarts Pt 2. discrepancies in the GPS surveying of platform positions.14 0. of points 4880 10188 5740 6311 Table 4. respectively. In many respects the comparison of elevations along roadways would be expected to yield optimal results. Crescent Hd 4. deviation of ΔH 0. Comparison between RTK GPS surveyed elevations and those from the LiDAR DEM. for the Stuarts Point and Kempsey test fields. only 1% of discrepancy values fell outside 3-sigma error bounds. White indicates within 1standard deviation of ΔH (ie within 1-sigma). all GPS points included (Units are metres). This issue will be addressed following a general summary of the results of the RTKGPS versus LiDAR comparison. ie in the removal of above bare-ground features. since the filtering issue is minimized. It is difficult to definitively establish the reasons for the larger mean LiDAR heighting bias in Crescent Head. Comparison between RTK GPS surveyed elevations and those from the LiDAR DEM.05 0. where neither the bias value nor the standard deviation of height discrepancies is significant given the 1-sigma accuracy of the LiDAR of around 15cm. Crescent Hd 4. in the case of the test areas considered. green between 2and 3-sigma.07 0. blue between 1.06 0.12 0.16 0. Mean elevation discrepancy (heighting bias) 0. However. of points 4842 10130 5097 5831 In the context of validating the LiDAR DEM via RTKGPS data.12 % of points removed (ΔH >3 1% 1% 11% 8% Test Area 1. the results listed in Tables 3 and 4 are quite encouraging for two of the test areas. though preliminary analysis suggests that it may in fact be due to a combination of both errors in the LiDAR DEM and lower than expected accuracy within the RTKGPS data.24 Std. Areas 1 and 2.02 -0.02 -0. and in Area 4 because of a high RMS discrepancy value.06 0. with the height discrepancy at each point being indicated by a coloured dot. there were instances were roadside vegetation appeared to influence localized filtering results. The corresponding figures for rejected points (ΔH >3 in Areas 3 and 4 are much higher at 11% and 8%. Stuarts Pt 2. However.10 0. airborne and terrestrial. It is also noteworthy in Table 4 that.and 2-sigma.12 0. GPS points where ΔH is greater than 3 times the standard deviation are omitted (Units are metres).11 0.13 -0. deviation of ΔH 0. Mean elevation discrepancy (heighting bias) 0. and red greater than 3-sigma. the level of compatibility is less than expected within the remaining two areas.04 RMS elevation discrepancy 0. Scotts Hd No.10 0. the sigma values being those listed in Table 4. 21 . and errors in the filtering of the LiDAR data. Kempsey 3.04 0.14 -0.09 RMS elevation discrepancy 0.
It can be difficult to accurately attribute errors in the determination of absolute elevation to the LiDAR DEM versus the RTKGPS data. Sample discrepancies in LiDAR DEM versus RTKGPS elevation data. Crescent Head. This shows the ‘error’ arising when the vehicle borne GPS crosses a railway bridge. A final example.Note in the upper two of the three images how GPS errors are suggested by distinctly different ΔH values being obtained in overlapping runs of the vehicle borne GPS survey. and here one could infer that the heighting error is more likely to have arisen within the LiDAR processing. is also shown. the LiDAR DEM can be safely taken as the benchmark against 22 . blue. which needs no explanation. some 4-5m above the underlying DEM. This is particularly apparent in the right-hand image covering a road roundabout. The elevation cross section through the LiDAR DEM. the lower image of Figure 13 shows systematic error in a double run along the edge of what is essentially a cliff face. Given that the next highest resolution DEM to be considered has a nominal vertical accuracy of 50cm. However. 1-2 sigma. A further example of where the height discrepancies are more likely attributable to shortcomings in LiDAR classification and filtering is shown in Figure 14. Figure 13. Note how the discrepancies increase for a double-run RTKGPS survey exactly at the transition between an open urban area and a heavily forested area. at the position indicated by the yellow line. White indicates within 1-sigma. and red. is indicated by Figure 15. >3 sigma. 2-3 sigma. there is the consolation in this investigation that height discrepancies are of a sufficiently small magnitude where they are consistent overall with the 1-sigma vertical accuracy specification of around 15cm for the LiDAR DEM. green. On the other hand.
and blue 1-2 sigma. White indicates within 1-sigma. Kempsey. Analysis of Different DEMs against LiDAR Reference DEM 8. 8. for each different data acquisition technology investigated. The areas of comparison have been restricted to those indicated in Figure 5. Also shown is the cross section height profile corresponding to the yellow line. both being relative to the LiDAR DEM. and red greater than 3-sigma. Sample discrepancies in LiDAR DEM versus RTKGPS elevation data. the RTKGPS versus LiDAR DEM analysis has highlighted practical issues that still hinder the acquisition of DEMs with vertical accuracies of better than. whereas the h is free of the overall mean bias. h will always be equal 23 . White indicates within 1-sigma. 10cm. Figure 14. which are deemed most vulnerable to the impact of rising sea level and storm surges. The results represent an initial summary of overall accuracy in these regions. above-ground structures such as buildings. South West Rocks. as quantified by both the Root Mean Square height discrepancy/Error value (RMSE) and the estimated standard error (h).1 Discrepancies in Elevation Shown in Tables 5 and 6 are results from initial comparisons of DEMs against the LiDAR ‘standard’. Thus. Discrepancies in LiDAR DEM versus RTKGPS elevation data at bridge crossing. ie to areas with an elevation of 10m or less.which to assess the remaining DEM generation technologies. Notwithstanding the acceptance of this benchmark status. say. Figure 15. This analysis has indicated that remaining shortcomings in the DSM-toDEM conversion for LiDAR data are most apparent in the classification and filtering of vegetation as opposed to man-made. The distinction between these two measures is that the RMSE includes the error arising from systematic height biases.
4 0. 10m for the Topo DEM and 5m for both the IfSAR and ADS40 DEMs.3 3. Some 40% of ADS40 data points in Area 4 were classed as 24 .9 2. Threshold=5m) IfSAR DEM (Area 4.4 0.4 2. Accuracy evaluation result against LiDAR derived reference DEM.6 RMSE (m) 3. Threshold=5m) ADS40 DSM (Area 1.9 2. These are removed from the computation of the RMSE and standard deviation values. Table 5.1 3.1 0. The outlier thresholds (cut-off values) in Table 6 impose a tighter tolerance on data acceptance than those of Table 5. Dataset SRTM DEM (Area 1.9 1.1 1. Threshold=10m) IfSAR DEM (Area 1. The area that was most noise-free.4 0. These values correspond roughly to multiples of three to five times the respective standard deviations.1 4. or gross errors.2 1.5 Sample Size 85740 51625 13075 20927 79077 51443 12359 18962 123454 74354 18906 30377 3038739 1855859 473092 701487 852493 695044 116038 179993 % removed 0.8 0. with the two estimates being equal when there is no mean height bias.6 39. Threshold=5m) ADS40 DSM (Area 4.6 1. Threshold=10m) Topo DEM (Area 4.8 7.3 0. was Area 2 and the ADS40 DEM constituted the noisiest data. The cut-off height discrepancy values in Table 5 were set at 15m for SRTM and SPOT5 data.6 2.8 3.7 5.02 0.3 0.0 2.7 1.03 0 0.3 4.9 The distinction between Tables 5 and 6 lies in the adopted threshold for classification of particular height discrepancy values as outliers.6 3. Threshold=10m) Topo DEM (Area 3.5 -0.6 h (m) 3.3 0. Threshold=5m) IfSAR DEM (Area 2.3 0. Threshold=10m) Topo DEM (Area 2. and the different threshold values afford an indication of the extent of noise within each DEM data set.01 0. Threshold=5m) ADS40 DSM (Area 3.8 1.8 5.0 2.4 2.1 4.2 2.0 0.4 0. Threshold=15m) Topo DEM (Area 1.5 1.5 10.5 1. as per the %-removed column.6 1.3 3.4 1.5 6.0 0.4 37. as expected.8 1. Threshold=5m) IfSAR DEM (Area 3.0 1.7 1.5 4. Only height differences below listed thresholds were included and those above removed.1 0. Threshold=15m) SRTM DEM (Area 3.2 2.1 0.8 2. Threshold=15m) SPOT5 DEM (Area 3. Threshold=15m) SPOT5 DEM (Area 4.4 4. Threshold=15m) SPOT5 DEM (Area 2.7 29. Threshold=15m) SRTM DEM (Area 2.9 0.5 1.3 5.2 4. Threshold=5m) Height bias (m) 0.3 4.9 2.2 2. Threshold=15m) SPOT5 DEM (Area 1. Threshold=15m) SRTM DEM (Area 4.06 0.7 8.8 0.4 5. Threshold=5m) ADS40 DSM (Area 2.to or smaller than the RMSE.8 0.9 0.9 1.8 1.0 2.
7 3.1 0. Threshold=5m) Topo DEM (Area 2.3 3. Threshold=10m) SPOT5 DEM (Area 2.9 17.1 1.6 1. Threshold=10m) SPOT5 DEM (Area 4.8 10.0 h (m) 3.1 2. findings could be briefly summarizes as follows: 25 .1 0.2 1.3 1.1 2. Table 6.5 6.1 0. Threshold=10m) SPOT5 DEM (Area 1.6 4.7 0.1 1. Threshold=10m) SRTM DEM (Area 2. some unique to particular DEM data acquisition technologies and others common to all.6 1.8 1.2 2.3 4. Threshold=3m) Height bias (m) 0.3 0.1 6.7 1. Threshold=3m) ADS40 DSM (Area 1. Threshold=3m) ADS40 DSM (Area 3.6 0. Threshold=3m) ADS40 DSM (Area 4.6 11.9 1.8 5. Dataset SRTM DEM (Area 1.outliers.5 2. which is no doubt attributable to incomplete classification and filtering within forested areas. coupled with the plots in Figures 16-20 showing height discrepancies above given thresholds.3 1. Threshold=5m) Topo DEM (Area 3.3 2.1 0.2 4.3 0.1 2.0 4.9 4.3 RMSE (m) 3.9 1.0 2.2 3. Threshold=10m) SRTM DEM (Area 4. DEM performance in urban areas will be addressed in a later section of this report.7 1.8 2.0 Sample Size 84665 51508 12735 19908 75763 50700 11655 17325 119997 62730 17461 28473 2889079 1828944 458564 651056 723999 683764 103057 160370 % removed 1.7 0.1 1. Only height differences below listed thresholds were included and those above removed. Threshold=3m) IfSAR DEM (Area 3.1 0.5 4. Threshold=10m) Topo DEM (Area 1.5 46. Crescent Head and Scotts Head.8 2.7 15.0 0.1 3.7 3. Threshold=5m) Topo DEM (Area 4.0 44. Threshold=5m) IfSAR DEM (Area 1.7 6.6 0.2 2.3 0. all lie at elevations above 10m.8 1. as per the %-removed column. Threshold=10m) SRTM DEM (Area 3.4 A feature to note is that due to the restriction of the analysis to elevations of less than 10m. Threshold=3m) IfSAR DEM (Area 2.2 40. reveal a number of characteristics. Threshold=3m) IfSAR DEM (Area 4.2 1.7 1. Threshold=10m) SPOT5 DEM (Area 3. there is limited initial consideration of DEM performance within urban environments.8 1. Accuracy evaluation result against LiDAR derived reference DEM.7 7.4 -0.8 0.5 4.6 5. In the latter category.3 2.8 15.0 2. since most of the town of Kempsey.7 2.4 0.2 2.9 1. as well as significant parts Southwest Rocks.2 0. Threshold=3m) ADS40 DSM (Area 2. The results in Tables 5 and 6.4 0.
tend to be concentrated in a small number of areas.2m for Area 2 to 4.6% in the worst case (Area 4) and 0. Based on results obtained in the foregoing analysis. This enhances the prospect for a better fit to the bare-earth LiDAR DEM. A further encouraging feature of the SRTM DEM. whereas the standard error of the SPOT5 DEM displayed lower than expected standard error values of 2 . which increase with increasing elevation. At a 15m or approx. Heighting blunders exceeding 15m are confined to a small number of local vegetation clusters in Area 4. IfSAR and ADS40 DEMs. As anticipated. and along two watercourses. at least to a moderate extent. but a disturbing.3m for the heavily forested Area 4. both heighting biases and height RMSE values are generally larger for Areas 1.3m. 3 and 4 in Figure 16. namely around 3m. The accuracy associated with each DEM technology.5m.3% in the best (Area 2). It is also noteworthy that there is a concentration of outlier points both within vegetated valley areas.1m and 3. respectively.4m were significantly lower than anticipated. 3 and 4 than for Area 2. as assessed via the RMSE and h values was basically consistent with or better than suggested by specifications. 5sigma threshold the number of rejected points falls below 1%. persistent height bias of close to 5m. The lack of forest cover in the extensive open floodplain area around Kempsey accounts to a large degree for this characteristic. The number of points with height discrepancies exceeding 10m (roughly 3-sigma) reaches 5. In the case of the Topo DEM. the systematic errors in DEM heights. the following general summaries of DEM accuracy can be offered: 8. The accuracy of the Topo DEM was close to specifications. with the majority of the area being free from ‘rejected’ points. with corresponding uniform RMSE values of 4.2 SRTM DEM When assessed against the basic accuracy specifications for the 1-second SRTM DEM. the distribution of RMSE values and standard errors for each case are correlated to the presence or absence of forest.9m and 0. but not for the SPOT5 and Topo DEMs. which is equal to or slightly below expectations. the values instead range from 2. It is noteworthy that the mean biases for the SRTM and airborne IfSAR DEMs are 0. where extensive manual filtering has been carried out. Instead of finding an RMSE in the range of 6-12m. since the positive bias effect of the DEM being in reality more of a canopy DSM in forest areas is absent.5-5. In the case of the SRTM data the RMSE values of around 2 . although influenced by the presence of forest. the achieved RMSE. as summarized in Tables 5 and 6. is that the distribution of height discrepancies exceeding the 10m threshold is characterized by concentrations in a few. Also as anticipated. The main conclusion regarding the GA-supplied 1-second 26 . The corresponding 1-sigma values are 2. as opposed to being distributed widely throughout forested regions. whereas the IfSAR and ADS40 DEMs displayed an accuracy level in the range of 0. It can be seen that the bias and RMSE values follow this trend for the SRTM.3m. which can be seen for Areas 1. In the case of the SPOT5 DEM there is a relatively uniform bias of 4-5m across all three areas.6m. mainly forested locations.5m. standard error (1-sigma) and mean height bias values are very impressive. There should be an expectation that automated DSM-to-DEM conversion will yield better results for IfSAR versus photogrammetrically derived DEMs generated through image matching because of the ability of radar to penetrate vegetation.7m to 1.
Red areas representing a 10m threshold are overlaid by blue areas representing a 15m cutoff (areas not to scale). Area 1 Area 2 Area 3 Area4 Figure 16: Points within the SRTM DEM with height discrepancies greater than threshold values when compared to the LiDAR reference DEM.SRTM DEM is that within the coastal areas considered it is more accurate than specifications would suggest. 27 . and it is free of significant height biases when assessed against RMSE values.
This is consistent with the expectation that the Topo DEM should have fewer filtering errors and thus fewer %-removals because of the map compilation process being based on manual stereoplotting from aerial photography. the resulting standard errors for the SPOT5 DEM are 3m or just under in Areas 1. there being over 8% in Area 1. The corresponding 1-sigma values were basically the same as a consequence of the modest bias values of 0. corresponding to a third of the contour interval of 10m.5 Airborne IfSAR DEM With the relatively coarse rejection threshold value of 5m or approximately 5-sigma assigned to the airborne IfSAR DEM. the DEM exhibits degraded accuracy due to the presence of significant height biases. it is could arise in large part in this case from errors in the exterior orientation of the stereo satellite imagery.2. One can only speculate as to the cause of the systematic heighting error. with a 10m removal threshold for height discrepancies.8m in Area 2.5m in Area 4. For example.8m in Area 1. but it is nevertheless interesting that the points removed are concentrated in localized. Of concern. which is largely devoid of forest cover. 2. 2m in Area 2. which had a range of 1. the attained accuracy of the IfSAR DEM was not well within specifications. and just below 2m in Area 2. Initial expectations for the Topo DEM would then be an RMSE at the 3m level. 8. The latter assumption is supported to some degree by the percentages of the rejected points where the height error exceeded a 15m threshold.000 topographic mapping is 3m. they are not viewed as significant given the corresponding 1-sigma values. This is well within specifications. with localized occurrences of height biases as opposed to the area wide bias seen in the SPOT5 DEM. DEMs generated from SPOT5 HRS imagery could be expected to show a standard error in elevation within the range of 5-10m.5m in Area 3 and 1. The mean height biases obtained for the Topo DEM.7m.4 Topo DEM (from 1:25.5m or less. The rejected points are concentrated mainly in areas of dense coastal forest. 28 . however.7 to 6.3 SPOT5 DEM In the absence of height biases.000 map data) The vertical accuracy specification typically associated with 1:25. 10% in Area 4. While the biases in Areas 2 and 3 are higher than one would anticipate for a 3m-accurate DEM. which results in RMSE values ranging from 4. mainly forested areas. when the threshold is reduced to 10m. Unlike the three lower resolution DEMs discussed above.2% or less for all four areas.4m in Area 4.1m in Area 3 and 1.9 . perhaps as a consequence of insufficient or inaccurate ground control within the block adjustment process.8.4% in Area 2. The rejections grow to greater than 10% in Areas 1 and 3. is the very significant height bias of over 4 . 0. Alternatively.4m in Area 1. Initial indications are that whereas the precision of relative heights is within specifications for SPOT5 data.0m. and to 18% in Area 4. 1. 8. The number of points with height discrepancies greater than the 10m cutoff (nominal 3-sigma value) was 0. The higher %removal values shown for a 5m cutoff in Table 6 can be discounted somewhat because the threshold is set too tight at only 2-sigma. 3 and 4. were 0. and a predictably lower 0. It is encouraging to see that with a point rejection threshold of 15m. 6% in Area 3. resulting RMSE values were 1. even in the absence of vegetation. as shown in Figure 18.5m in all four test areas. it might be attributable to shortcomings in the filtering of vegetation within the DSM-to-DEM conversion. with the distribution of the rejected points being shown in Figure 17.
Area 1 Area 2 Area 3 Area4 Figure 17: Points within the SPOT5 DEM with height discrepancies greater than threshold values when compared to the LiDAR reference DEM. 29 . Red areas representing a 10m threshold are overlaid by blue areas representing a 15m cutoff (areas not to scale).
Area 1 Area 2 Area 3 Area4 30 .
the regions with most rejected points correspond to hilly terrain with steeper slopes. with vegetation cover appearing as a more significant issue than the presence of buildings and other man-made structures. it is apparent that a significant factor limiting vertical accuracy in the generation of supposedly bare-earth DEMs is the automated classification and filtering in forest and urban areas. Impact of Land Cover on DEM Accuracy Based on the results obtained in the analysis of performance of the five DEMs against the LIDAR reference DEM. and the %-removal value drops from 30% or more to 4%. their associated discrepancy values against the LiDAR data being greater than 5m or roughly 5-sigma. where it can be seen that the majority of the elevations within forested areas were rejected as outliers. The results of the analysis for these three test sites are shown in Table 7. The height bias for Area 2 is also reduced to 0. Once again. ie an RMSE value of less than 1m. the accuracy was generally consistent with expectations and even a little worse than anticipated. elevation bias. where the RMSE value for the 5m threshold falls from the near 2m level of Areas 1. Generally speaking. The accuracy indicators of RMSE and standard error changed marginally when the rejection threshold was lowered from 5m to 3m. As can be seen in Figure 19. the results obtained with the IfSAR DEM were in accordance with accuracy expectations.6 ADS40 DEM The ‘DEM’ derived from ADS40 digital 3-line scanner aerial imagery was in fact a ‘smoothed’ DSM that had undergone some initial automated classification and filtering. 9. and mixed coastal cover of vegetated dunes and housing. Some 40% of the height discrepancy values in Area 4 were rejected. 8. 3 and 4 to 1m. Given the incomplete filtering. and to 2% and 4%. (b) the commercial centre of South West Rocks (Area 1). for Areas 2 and 3. open farm land. it is difficult to characterize the accuracy of the ADS40 DEM (actually DSM).1 Urban Areas Figure 21 shows three sample ‘urban’ areas: (a) a part of the coastal settlement of Scotts Head (taken from Test Area 4). Instead. RMSE and standard error of height discrepancies were quantified using the LIDAR data as the reference DEM. but it is encouraging to see results in Area 2 which are consistent with accuracy specifications.3m from closer to 1m for the remaining areas. respectively. and (c) a low-lying residential area of West Kempsey (Area 2). analyses were carried out for samples of four specific land cover types: urban. 9. which has the same structure as the earlier Tables 5 and 6. and significantly more points were removed. 31 . with the technology performing best in low lying areas. respectively.000 map data) with height discrepancies greater than threshold values when compared to the LiDAR reference DEM. The %-removal values climbed to 7% and 15% in Areas 1 and 4. Red areas representing a 5m threshold are overlaid by blue areas representing a 10m cutoff (areas not to scale). In order to gain further insight into the impact of different land cover on the DEM technologies considered.Figure 18: Points within the Topo DEM (1:25. and to a lesser extent to forested areas. forest/bushland. The assumption that the RMSE values were inflated by an incomplete DSM-to-DEM conversion is reinforced by the results of the mostly forest free Area 2. The first indication of the partial filtering of the ADS40 DSM is indicated in Figure 20.
Red areas representing a 3m threshold are overlaid by blue areas representing a 5m cutoff (areas not to scale).Area 1 Area 2 Area 3 Area4 Figure 19: Points within the airborne IfSAR DEM with height discrepancies greater than threshold values when compared to the LiDAR reference DEM. 32 .
Red areas representing a 3m threshold are overlaid by blue areas representing a 5m cutoff (areas not to scale).Area 1 Area 2 Area 3 Area4 Figure 20: Points within the ADS40 DEM with height discrepancies greater than threshold values when compared to the LiDAR reference DEM. 33 .
6 3 1.1 1. Threshold=5m) IfSAR DEM (Area b.9 1. Accuracy evaluation result against LiDAR derived reference DEM for three Urban Test Areas. Only height differences below listed thresholds were included and those above removed. (b) South West Rocks and (c) West Kempsey.7 6.1 6. Threshold=5m) ADS40 DSM (Area b.5 RMSE (m) 2.1 0.4 1.1 0.5 0.5 1. Threshold=5m) Height bias (m) 1. Threshold=5m) IfSAR DEM (Area c.2 6.5 1.7 2. Sample labels correspond with those in Figure 21.3 1.3 1.4 34 . Dataset SRTM DEM (Area a.5 1.9 3. Threshold=10m) IfSAR DEM (Area a. as per the %-removed column. Threshold=15m) SPOT5 DEM (Area b.1 0 1.7 0.8 -1 0 -0. (a) Scotts Head. Threshold=10m) Topo DEM (Area b.3 2.5 2.9 1. Threshold=5m) ADS40 DSM (Area c. Threshold=15m) SRTM DEM (Area b.1 0.9 0. Threshold=15m) TopoDEM (Area a.6 3. (a) (b) (c) Figure 21: Urban test areas.9 1.6 1.5 2.4 1.4 1.2 1 1. Threshold=15m) SPOT5 DEM (Area a.7 -0.3 -0.8 -1.9 Sample Size 273 150 403 273 150 403 243 150 403 10043 5512 14800 3828 2135 5725 % removed 0 0 0 0 0 0 11 0 0 0.1 7. Threshold=10m) Topo DEM (Area c. Threshold=5m) ADS40 DSM (Area a. Table 7.8 3 1.2 1 h (m) 2.9 6. Threshold=15m) SRTM DEM (Area c. Threshold=15m) SPOT5 DEM (Area c.4 0.6 7.
the bias value has increased over that listed in Tables 5 and 6. while the third is flat. (a) West Kempsey. is not at all consistent with a shortcoming in building classification and filtering. The results achieved for the three urban areas for the Topo. is characterized by buildings taller than a single story and it is thus not unexpected to see a more significant bias being present. for all five 35 .5m to 3m. at between 6m and 7m. The South West Rocks town centre. it is a gross positive height error likely attributable to a failure to utilize local ground control in the exterior orientation determination for the HRS imagery. which is indicative of a more successful filtering of buildings in the automated DSM-to-DEM conversion. The results of the analysis for these test sites are shown in Table 8. In the case of SRTM. (b) Yarrahappini and (c) Stuarts Point Shortcomings in the DSM filtering required in the area shown in Figure 21a. where it can be immediately seen that the DEM accuracy improves significantly when the need for extensive filtering is removed from the DSM-to-DEM transformation. (a) (c) (b) Figure 22: Open rural test areas. both SRTM and SPOT5 yield standard errors of height discrepancies in the range of 1.The first feature of note in Table 7 is that for the SRTM and SPOT5 DEMs.2 Open Rural Areas Figure 22 shows the three selected open rural area sites: (a) open grassland with thinly distributed houses and trees in West Kempsey. Figure 21b. In terms of accuracy. Upon compensation for the bias. IfSAR and ADS40 DEMs show an overall reduction in height bias. which comprises a relatively small number of houses and trees. Instead. (b) open fields near Yarrahappini and (c) ploughed fields south of Stuarts Point. 21b and 21c. is enough to significantly inflate the RMSE value compared to that for the bare-ground areas of Figs. it is safe to assume that this is attributable to an incomplete removal of buildings in the DSM-to-DEM conversion. the RMSE values obtained are largely consistent with those obtained in the full-area evaluations. 9. The first two areas are gently undulating. The bias value for SPOT5.
3 0.4 0.7 0 0 1.4 0.5 3.5 0.6 0. the accuracy of SRTM.6 0.9 4. The table indicates a number of interesting features worthy of note.2 3.6 0. Only height differences below listed thresholds were included and those above removed.2 -0. Threshold=10m) SRTM DEM (Area c.3 Forest/Bushland Areas Figure 23 shows the three selected forest/bushland sites: (a) Dense tall (>10m) eucalypt forest at Yarrahappini.3 -0. as per the %-removed column. once again. Given the largely insignificant height biases and RMSE values that are within specifications.DEMs.8 -2.6 0. Threshold=3m) ADS40 DSM (Area a.4 0. Threshold=10m) SPOT5 DEM (Area b.6 0.3 0.9 0. In the open areas. The results of the analysis for these test sites are shown in Table 9.8m.6 1. Threshold=3m) IfSAR DEM (Area b.6 0.7 0. Accuracy evaluation result against LiDAR derived reference DEM for three Open Rural Test Areas.5 1.7 4. is better than 1m.3 0.4 0.1 0 0 Given that the cultivated area shown in Figure 21c was likely bushland at the time the Topo DEM was produced. and the corresponding values for the IfSAR and ADS40 DEMs are between 0.6 0. 9. including an area of mangroves.4 1. Figure 23a. Threshold=10m) SPOT5 DEM (Area a. Threshold=3m) ADS40 DSM (Area b.2 0.3m is land clearing and subsequent earthworks to create the cultivated fields. Indeed.4m and 0. as expressed through the RMSE.3 3. Threshold=10m) SPOT5 DEM (Area c. with virtually all of these being found in the DEMs covering the scene with houses and trees. the SPOT5 DEM.6 -0. Table 8.3 RMSE (m) 2.3 0. Threshold=5m) Topo DEM (Area b. (b) Tall forest near Grassy Head and (c) scrubland covering a coastal dune at Stuarts Point. Firstly. it is not surprising to see so few points classified as outliers. Threshold=5m) IfSAR DEM (Area a. Threshold=10m) SRTM DEM (Area b.1 -0. Threshold=10m) Topo DEM (Area a.2 -0. Sample labels correspond with those in Figure 22.1 0 0 1.2 0. Threshold=3m) Height bias (m) -1. the accuracy of the SPOT5 DEM is no better than 10m in absolute terms. the probable reason for the bias figure of -2.8 1 0.3 0 0. it can be seen that some 91% of the sample points are 36 . Threshold=3m) ADS40 DSM (Area c.6 0. Dataset SRTM DEM (Area a.4 3. Threshold=5m) Topo DEM (Area c.6 Sample Size 703 374 286 702 374 286 691 374 286 25087 13802 9726 9860 5376 3854 % removed 0 0 0 0.4 0.6 0. Threshold=3m) IfSAR DEM (Area c. Also exhibiting a large positive bias is. The absolute accuracy for all DEMs is within specifications for all three test sites.2 1 1.7 h (m) 1.9 2. in the heavily forested area.
4 1.8 0.2 -2. Threshold=10m) IfSAR DEM (Area a. (a) (b) (c) Figure 23: Forest/Bushland test areas (a) Yarrahappini.6 1.3 0. Threshold=5m) ADS40 DSM (Area b.4 4 2.7 1.7 1.2 0.3 0. where agreement with the LIDAR DEM is 0. Threshold=10m) Topo DEM (Area b.2 0. Threshold=15m) SPOT5 DEM (Area c.9 1. Threshold=15m) Topo DEM (Area a.2 4.9 1. the cause no doubt being a combination of the already referred to exterior orientation bias and an inadequate removal of vegetation from the DSM. Threshold=15m) SRTM DEM (Area c. Contrasting to the poor accuracy of the SPOT5 and ADS40 DEMs is the result for the airborne IfSAR DEM in the same area. Threshold=15m) SPOT5 DEM (Area a.7 10.7 Sample Size 240 60 395 21 60 395 240 60 395 8910 1888 15017 5 529 5907 % removed 0 0 0 91 0 0 0 0 0 0 0 0. meaning they are in error by more than 10m. (b) Grassy Head Road.4 3. Threshold=5m) ADS40 DSM (Area a.9 2.8 0.3 1.2 2.1 4.2 -0.4 1. Threshold=15m) SRTM DEM (Area b.8 99.1 RMSE (m) 2.7 Another DEM showing a high bias value in thick forest was that from ADS40 imagery.5 0. and (c) Stuarts Point Beach.3 9.5 -0.3 1.5m RMS.2 1.rejected as outliers. Threshold=10m) Topo DEM (Area c.9 28 0. Dataset SRTM DEM ( Area a.5 -3. Accuracy evaluation result against LiDAR derived reference DEM for three forest/bushland areas. Sample labels correspond with those in Figure 23. 37 . Threshold=5m) IfSAR DEM (Area b.6 3.8 3.4 1. Threshold=5m) IfSAR DEM (Area c. Threshold=15m) SPOT5 DEM (Area b. Only height differences below listed thresholds were included and those above removed. though this was to be anticipated given the low level of filtering undertaken with this data.2 2 0.5 1.4 0.2 2. Threshold=5m) ADS40 DSM (Area c.5 1.7 4 4.7 h (m) 1. Threshold=5m) Height bias (m) 2. as per the %-removed column. Table 9.8 1.
namely that the RMSE is higher than specifications for the DEM technologies would suggest. the results for the forested areas are consistent with expectations.7 1.9 6 3. The chosen test area shown in Figure 24 is representative of much of the low-lying coastal environment along Australia’s eastern seaboard that is vulnerable to sea level rise and storm surges. Accuracy evaluation result against LiDAR derived reference DEM for coastal area of mixed land cover. The RMSE of the SRTM elevations is a commendable 3m. Only height differences below listed thresholds were included and those above removed. Threshold=5m) Smoothed ADS40 DSM (Sample 1.4 Mixed Coastal Land Cover The final land cover type sampled could be characterized as mixed coastal dunes. Figure 24: Coastal area of mixed land cover. Threshold=10m) IfSAR DEM (Sample 1.39 10. largely due to the now quite familiar large bias of also close to 6m.7 2.5 1. Threshold=15m) Topo DEM (Sample 1. Neither systematic error is immediately explainable.1 2.2 0.8 1.7 244 233 244 8557 3281 0 4. scrubland. Arakoon. Threshold=5m) -1. 24. Table 10. though RMSE values which are outside specifications by approximately 0. 9.51 0 9.7 0.7m. Given these results it is observed that the particular combination of land cover types does not reveal any distinctive performance characteristics which might not be apparent in the data covering the broader test areas. Threshold=15m) SPOT5 DEM (Sample 1.6 2. Dataset Height bias (m) RMSE (m) h (m) Sample Size % removed Smoothed SRTM DEM (Sample 1. The results shown in Table 10 show largely the same characteristics as those presented in Table 5 for the full test areas.2 5.Also noteworthy in Table 9 are the negative height biases of the SRTM DEM in the coastal scrubland and mangrove environment of Figure 23c and the Topo DEM in the tall bushland of Figure 23b. whereas the SPOT5 elevations show an RMSE of 6m. bush and built-up urban area. as per the %-removed column.1 2. with the achievable accuracy being inversely proportional to vegetation density.87 38 .7 1. Both the ADS40 and IfSAR DEMs have small biases. as shown in Fig. Overall.6 2. with a modest bias. with its RMSE value being marginally higher than expected. The Topo DEM also has a larger than expected bias given that the test area is right on the coast.
The values shown represent discrepancies between the LiDAR reference elevations and the SRTM.5m in near-flat areas to 7. the current project offered a favourable opportunity to examine how different DEM technologies behaved in areas of differing topography. which contains both the steepest and most forested terrain. Shown in Figure 25a-d are plots of the variation of RMSE values for DEM elevations for slopes from 50 to 500 within the four test areas. Another feature of the plots is that in addition to the airborne IfSAR and ADS40 DEMs displaying significantly higher accuracy 39 . it is interesting to note that the mean errors.10. are impacted in the cases of SRTM and SPOT5. essentially heighting biases. being most pronounced in Area 1. Error cut-off thresholds of 15m apply for the SRTM. Whereas the impact of forest is not anticipated to significantly influence the character of the plots. Topo. Whereas. SPOT5 and Topo DEMs. Influence of Terrain Slope It is well established that the performance of DEM generation technologies is generally degraded as a function of increasing terrain slope. but a value of 5m is obtained for Area 4. Steep terrain adversely impacts especially upon image matching in stereo photogrammetric techniques and upon radar interferometry. (a) Area 1 (b) Area 2 (c) Area 3 (d) Area 4 Figure 25. The mean error for SPOT5 derived elevations increases from around 4. whereas a cut-off of 5m applies to the IfSAR and ADS40 data. The accuracy degradation with slope is clearly apparent.5m in areas displaying slopes of between 250 and 500. Plots of RMSE values against LiDAR elevations for different DEM technologies for different terrain slope. airborne IfSAR and ADS40 DEMs. The biases are considerably less for SRTM. SPOT5. the impact of slope might not be of prime importance within low-lying coastal topography potentially affected by sea-level rise.
9 5.4 1.9 5.5 5.3 -1.6 0.8 0.2 4. RMSE values for DEMs assessed against LiDAR DEM at different ground slopes.9 0.7 2.7 1.4 0.4 5.1 8 7.3 4.2 2.8 1.9 25-50 Height bias 1.8 RMSE 4.2 7. Slope category % DEM SRTM (Area 1) SRTM (Area 2) SRTM (Area 3) SRTM (Area 4) SPOT5 (Area 1) SPOT5 (Area 2) SPOT5 (Area 3) SPOT5 (Area 4) Topo (Area 1) Topo (Area 2) Topo (Area 3) Topo (Area 4) IfSAR (Area 1) IfSAR (Area 2) IfSAR (Area 3) IfSAR (Area 4) ADS40 (Area 1) ADS40 (Area 2) ADS40 (Area 3) ADS40 (Area 4) Height bias 0. Table 11.2 0.7 -2.9 -1.9 1.7 4. in the context of terrain modelling within low-lying coastal zones.5 0.8 RMSE 7 4.2 4.5 4.9 5.9 1.9 1.2 4.3 1. only the airborne IfSAR and the ADS40 DEMs.3 3.8 0.7 2.5 3.5-1m for IfSAR and the ADS40.6 RMSE 5.7 4.4 3.8 5. Yet. Units are metres.9 0.2 2.8 2.5 0-5 RMSE 3.3 5-15 Height bias 1.9 0 -0. the findings from the evaluation of the performance of DEM generation technologies are consistent with expectations regarding both accuracy and recognised attributes and limitations of the different DEM data sources considered.8 1. Overall.8 1.9 5.4 0.3 0.1 -0. 40 .4 1.4 1 0.5 -1.9 6.7 2 1.4 5.5 1.5 -0. the results of the analysis of the influence of slope on DEM technologies has served to further emphasise that of the five DEMs considered.7 -0.1 4.2 0. as can be seen from Figure 25 and from Table 11.8 2.7 1. their performance is less influenced by terrain slope.4 5.8 -0.8 1.5 -1.4 -0.2 1. SRTM and Topo DEMs.2 0.7 1.4 3.7 3.3 -0.4 6 6.5 5.1 1.5 5.3 Conclusions In most respects.1 4.5 1. However. The accuracy gap between LiDAR DEMs and those from airborne IfSAR and ADS40 aerial photography at 50cm GSD might only be a factor of three to four according to specifications.6 4.9 4.2 0 0.8 0.7 4.1 1.4 3 3.6 3.6 0.4 0 4.2 1.9 -0.1 2. though a mild fall off in accuracy with increasing slope is apparent.4 2.8 1.1 5 5.1 5.8 5.9 1.9 1.4 6. this project has also revealed characteristics of the different DEMs that are perhaps not as widely recognized.8 2.9 1 1.3 2.9 1.1 6.4 0.7 2.3 0 -0.than the SPOT5.5 1 0.2 -0.4 8 7. eg 15-25cm elevation accuracy for LiDAR versus 0.8 15-25 Height bias 1 0.1 0.4 0.3 3.1 2.7 4. but are nevertheless important in the context of producing accurate bare-earth DEMs of coastal terrain vulnerable to the impact of climate change.2 4.2 2.2 1.3 0.6 2.3 -0.2 4.5 -0. are of sufficient accuracy and reliability.1 5.3 0.2 0 2.7 7.2 3.6 5.5 1. RMSE values for IfSAR and the ADS40 DEMS are nevertheless at a higher than desired level of 1-2m.4 1.5 6.6 0. as well as the LiDAR reference data of course.6 3.4 0.2 0.
but here the bias problem was very significant. the following short summaries of the performance of each of the DEM generation technologies in the four selected test sites on the mid north coast of NSW are offered: The integrity if the LiDAR ‘master’ DEM was validated through checks against the 27.However. Whereas the removal of vegetation and building from the DSM through automated classification and filtering can be expected to be more complete with multiple-return LiDAR than with radar or Topo DEMs. In the case of the open pasture (Area b). and are therefore generally positive in sign. and indeed in the case of the 1-second SRTM accuracy significantly exceeded specifications. The systematic error effects then flowed through to the image matching and object point triangulation phases. which cannot be matched in densely vegetated areas by radar and photogrammetry techniques. In the case of the SPOT5 DEM. largely free of trees and buildings. Elevation biases are generally attributable to incomplete filtering of vegetation and buildings. to the point where this DEM has little utility for higher resolution terrain modeling. The results listed in Table 8 for DEM performance in open areas. relative vertical accuracy within specifications. It must be kept in mind. irrespective of land cover.15m. as to differences in basic metric resolution of the different technologies. and to a lesser extent. which was performed without the use of local ground control. 41 . and the IfSAR and ADS40 DEMs showed sub-half metre RMSE values. the SPOT5 DEM also produced a relative accuracy well within specifications. As a consequence of the classification/filtering issues. and consequently to filtering. man-made structures within the DSM-toDEM conversion of the radar and photogrammetrically produced DEMs. a 4-7m systematic elevation error was present. In regard to the five DEM generation technologies evaluated against LiDAR within the project. sub-metre RMSE values were obtained for the SRTM and Topo DEMs. Finally. The residual systematic elevation errors attributable to incomplete filtering of DEMs have the potential to compromise the integrity of bare-earth elevation models in low-lying coastal areas that are either heavily vegetated or urbanized. it can be concluded that LiDAR is very much the preferred option for DEM generation in coastal regions vulnerable to sea level rise and storm surges. each produced localized. this difference is accentuated by shortcomings in the automated classification and filtering of both vegetation and. When corrected for bias.1m. highlight the fact that distinctions in DEM accuracy are as much due to different terrain and land cover. though there is an absence of available tools to assess the extent of such systematic errors. Multiple-return LiDAR displays significant advantages by way of last-pulse ground definition. Such land cover accounts for the majority of the populated coastal regions of Australia. the difference in vertical resolution between different DEM data sources. This bias likely arises due to accuracy shortcomings in the exterior orientation determination for the SPOT5 line scanner imagery. except through skill-intensive and expensive manual editing processes. the presence of residual height errors over dense vegetation cover and low-level man-made features can be anticipated to some extent. that all checkpoints were positioned along open roads where issues with filtering in the DSM-to-DEM conversion do not arise. This is entirely consistent with the anticipated RMS elevation accuracy of the LiDAR DEM of 0. which revealed an overall RMS height discrepancy value of close to 0. however.000-point kinematic GPS survey. to a lesser extent.
the better than 1m height accuracy attained in the smoothed DSM is consistent with accuracy specifications. as quantified by an RMSE value of around 5m. which has only minor coverage of either scrubland or forest. However. The airborne IfSAR DEM displays an accuracy at the high end of its anticipated 0. which is inside specifications. Acknowledgments This work was funded by the Australian Government Department of Climate Change and Energy Efficiency.5 to 1m range. but it displays a disturbingly high systematic height bias averaging around 5m. The 1-second SRTM DEM. The Topo DEM derived from 1:25. a comprehensive DEM accuracy analysis was precluded. it is noteworthy that within Area 2. with its RMSE value range of 2. 42 .000 topographic map data is internally quite consistent and displays an accuracy in accordance with its 3m specification. and has optimal accuracy in low-lying areas with sparse vegetation coverage.1m. in some cases due to changes in land cover. appears to be a more accurate bare-earth elevation model than its accuracy specifications would suggest. partially filtered DSM.2 to 4. Given that the ADS40 elevation model was really a smoothed. The SPOT5 DEM also produces an accuracy. This DEM displays localized areas of systematic height bias.