Professional Documents
Culture Documents
A R T I C LE I N FO A B S T R A C T
Keywords: The understanding of subsurface events that cannot be directly observed is dependent on the ability to relate
Change detection surface-based observations to subsurface processes. This is particularly important for nuclear explosion mon-
Unmanned aerial systems itoring, as any future clandestine tests will likely be underground. We collected ground-based lidar and optical
Lidar imagery using remote, very-low-altitude unmanned aerial system platforms, before and after several under-
Underground explosions
ground high explosive experiments. For the lidar collections, we used a terrestrial lidar scanner to obtain high-
Structure-from-motion
Nuclear explosion monitoring
resolution point clouds and create digital elevation models (DEMs). For the imagery collections, we used
Photogrammetry structure-from-motion photogrammetry techniques and a dense grid of surveyed ground control points to create
high-resolution DEMs. Comparisons between the pre- and post-experiment DEMs indicate changes in surface
topography that vary between explosive experiments with varying yield and depth parameters. Our work shows
that the relationship between explosive yield and the extent of observable surface change differs from the
standard scaled-depth-of-burial model. This suggests that the surface morphological change from underground
high explosive experiments can help constrain the experiments' yield and depth, and may impact how such
activities are monitored and verified.
⁎
Corresponding author.
E-mail address: eschultz@lanl.gov (E.S. Schultz-Fellenz).
https://doi.org/10.1016/j.rse.2020.111871
Received 11 October 2019; Received in revised form 27 April 2020; Accepted 6 May 2020
Available online 18 May 2020
0034-4257/ Published by Elsevier Inc. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/BY-NC-ND/4.0/).
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Schlittenhardt, 2001; Zelinski et al., 2014; Coblentz and Pabian, 2015), morphological change characterizations were conducted for individual
its use for characterizing underground nuclear tests has been so far experiments within a sequence of multiple, controlled underground
limited to the announced tests of the Democratic People's Republic of conventional high-explosive experiments in granite. Here, we compare
Korea (DPRK) (e.g., Wei, 2017; Wang et al., 2018; Pabian and Coblentz, the results from two different change detection modalities (terrestrial
2018), where the observations cannot be compared against verified light detection and ranging scanners, known as TLS or lidar; and pho-
yields. Remotely sensed change detection has the potential to provide togrammetry), and discuss how measurement technique, geology, ex-
significant insight on yield/depth trade-offs. However, this cannot be plosive yield, and depth of burial influence surface signatures.
done without a better understanding of how surface signals manifest With respect to surface response to explosions, previous work has
from underground explosions, a field in need of significantly more used the term “spall” in two different ways. The first describes the
study. For example, at the current time, it is unclear (1) whether the physical manifestation of permanent geologic deformation and/or
surface change from any given underground explosion will manifest as surface morphological change (e.g., Glasstone and Dolan, 1977;
uplift or subsidence, and (2) what specific parameters govern this Adushkin and Leith, 2001; Khalturin et al., 2005). The second (e.g.,
manifestation. Eisler and Chilton, 1964; Viecelli, 1973; Merkle, 1980; Patton and
The most commonly documented and identified surface morpholo- Taylor, 2011) describes an interval of time when surface accelerometers
gical changes related to United States (U.S.) legacy underground nu- measure a period of freefall, (i.e., −1 g acceleration). While both uses
clear explosions were surface fractures (referred to as cracks in older of the term refer to interactions of the explosive seismic wave with the
literature; e.g., Barosh, 1968; Grasso, 2003 and references therein) and free surface, their implications are different. McKeown et al. (1967); as
subsidence features, including collapse sinks/craters (e.g., Houser, reported by Allen et al., 1997) observed that while cracks from UNEs
1969; Hakala, 1970; Allen et al., 1997; Vincent et al., 2003). Signatures are most prevalent and best developed within the region of accel-
of topographic uplift such as doming or bulging were documented only erometer-measured spall, it was not uncommon for cracking to occur
twice in post-experiment surface change analyses of the more than 800 outside this zone. This paper discusses the permanent deformation re-
underground nuclear explosive experiments conducted by the U.S. since sulting from the SPE experiments, and our use of the term spall herein
the Limited Test Ban Treaty took effect in 1963 (Allen et al., 1997; refers to the physical manifestation of deformation at the surface and
Grasso, 2003; U.S. Department of Energy, 2015). Cattermole and does not necessarily indicate any particular accelerometer measure-
Hansen (1962) characterized and discriminated uplifts ≥30 cm in large ment at that location. Similarly, since the paper discusses geologic
(10- and 50-ton) high explosive experiments. Most previous measure- controls on deformation, our use of fracture herein refers to cracks,
ments of surface deformation were conducted using individually sur- joints, or other breaks in rocks.
veyed control points or along level lines (e.g., Cattermole and Hansen,
1962; Dickey, 1968, 1969; Bucknam, 1972); the data were not collected 2. Geologic setting, experimental series, and test bed
for every underground nuclear explosion, and the tools available at the
time of the experimentation may not have captured cm-scale topo- The experiments of SPE Phase 1 are located within the Nevada
graphic change. Furthermore, the legacy photogrammetric techniques National Security Site (NNSS, formerly the Nevada Test Site; Fig. 1),
used to quantify explosion-induced surface effects focused largely on within a Cretaceous igneous granitic body comprised of porphyritic
crater volume changes (e.g., Love and Vortman, 1967; Garcia, 1989) or biotite quartz monzonite known as the Climax Stock (Houser and Poole,
major surface morphologic changes (Morris, 1973), and do not explore 1961; Orkild et al., 1983). The Climax Stock is bounded by faults along
the possibility of subtle uplift or subsidence. its south and east sides (Fig. 1). The NE-trending Boundary Fault, lo-
Recent improvements in surface morphological change detection cated southeast of the SPE test bed, merges with the NNE-trending
techniques now enable much higher-resolution topographic datasets to Yucca Fault to the east. This major basin-bounding normal fault sepa-
be collected in the field, requiring less time (Barnhart and Crosby, rates the quartz monzonite stock from the nearby Yucca Flat alluvial
2013; Piras et al., 2017; Di Traglia et al., 2018; Favalli et al., 2018; valley and accommodates as much as 600 m of throw (Maldonado,
Schultz-Fellenz et al., 2018). As these field collection techniques and 1977). The Tippinip Fault, located immediately west of the Climax
commercial off-the-shelf topographic model development software stock, strikes north (e.g., Houser and Poole, 1961; Barnes et al., 1963;
suites offer affordable, flexible modalities for repeat data collection and Orkild et al., 1983). The nearest approach of any regional fault to the
processing, four-dimensional analyses lie within reach for many appli- SPE site is the Boundary Fault, 280 m to the southeast (Fig. 1). The
cations (e.g., Tannant, 2015; Warrick et al., 2017). Similar techniques predominant pre-existing fracture orientations within the Climax stock
for data collection have been carried out to understand processes re- are subhorizontal, and the secondary fracture set strikes WNW-ESE, and
lated to natural changes in surface topography (e.g., Klawitter et al., dips steeply to the NNE-SSW (Fig. 2) (Houser and Poole, 1961; Barnes
2017). These techniques facilitate the detection and identification of et al., 1963; Orkild et al., 1983; Wilder and Yow Jr., 1984). There is a
very subtle uplifts (< 5 cm) from underground chemical explosive ex- less prominent fracture set sub-parallel to the Boundary Fault, dipping
periments, where they are not otherwise apparent (Schultz-Fellenz steeply ESE, and likely aligned with the modern stress field.
et al., 2018). Yet the full value of these techniques lies not just with Phase 1 of SPE involved six individual subsurface chemical ex-
detection of explosion signatures, but with the potential ability to plosive experiments of varying depth and yield. The first experiment,
constrain the role that geology (i.e., the local tectonic/structural re- SPE-1, was very small and deep, intended to obtain an approximate
gime, material properties, pre-existing induced damage, saturation), Green's function (i.e., elastic response) for later experiments. Since the
depth, and yield have on the formation of such signatures from un- experiment had a heavy initial focus on seismology, there were neither
derground explosions. A better understanding of the processes involved predictions nor the expectation of surface damage, so no surface change
with surface damage (e.g., spall) could enhance the ability to detect and detection data were collected against SPE-1. An effort to quantitatively
characterize clandestine underground nuclear explosions using remote assess the no-surface-effects hypothesis followed the initial experiment,
methods, including seismic data. and surface morphological change detection studies were performed for
The first phase of the Source Physics Experiments (SPE), performed each Phase 1 experiment following SPE-1. Therefore, this work ex-
under the auspices of the U.S. Department of Energy's National Nuclear amines quantitative relationships of spatial distribution of damage re-
Security Administration, provided a scientific framework to observe lated to five underground explosive experiments that took place in the
and analyze surface morphological change with varying underground same emplacement hole, although the depth and yield of the experi-
explosive experiment parameters. SPE aims to advance the physical ments varied. The surface damage information presented here helps
understanding of seismic wave propagation through geologic media validate other real-time field geologic and geophysical measurements
(Snelson et al., 2013). As part of this effort, detailed surface (including surface effects mapping, subsurface microfracture density
2
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Fig. 1. Map of the study area, showing simplified geology. Modified from Houser and Poole (1961). Inset shows outline of the Nevada National Security Site (NNSS)
and its location within the state of Nevada. The locations of three nearby legacy nuclear tests are shown in black stars. Coordinate system shown is NAD83, UTM Zone
11n, meters.
and orientation analyses, downhole accelerometer instrumentation, and conducted within the Climax Stock, with the largest in terms of an-
seismic wave analyses recorded from nearfield and farfield sensors; e.g., nounced yield being the PILE DRIVER test (U.S. Department of Energy,
Snelson et al., 2013; Patton, 2015; Larmat et al., 2017), and provides 2015; Table 1), located ~760 m to the northeast of the SPE area. Maps
critical input into predictive models (e.g., Larmat et al., 2017). All ex- of surface effects from PILE DRIVER show an area of concentrated
periments in the SPE Phase 1 series were conducted underground, fractures (Grasso, 2003) at the approximate location of the SPE test bed
within the same 0.91 m-diameter borehole. Where this borehole meets as it exists now, likely because a graded pad had already been con-
the ground surface is a reference point known as surface ground zero, or structed at that location (the site was later reused for the SPE tests) and
SGZ. This emplacement borehole is located within a test bed, which is a suggesting the SPE site had experienced geologic damage prior to the
graded pad area inset into a bedrock hillslope (Fig. 3). initiation of this experiment series in 2011. Since the SPE test bed was
The SPE test bed sits proximal to three underground nuclear tests re-graded and prepared for the experimental series starting in 2010, the
3
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
and systems employed for SPE-5 and SPE-6 are described in Schultz-
Fellenz et al. (2018) and key parameters for both the UAS flights and
SPE Phase 1 experiments are summarized in Table 2 and Table 3, re-
spectively. Surveyed positions of all GCPs and benchmarks in the SPE-5
and SPE-6 campaigns are included in Appendix A.
In both data capture methods, PreX and PostX data acquisition oc-
curred as close to zero-time as possible to rule out other formation
processes for observed signatures. The surface change detection team
were among the first researchers allowed back to the experimental pad
after the execution of experiments. However, following some SPE ex-
periments, issues like carbon monoxide gas venting and geyser-like
water evacuation from instrumentation boreholes near the main em-
placement hole caused delays of as much as 24 h in accessing the ex-
perimental pad for field data collection.
4
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Fig. 3. Map showing some of the surface effects mapped after PILE DRIVER (1966), and compiled by Grasso (2003). The PILE DRIVER surface ground zero is located
approximately 760 m northeast of the SPE SGZ. Grasso (2003) transferred fracture traces from mylar overlain on aerial photography from the 1960s, potentially
causing minor distortion when projected to modern coordinates. Background imagery circa 2017 from ESRI ArcMap 10.6. Coordinate system shown is NAD83, UTM
Zone 11n, meters.
Table 1
Published parameters of three U.S. underground nuclear explosions (UNEs) conducted in the Climax Stock. Latitude and longitude locations are the surface ground
zero location of the drill hole or other emplacement location, surveyed in NAD27, State Plane Coordinate System 12,702, and converted to the World Geodetic
System 1984 reference model, shown in decimal degrees. From U.S. Department of Energy (2015).
Climax Stock UNE Date Latitude Longitude Yield (W; tons TNT equiv.) Depth, m
and Midgley, 2016). SPE-5 and SPE-6. In addition to the immediate SGZ area and pad sur-
face in general, geologists photographed areas thought to be most
susceptible to showing surface effects, such as borehole casings and
3.4. Surface effects mapping slopes. Each site at which a photo was taken was given a station
number, which was annotated on the orthophoto base map. Features
Surface effects (e.g., fractures, separation of ground or grout from photographed pre-test were re-photographed post-test. The photos were
well casing, slumping/debris fall, enhanced desiccation cracks, fluffed then visually compared to determine if any surface effects were visible
soil, degassing features, soil fallback, and shifted equipment) for SPE-2 that were not obvious in the field.
through SPE-6 were visually mapped by geologists on foot using tech- The 1–3 m accuracy of available hand-held GPS units was deemed
niques similar to those employed for surface effects mapping after un- inadequate for measuring the closely spaced fractures near the SGZ, so a
derground nuclear explosive tests during the Weapons Testing Program handheld GPS was not used to collect location data. Surface effects were
at the NNSS (Allen et al., 1997). Mapping was done for SPE-3, SPE-5, plotted from visual observations directly on an aerial orthophoto using
and SPE-6 on the day after the test. The SPE-4prime site was mapped an existing features for location. When larger distances to known features
hour after execution, and SPE-2 effects were mapped seven days after made plotting fractures on the orthophoto less accurate, fractures were
execution. also located by measuring from the features with a tape measure and by
Photographs were taken after each experiment to document the taking bearings with a pocket transit. The surface effects were later
surface effects. Pre-test photographs of the SPE pad were taken prior to
5
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Table 3
Parameters of SPE Phase 1 experiments, including surface change detection measurement details from each experiment in the series. Surface morphological change
detection analyses were performed for all experiments except for SPE-1. Chemical high-explosive experiment yields are presented in terms of tons of trinitrotoluene
(TNT) equivalence. Explosive types: SHANFO = sensitized heavy ammonium nitrate/fuel oil; C4 = Composition C4 plastic explosive; PBX = polymer-bonded
explosive. sDOB = scaled depth of burial, which is a calculated indication of confinement of an explosion; TLS = terrestrial lidar scanning; UAS = unmanned aerial
system. Experiment operational constraints drove scheduling of PreX and PostX collections. Surface distance is the maximum horizontal distance to edge of 2 cm
uplift area from the center point of the emplacement hole at the test bed ground surface post-experiment, as measured on map. Range distance is the straight-line
distance from that same point, and is calculated from the centroid depth of the experiment as noted in Table 1.
Experiment Depth, m Yield (W, Explosive Surface change PreX PostX Max Max Total Max Δz Max Δz range
(sDOB, tons TNT Type field data Collect Collect uplift, subsidence, cm surface surface distance, m
Name Date 1 equiv.) capture Date Date cm change distance, m
m/ kt 3 ⎞⎟ modality area, m2
⎠
SPE-1 5/3/ 55.1 0.09 SHANFO n/a n/a n/a n/a n/a n/a n/a n/a
2011 (1230)
SPE-2 10/ 45.7 0.997 SHANFO TLS 10/23–24 10/26–27 5 0 30 11 46
25/ (457)
2011
SPE-3 7/24/ 45.7 0.905 SHANFO TLS 7/23 7/25 4 0 24 11 47
2012 (457)
SPE-4prime 5/21/ 87.2 0.089 C4 TLS 5/20 5/21–22 – – – – –
2015 (1952)
SPE-5 4/26/ 76.5 5.035 PBXN-110 UAS 4/19–20 4/27–28 9 5 3600 65 100
2016 (446)
SPE-6 10/ 31.4 2.245 PBXC-141 UAS 10/6–7 10/13–14 28 0 1530 50 59
12/ (240)
2016
digitized using ArcGIS. Maps showing the visually-mapped fractures for performed by subtracting the PreX surface from the PostX surface,
SPE-2 through SPE-6 are provided in Figs. 5 and 6. which yields surface change (ΔZ) on the SPE test bed for individual SPE
More surface fractures were documented following SPE-6 than any experiments. These data are presented together with an examination of
of the previous SPE tests, as anticipated based on its shallower scaled overall surface change across the SPE Phase 1 series (pre-SPE-2 com-
depth of burial (sDOB), which is a calculated indication of confinement pared to post-SPE-6; Fig. 5). We do not include data analysis between
of an explosion. SPE-2 produced few surface fractures. SPE-3 and SPE-5 tests, (e.g., comparing post-SPE-5 to pre-SPE-6) due to the errors as-
produced considerably more surface effects than SPE-2, even though sociated with different data modalities, stand-off distances, and ima-
the three tests had similar sDOBs. SPE-5 produced more surface effects gery resolution for different experiments. When subtracting datasets
than SPE-3, but less than SPE-6. SPE-4prime had the largest sDOB and collected the same way, these differences are small, but comparisons
produced few surface fractures, as expected. The farthest visually ob- between different types of collections result in much more noise, ob-
served effects were from SPE-6 and SPE-5, about 52 m from the SGZ. scuring the signal of interest.
Focused views of maximum surface change and patterns in regions
4. Results around the SPE SGZ are shown in Fig. 6. Calculated vertical surface
changes of less than 2 cm are considered to be less than the elevation
This section presents results of DEM raster difference calculations, error in calculating the DEM surfaces, and are not included in the
6
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Table 2
UAS flight parameters for SPE-5 and SPE-6. The SPE-5 low altitude model includes data collected only over the graded test bed area; the high altitude model
represents data collection across the full study area, including a region of native terrain beyond the graded test bed area.
Parameter SPE-5 PreX (Low altitude model) SPE-5 PostX (Low altitude model) SPE-5 PreX (High altitude model) SPE-5 PostX (High altitude model)
discussions below. In addition, any testbed surface changes deemed not little to no subsidence is observed. Weak linear features again appear to
to be associated with effects of the experiment (e.g., natural geo- bound small localized areas of uplift and align with the surface fractures
morphic processes, equipment movement) are not considered here. mapped on the test bed. We note that the mapped surface fractures for
Unless otherwise noted, all lateral distances and azimuths noted in the SPE-3 extend well beyond regions of calculated surface topographical
section below are relative to the center of SGZ. changes, an unusual occurrence across the SPE experiment series.
Surface topographic change from SPE-2 was detected in regions SPE-4prime was the deepest and smallest-yield experiment in the
adjacent to, immediately northeast and southwest of SGZ (Figs. 5a and series for which change detection studies were performed (Table 1).
6a), and near the edges of the graded pad. Visually mapped surface Despite the depth and yield, subtle surface changes were measured
fractures broadly correlate with calculated surface topographic change. (Fig. 5c). Most of the changes observed are over surface-mounted or
We interpret the changes along the edge of the graded area to be arti- shallowly-buried instruments, where sand bags were added or removed.
facts of the collection modality, not experiment-related change; since Examinations focused on SGZ (Fig. 6c) show subsidence observed im-
the edge of the graded area was at a low angle to the TLS, minute mediately northeast of SGZ. Maximum uplift is located N34E from SGZ
differences in horizontal alignment result in large differences in vertical at a distance of 1.8 m. Since these subtle changes are about the same
position. A rectangular container removed from the collection area magnitude as the data error and given their spatial distributions, we
between the PreX and PostX collections can be seen in the data. Max- interpret that these changes are noise or artifacts, and do not reflect
imum uplift is observed N44E of SGZ at a distance of 8.4 m. A weak NE- explosion-induced surface damage.
SW oriented linear trace is visible near the northeastern margin of the
uplift area. Little to no subsidence is observed. Very few surface frac- 4.4. SPE-5
tures were observed for this experiment.
SPE-5 was the largest-yield experiment, and the first for which
4.2. SPE-3 surface morphologic change detection was performed using UAS pho-
togrammetric techniques (Schultz-Fellenz et al., 2018). Widespread
Surface changes related to SPE-3 (conducted at the same depth as surface changes resulted from this experiment, both in spatial extent
SPE-2, within the SPE-2 damage zone) are very similar in spatial extent and maximum magnitude (Fig. 5d, Fig. 6d). Surface fracturing was
and maximum magnitude to those from SPE-2, with an area of uplift observed, and those effects correlate with regions of surface topo-
near SGZ and near the edge of the graded area. We interpret the graphic change. A longer time window was budgeted for the SPE-5 PreX
changes near the edge of the graded area to be artifacts for the same collection to ensure adequate data capture using this novel metho-
reason above. Slightly NE from SGZ, a small uplifted area trends NW- dology. Because of this, PreX data for SPE-5 were collected several days
SE. Maximum uplift is observed N30E of SGZ at a distance of 4.4 m; prior to the SPE-5 experiment, with PostX data capture occurring within
7
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Fig. 5. (a-e) change in surface elevations for each explosion in the SPE series. (f) cumulative surface change (DEM subtraction of pre-SPE-2 from post-SPE-6). Mapped
surface fractures in (a-e) are from this study's visual surface effects mapping; those shown in (e) are additionally validated using geospatial analysis of this study's
PostX imagery. One small surface fracture was mapped following SPE-4prime (c), but is not visible at the scale of this figure. Background hillshade DEM data for all
panels is post-SPE-6.
36 h after zero-time. Between the PreX collect and zero time, a large the intervening time such as flowering plant blossom drop or vegetation
rainstorm crossed the SPE site and impacted both surface morphology movement in wind. Given these alternative, non-experiment related
and the integrity of some GCP fiducial markers. Thirty-eight GCPs were scenarios for surface change off the test bed, and the higher-confidence
damaged and unusable in the SPE-5 analyses. Although some recent data available for the test bed, we did not include these off-testbed
studies have suggested that the arrangement and distance from GCPs regions in our SPE-5 change detection calculations.
may be one of the largest contributing errors in Agisoft-created DEMs
(Goetz et al., 2018), the optimal quantity, density, and distribution of
4.5. SPE-6
GCPs is actively under research for geologic change detection photo-
grammetric analyses and applications.
The experimental parameters of SPE-6 were expected to enhance
Following SPE-5, the emplacement hole and several test bed bore-
surface damage. Surface change manifests predominantly as uplift in an
holes evacuated stemming materials and/or water, some within seconds
elongated region, located NE from SGZ and oriented NE-SW. There are
after the experiment. Deposition of these evacuated materials, including
also broad areas of change farther from SGZ that are ambiguous to
gravel, are visible (Fig. 6d). In addition to the gravel, flowing water
interpret and may be artifacts, so we focus on the more obvious uplift
altered the test bed morphology. One instrumentation borehole located
near SGZ in our analyses. While SPE-6 exhibited widespread surface
on the northeast margin of the test bed geysered water to a height of
change like SPE-5, the spatial extent was smaller than for SPE-5. The
nearly 30 m. Another instrument hole to the southwest also geysered.
region of uplift was bound on the west by a prominent linear feature
Because of these disturbances, the specific attribution of observed
oriented approximately N40E (Fig. 5e). This prominent bounding edge
surface morphological changes to the weather event, the experiment's
was not observed in any other experiment. Surface fractures are present
explosion-induced seismic waves, or the water flowing from the bore-
in greater observed quantity than any previous experiment, and their
holes is unclear.
mapped positions strongly correlate with regions of surface topographic
Much larger areas of subsidence and uplift are identified off of the
change.
test bed for SPE-5, but determining whether these observations re-
present actual surface topographic change from SPE-5 is ambiguous.
These changes may result from the passing weather system between the 4.6. Post-SPE-6 minus pre-SPE-2
PreX and PostX collections, or may be other artifacts of site changes in
Figs. 5f and 6f illustrate cumulative overall surface change on the
8
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Fig. 6. (a-e) More detailed change in surface elevations for each explosion. Mapped surface fractures in (a-e) are from this study's visual surface effects mapping;
those shown in (e) are additionally validated using geospatial analysis of this study's PostX imagery. (f) cumulative surface change (DEM subtraction of pre-SPE-2
from post-SPE-6). Background hillshade DEM data from post-SPE-6. Many localized areas of apparent uplift, like the small point-locations east and south of SGZ for
SPE-5 (6d) and similar features in the lowermost quarter of the panel showing cumulative change from SPE-2 to SPE-6 (6f), are due to anthropogenic activities in the
collection area between collections, such as the installation of surface instrumentation, sandbags, or traffic cones. There is a network of diagnostic cables at the site
that are prominent linear features not related to surface topographic change.
SPE testbed from pre-SPE-2 to post-SPE-6. The figures indicate that and Δy (Fig. 7). Most GCPs show radially outward motion from SGZ, as
earlier surface change is largely overprinted by the results of SPE-5 and expected. However, many GCPs exhibit more south-easterly motion
SPE-6. Small subsidence occurs on the NNE and SSW ends of the graded than expected, particularly due to SPE-6 (Figs. 5e and 6e). These GCPs
pad that were not apparent in analyses from any single test. This could moved vertically upward and laterally southeast, a motion consistent
possibly reveal topographic relaxation or settling in the intervening with the opening of one or more fractures parallel to the Boundary Fault
time between SPE-5 and SPE-6, or it could indicate that the original surface trace. This suggests that latent geologic and geostructural
uplift was a data processing artifact and did not reflect actual surface complexity may alter predicted explosion-induced deformation pat-
change. Given the disturbances to the area (discussed above under SPE- terns.
5), we prefer the interpretation that these distal uplifted regions result
from artifacts, but cannot eliminate the possible interpretation that 5. Discussion
these uplifted regions are SPE-series changes that manifest through
different timescale processes than previously understood. We interpret All SPE experiments at the Climax Stock for which data were col-
that most or all of the subsidence shown in Fig. 5f is due to testbed lected resulted in observable surface morphological change.
surface activity and disturbances not related to the experiments (ero- Observations of surface changes were found during experiments with
sion, traffic, etc.), due to their linear pattern and the lack of such explosions occurring at scaled depths of burial of 240–472 m, which
subsidence areas between any one PreX - PostX pair (Fig. 5a-e). How- contrasts with previous work that predicted no surface change would be
ever, it remains possible that some late-time subsidence affected loca- detectable for experiments deeper than ~200 scaled meters depth (e.g.,
lized areas. Rougier et al., 2011, whose simulations were based on scaling re-
lationships from Mueller and Murphy (1971) and Denny and Johnson
4.7. Δx and Δy (1991)). Topographic changes from SPE-4prime are interpreted to be
noise, based on their lack of obvious correlation to SGZ or other ex-
For SPE-5 and SPE-6 photogrammetric collections, a dense network perimental features. Consistently observing surface topographic change
of geodetically-surveyed GCPs establishes an absolute reference fra- where none was predicted indicates that the dependence on scaled
mework for Δz analyses (changes in height), and quantifies lateral Δx depth of burial to minimize buried explosion surface effects may not be
9
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Fig. 7. Changes in horizontal position of ground control points, shown by vectors. (a), SPE-5 and (b) SPE-6. See Figs. 5 and 6 for source data of surface fracture
mapping. Only points with changes of > 1 cm (the error in the GPS measurements) are shown. SGZ, surface ground zero. Note the combination of radially outward
(away from SGZ) and southeasterly displacements.
correct and requires reconsideration. Furthermore, the patterns of synthetic aperture radar (SAR) to show subsidence of legacy U.S. un-
surface change reflect the roles that geology, explosion parameters, and derground nuclear explosive tests starting in 1992 and continuing for
SGZ pad characteristics play in the manifestation of these features at the years after the end of testing. These measurements occurred wholly
ground surface at testing locations. post-detonation, and in many cases, years after detonation, and thus do
not provide insight into surface changes during the explosions.
The use of remote sensing data to analyze surface change from
5.1. Uplift or subsidence? underground nuclear explosions has been so far limited to the DPRK
announced tests (e.g., Carluccio et al., 2014; Wei, 2017; Wang et al.,
The surface changes discussed here that result from the SPE series 2018; Pabian and Coblentz, 2018). Carluccio et al. (2014) used SAR
predominantly exhibit uplift. These data contrast with observations data collected within 3 months of the 2009 DPRK announced nuclear
made by Houser (1969), Hakala (1970), Allen et al. (1997), and Vincent test and discovered surface changes they interpret as subsidence or
et al. (2003), which principally identify subsidence as the permanent landsliding caused by the nuclear test. However, the location of their
topographic signature of underground nuclear explosions in tuff and observed surface are 10 km away from the estimated test location based
alluvium at the Nevada Test Site (now the NNSS). This difference could on satellite imagery of the tunnel entrance and seismic epicentral lo-
be due to a variety of potential factors: the geology at the explosion site, cations. While this detected change could represent surface processes
the size of the explosion, and the nuclear vs conventional high explosive unrelated to nuclear tests, it intriguingly suggests that relevant sig-
energy source, among others. To help constrain the determining factors, natures may happen at locations distal from the area of interest, not
we searched for other studies of permanent surface deformation from necessarily co-located with an estimated SGZ position. Analysis by Wei
underground nuclear explosions. (2017) of SAR interferometry from the January 2016 DPRK announced
Before the U.S. nuclear testing moratorium took effect in 1992, nuclear test shows permanent surface change interpreted as either a
surface topographic change measurements of underground nuclear ex- landslide or uplift, with uplift being the preferred interpretation due to
plosions that did not crater were extremely limited, mostly in the form a lack of an apparent scarp in optical (0.5 m resolution) Google Earth
of “level lines”, which measured one or two linear trends across an imagery. Wang et al. (2018) interpret aseismic subsidence to have oc-
explosively damaged area. Photogrammetric studies employed for le- curred from the September 2017 DPRK test based on SAR data that
gacy U.S. underground nuclear explosions (e.g., Morris, 1973) could not show less uplift than expected based on predictive numerical models.
resolve changes ± 1 ft. (30 cm). Recent progress in remote-sensing Analysis by Pabian and Coblentz (2018) of the 2017 announced DPRK
techniques now enable the measurement of small (cm-scale) changes nuclear test use SAR data from Wang et al. (2018) and optical imagery
with orders of magnitude more data points. Vincent et al. (2003) used
10
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
to suggest that subsidence occurred. were engineered to detonate and burn symmetrically. Thus, the
The DPRK nuclear tests are thought to have been conducted in northeasterly offset of maximum uplift is likely controlled by some
granite or diorite (Coblentz and Pabian, 2015; Pabian and Coblentz, parameter of the site geology.
2018), whereas the host rock for the SPE series is a quartz monzonite A priori, it is not apparent whether surface change patterns would
(Houser and Poole, 1961; Orkild et al., 1983). While the rock types at be more heavily controlled by the majority of fractures, which are or-
these disparate locations have similarities, it is unlikely that a differ- iented WNW-ESE, or the less numerous fractures that are parallel to the
ence in rock type would explain the potential subsidence in some of the Boundary Fault, and thus more likely to fail under the modern tectonic
DPRK underground nuclear explosions vs. uplift in the SPE series. Other stress regime. We observe that some uplifts seem to be bound on the
potential factors that may influence uplift or subsidence include po- west by a NNE-striking linear feature, which is particularly prominent
tential differences in nuclear vs. conventional high explosive source, in Fig. 5e, where it corresponds to a surface fracture mapped post-test.
water saturation levels in the host rock, or differences in yield and/or This suggests that failure is preferred along planes that are oriented
depth. There is also the potential for temporal variability in data col- favorably for slip with the state of tectonic stress, even if they cross
lection timing to account for these differences, with uplift occurring more numerous pre-existing fractures.
during the explosion and temporarily preserved, with subsidence fol- The work of Morris (1973) interpreted that geologic and fault/
lowing as a longer-term signature that develops within days to months fracture conditions at the site of the CANNIKIN underground nuclear
of the event. This is supported by observations from Vincent et al. explosion govern the complexity of form, magnitude, and location of
(2003), that seem to suggest subsidence on the order of up to 5 cm, over surface deformation relative to the test SGZ. At CANNIKIN, post-shot
a period of months to years following underground nuclear explosions photogrammetric analyses identified maximum subsidence of 12.2 m at
at the current NNSS. The change detection data presented here do not a location 450 m ESE of SGZ, in an area where three faults were known.
comprehensively assess or distinguish time-dependent patterns, as there While this study does not focus specifically on how geological host rock
was only one collection after each explosion, always within a few days. heterogeneities or faults may impact on how explosion-related changes
However, if the observed subsidence between pre-SPE-2 and post-SPE-6 manifest topographically, we acknowledge this likely plays a role in the
in the more distal areas of the graded pad is a real signal, late-time pattern and magnitude of damage. Geological impacts on surface
subsidence may have occurred. This interpretation requires assuming morphological changes requires further study at the SPE site, and at
that changes observed are due to ground motion alone, despite col- other test sites.
lections between different data collection modalities, over several years
of heavy equipment operation, and many weather events. Thus, we 5.4. Effect of pre-existing damage
prefer the interpretation that the subsidence is not indicative of sub-
surface processes of interest. One of the purposes of creating two explosions of very similar size
and depth in the same emplacement hole (SPE-2 and SPE-3) was to
5.2. Uplift magnitude examine the possible role of pre-existing damage on the measured ef-
fects of the explosion. Here, the surface change resulting from SPE-3
Observations presented here that were generally not present in (the test conducted in damaged rock) is very similar to SPE-2 (the less
historical datasets is the measurements of uplift magnitude. While damaged one), as shown in Fig. 5. However, we hesitate to conclude
Cattermole and Hansen (1962) obtained uplift data from a series of that pre-existing damage has no effect due to the area's previous ex-
surveyed points, they mentioned that the wide spacing between mea- plosions. SPE-1, which was intended to be small enough to not spall, did
surement locations prevented accurate contours, particularly at loca- spall, likely damaging the surface rock to some extent, but no surface
tions distal from SGZ. UAS photogrammetry and TLS both provide topographic change measurements were collected for SPE-1. In addi-
much denser topographic data than line or point surveys, which results tion, PILE DRIVER did cause a few surface fractures at what is now the
in superior resolution of cm-scale changes. SPE site, although that was decades prior to the SPE Phase 1 com-
While both SPE-5 and SPE-6 show clear cm-scale topographic mencement. Thus, SPE-2 may have also already been pre-damaged, and
changes, their patterns of uplift differ (Figs. 5d and 5e). This is espe- therefore looks similar to SPE-3 for that reason.
cially apparent in the difference in maximum uplift magnitudes. While
both experiments produced approximately similar lateral extent of 5.5. Role of scaled depth of burial
uplift, SPE-6 produced a greater maximum magnitude of uplift than
SPE-5 (28 cm and 15.5 cm, respectively), despite a smaller yield. In As scaled depth of burial is a calculated indication of confinement of
addition, SPE-2, −3, and − 5 all have approximately the same scaled an explosion, and by correlation relates to minimization of visible
depth of burial. This suggests that the true depth of burial plays a strong surface effects, relating scaled depth of burial to our observations is
role in the total magnitude of uplift. This raises the intriguing possibi- important in assessing its role as a predictor of damage. A comparison
lity that depth of burial could be obtained independently from scaled of the surface changes from SPE-2, SPE-3, and SPE-5 (Fig. 5), which all
depth of burial using a combination of surface change extent and had similar scaled depths of burial (Table 1) show that they do not all
magnitude. While the dataset presented here is too small to quantify have the same pattern of uplift. SPE-2 and SPE-3, which had very si-
such a relationship, SPE has recently completed a second phase, a suite milar yields and depths, appear to have similar surface damage, but
of experiments in an alluvial geologic site, where additional data may SPE-5, which is larger and deeper, has a broader and higher uplift. All
help address this critical knowledge gap. of these tests were in the same borehole in the same unit. This indicates
the scaled depth of burial alone is not a good predictor of damage.
5.3. The role of geology
5.6. Extent of surface change scaling
Comparing the surface changes resulting from individual experi-
ments SPE-2 through SPE-6 identifies significant spatial variability The fact that geologic features play a role in the distribution of
(Fig. 5). However, one common feature across all of the change de- surface effects at the U.S. former nuclear testing site has been noted in
tection analyses for all of the experiments is the offset of the region of open literature for many decades, with Barosh (1968) observing that
maximum uplift to the northeast of SGZ. No engineering factors of the post-experiment fractures commonly formed preferentially along pre-
experimental set-up appear to account for this consistent observation existing faults and joints in alluvium. Dickey (1968) attempted to
through the experimental series, as the emplacement hole for all the quantify the relationship between the horizontal distance to fault and
explosives is vertical and the SPE experimental explosives packages the size of the explosion, finding that there was a cube-root-of-yield
11
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
10000 from the location of the explosion to the farthest identified surface
Legend fracture resulting from the underground experiment. Although at the
tuff UNE time of their study this was more relevant because of the significant
range distance of surface fractures (ft)
granite UNE topography in their study area, conceptually this relationship may be
tuff HE superior in all cases, since the surface fracturing is produced as a result
granite HE (SPE)
of the radially-outward wave generated from the experiment. Their
empirical results gave a relationship of scaled slant range equal to 50 ft.
Power (Legend)
* tons0.4, based on five data points, (three underground nuclear ex-
1000 y = 170*x0.30 plosions and two conventional high-explosive experiments).
In order to directly compare our results to previous work, we have
computed the slant range distances (which require depth as an input)
for the maximum extents of uplift discussed earlier (Fig. 8). To the data
presented in Wilmarth and McKeown (1960), this study adds the four
data points from SPE, as well as data from PILE DRIVER, the only one of
the three nuclear experiments in granite nearby to SPE for which sur-
face cracking data are available (Grasso, 2003). This was done to assess
100 whether significant differences arose from the different rock types
0.1 1 10 100 1000 10000 100000
yield of explosion (in tons) (granite for SPE and PILE DRIVER, tuff for the high explosive and nu-
(a)
clear tests presented in Wilmarth and McKeown (1960)). The data
follow similar trends, and so their data are analyzed together (Fig. 8).
100 704
While Wilmarth and McKeown (1960) present extents of fracturing only
y= 1.57E-09x3.398 705 in a figure, this study obtained data from reports by Cattermole and
Yield of explosion, in kilotons
10 706 Hansen (1962) and from data presented by Grasso (2003). Our values
707 appear to be slightly different from the values used by Wilmarth and
708 McKeown (1960), but as that work did not report their data source, the
1 source of this discrepancy cannot be determined.
709
Following the previously published conventions [and as used by
710
0.1 Wilmarth and McKeown (1960)] of feet and yield in tons, the best fit to
711 the extended dataset is:
712
0.01 Legend RD = 170 ∗ W 0.30
tuff UNE 713
where RD is range distance in feet, and W is yield in tons. The exponent
granite UNE 714
0.001 tuff HE presented here is 0.3, which is slightly different from the 0.4 presented
SPE, HE granite 715
by Wilmarth and McKeown (1960), but both bracket the expected
Power (Legend) 716 theoretical 1 - power relationship proposed by Mueller and Murphy
0.0001 3
10 100 1000 717
10000 (b) (1971). To assess potential relationships and application to nuclear
Maximum range distance of surface fractures (m) explosive events, it is more helpful to present the data as W (in kt)
calculated from extent of surface damage (in m). For this, the equation
Fig. 8. Relationship of explosive yield to maximum range distance of mapped
surface fractures or morphological change related to the experiment. is:
Underground nuclear explosion (UNE) yield and depth data from U.S. W = 1.57 ∗ 10−9 ∗ RD3.4
Department of Energy (2015); and surface effect data from Grasso (2003). Tuff
high explosive (HE) data from Cattermole and Hansen (1962). Best fit power- where RD is the range distance in meters and W is yield in kt. Note
law line through combined UNE and HE data is shown. (a), showing range that this equation is based on a relatively small number of data points,
distance in feet as a function of yield in tons, of the form used by Wilmarth and and scales with range distance, a value that depends on knowing (or
McKeown (1960). (b), showing yield in kilotons as a function of range distance accurately estimating) the depth.
in meters, a more useful form for today's purposes.
6. Conclusions
relationship for tests in alluvium. Dickey (1968) divided the horizontal
distance of the farthest fracture to surface ground zero, and divided by All SPE Phase 1 experiments for which surface morphological
the cube root of the explosion yield to obtain a “scaled distance”, which change data were collected showed evidence of detectable surface
ranged from 920 ft./kt1/3 to 3600 ft./kt1/3 (280–1100 m/kt1/3). In changes with the exception of SPE-4prime, which had effects that are
addition, these values of scaled distance only applied to the Yucca not distinguishable from noise in the imagery data though a few small
Fault, with another nearby fault only having triggered slip for explo- test-related effects were visible during visual mapping. In this experi-
sions closer than 500 ft./kt1/3 (150 m/kt1/3). This gives nearly an order mental series, all changes within 80 m of SGZ manifest as uplift. The
of magnitude spread in the scaled horizontal extent of fracturing, all maximum uplift magnitude ranged from 2 to 20 cm, depending on an
within the same alluvial unit in Yucca Flat. individual experiment's yield and depth of burial. We attribute this
Scaled ranges of fractures in volcanic units in the northwestern difference to a scaling relationship that is not exclusively dependent on
portion of the NNSS, range between approximately 300–1000 m/kt1/3 scaled depth of burial.
(Fig. 8), which are remarkably similar given the differences in geology. The observed topographic change for this series of conventional
These order-of-magnitude ranges in values are too imprecise to be high explosive experiments in granite is all uplift, with some horizontal
useful for nuclear explosion monitoring purposes; a more precise re- movement identified through repeat geodetic survey of ground control
lationship is needed. points. Though SPE used conventional high explosives, it is interesting
Wilmarth and McKeown (1960) also quantified the extent of surface to note that this is the same direction of motion as that interpreted from
cracking after studying the effects of several underground nuclear ex- InSAR data for one DPRK underground nuclear test (e.g., Wei, 2017)
plosions in the tuffs at Rainier Mesa. However, their mathematical but opposite in direction to that cited in literature for legacy U.S. nu-
analyses used a scaled slant range, a measure of direct-line distance clear tests in alluvium and tuff (Houser, 1969; Vincent et al., 2003)
12
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
However, Pabian and Coblentz (2018) interpret landslides/subsidence without the support of many people from several organizations. The
for the same event as well as a later test. More work is needed to un- authors thank NNSA, the Office of Defense Nuclear Nonproliferation
derstand this discrepancy. Research and Development (DNN R&D), and the SPE working group, a
The pattern of surface expression, and in particular maximum lat- multi-institutional, interdisciplinary group of scientists and engineers.
eral extent and the maximum magnitude of uplift, do not vary solely as Thanks to the staff of Optira, Inc. for TLS acquisitions for SPE-2, SPE-3,
a function of scaled depth of burial, as previously published (e.g., and SPE-4prime. The skill, dedication, and professionalism of our field
Houser, 1969). Deeper explosions seem to have a broader, lower am- UAS pilots (M Grimler and D Cornely [now retired] of Los Alamos
plitude signal while shallower explosions have larger maximum National Laboratory) ensured safe and successful airborne operations
changes but smaller areal extent. This is in contrast to the predicted and data collections during SPE-5 and SPE-6. Los Alamos National
pattern of similar surface changes from explosions with the same scaled Laboratory, an affirmative-action/equal opportunity employer, is op-
depth of burial (e.g., Houser, 1969). Thus, the uplift pattern may po- erated by Triad National Security, LLC for the National Nuclear Security
tentially be used to constrain characteristics of interest, although more Administration of the U.S. Department of Energy under contract
data are needed for quantitative predictions. Our results show that 89233218CNA000001. Sandia National Laboratories is a multi-mission
observable surface changes exist from this series of overburied explo- laboratory managed and operated by National Technology and
sions, and this ground-truth validation suggests that surface changes Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of
may be detectable in areas of interest where no surface changes were Honeywell International, Inc., for the U.S. Department of Energy's
previously expected or anticipated. Additionally, this work helps to National Nuclear Security Administration under contract DE-
refine how, when, and what types of remote modalities could be used in NA0003525. This manuscript has been co-authored by Mission Support
explosion monitoring and verification. Subtle surface changes from and Test Services, LLC, under Contract No. DE-NA003624 with the U.S.
explosions are more readily observable with modern tools, and show Department of Energy, National Nuclear Security Administration. The
their potential to help determine subsurface explosive experiment United States Government retains and the publisher, by accepting the
characteristics such as yield and depth. article for publication, acknowledges that the United States
Government retains a non-exclusive, paid-up, irrevocable, worldwide
Declaration of Competing Interest license to publish or reproduce the published form of this manuscript,
or allow others to do so, for United States Government purposes. The
The authors declare that they have no known competing financial U.S. Department of Energy will provide public access to these results of
interests or personal relationships that could have appeared to influ- federally sponsored research in accordance with the DOE Public Access
ence the work reported in this paper. Plan (http://energy.gov/downloads/doe-public-access-plan). The
views expressed in this article do not necessarily represent the views of
Acknowledgements the U.S. Department of Energy or the United States Government. This
document is unclassified and has been approved for unlimited release
The Source Physics Experiments (SPE) would not have been possible (LA-UR-19-28786; DOE/NV/03624—0765; SAND2020-4478 J).
Units Meters
13
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
14
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
15
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
16
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
17
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
18
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
19
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
20
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
21
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
osti.gov/servlets/purl/671858. aquaculture facilities in the Yellow River Delta, China. Geophys. Res. Lett. 40,
Allmendinger, R.W., Cardozo, N.C., Fisher, D., 2013. Structural Geology Algorithms: 3898–3902.
Vectors & Tensors: Cambridge. Cambridge University Press, England (289 pp). Houser, F.N., 1969. Subsidence related to underground nuclear explosions, Nevada test
Argo, P., Clark, R.A., Douglas, A., Gupta, V., Hassard, J., Lewis, P.M., Playford, K., site. Bull. Seismol. Soc. Am. 59 (6), 2231–2251.
Ringdal, F., 1995. The detection and recognition of underground nuclear explosions. Houser, F.N., Poole, F.G., 1961. Age relations of the Climax composite stock, Nevada Test
Surv. Geophys. 16, 495–532. Site, Nye County, Nevada; USGS Misc. Investigations Map I-328. (scale 1:4,800).
Barnes, H., Houser, F.N., Poole, F.G., 1963. Geologic map of the Oak Spring Quadrangle, International Society for Rock Mechanics (ISRM), 1981. Basic geotechnical description of
Nye County, Nevada, U.S. Geological Survey Map GQ-214. Scale: 1:24,000. rock masses. In: International Journal of Rock Mechanics, Mining Sciences, and
Washington, D.C. Geomechanics Abstracts. 18. pp. 85–110.
Barnhart, T.B., Crosby, B.T., 2013. Comparing two methods of surface change detection Ishitsuka, K., Tsuji, T., Matsuoka, T., 2012. Detection and mapping of soil liquefaction in
on an evolving thermokarst using high-temporal-frequency terrestrial laser scanning, the 2011 Tohoku earthquake using SAR interferometry. Earth Planet Space 64 (22).
Selawik River, Alaska. Remote Sens. 5, 2813–2837. https://doi.org/10.3390/ https://doi.org/10.5047/eps.2012.11.002.
rs5062813. Kaiser, A., Holden, C., Massey, C., 2013. Determination of site Amplification,
Barosh, P.J., 1968. Relationships of explosion-produced fracture patterns to geologic Polarization, and Topographic Effects in the Seismic Response of the Port Hills
structures in Yucca Flat, Nevada Test Site. Geol. Soc. Am. Memoir 110, 199–217. Following the 2011 Christchurch earthquake, New Zealand Society for Earthquake
Bucknam, R.C., 1972. Vertical deformation produced by some underground nuclear ex- Engineering Technical Conference, 26–28 April. 8 p.
plosions. Bull. Seismol. Soc. Am. 62 (4), 961–971. Kaya, G., Musaoglu, N., Ersoy, O., 2011. Damage assessment of 2010 Haiti earthquake
Buech, F., Davies, T.R., Pettinga, J.R., 2010. The little Red Hill seismic experimental with post-earthquake satellite image by support vector selection and adaptation.
study: topographic effects on ground motion at a bedrock-dominated mountain edi- Photogramm. Eng. Remote. Sens. 77, 1025–1035.
fice. Bull. Seismol. Soc. Am. 100 (5A), 2219–2229. Khalturin, V.I., Rautian, T.G., Richards, P.G., Leith, W.S., 2005. A review of nuclear
Canty, M.J., Schlittenhardt, J., 2001. Satellite data used to locate site of 1998 Indian testing by the Soviet Union at Novaya Zemlya, 1955–1990. Sci. Global Secur. 13
nuclear test. Eos Trans. AGU 82 (3), 25–29. https://doi.org/10.1029/01EO00015. (1–2), 1–42. https://doi.org/10.1080/08929880590961862.
Carluccio, R., Giuntini, A., Materni, V., Chiappini, S., Bignami, C., D’Ajello Caracciolo, F., Klawitter, M., Pistellato, D., Webster, A., Esterle, J., 2017. Application of photo-
Pignatelli, A., Stramondo, S., Console, R., Chiappini, M., 2014. A multidisciplinary grammetry for mapping of solution collapse breccia pipes on the Colorado Plateau,
study of the DPRK nuclear tests. Pure Appl. Geophys. 171, 341–359. https://doi.org/ U.S.A. Photogramm. Rec. 32 (160), 443–458.
10.1007/s00024-012-0628-8. Larmat, C., Rougier, E., Patton, H., 2017. Apparent explosion moments from Rg waves
Cattermole, J.M., Hansen, W.R., 1962. Geologic effects of the high-explosive tests in the recorded on SPE. Bull. Seismol. Soc. Am. 107, 43–50.
USGS tunnel area, Nevada test site. In: U.S. Geological Survey Professional Paper Liau, J., Shen, G., 2009. Detection of land surface change due to the Wenchuan earth-
382-B, (37 p). quake using multitemporal advanced land observation satellite-phased array type L-
Chai, J.C., Shen, S.L., Zhu, H.H., Zhang, X.L., 2004. Land subsidence due to groundwater band synthetic aperture radar data. J. Appl. Remote. Sens. 3 (1), 031680. https://doi.
drawdown in Shanghai. Geotechnique 54 (2), 143–147. org/10.1117/1.3142466.
Chowdhury, A.H., Wilt, T.E., 2015. Characterizing explosive effects on underground Love, G.C., Vortman, L.J., 1967. Photogrammetric Techniques Associated with Model
structures. In: U.S. Nuclear Regulatory Commission report NUREG/CR-7201, (97 p). Studies of Earth-Moving Explosions, Surveying and Mapping Division. American
Coblentz, D., Pabian, F., 2015. Revised geologic site characterization of the north Korean Society of Civil Engineers 40 p. https://www.osti.gov/servlets/purl/4565399.
test site at Punggye-ri. Sci. Global Secur. 23 (2), 101–120. https://doi.org/10.1080/ Maldonado, F., 1977. Summary of the Geology and Physical Properties of the Climax
08929882.2015.1039343. stock, Nevada Test Site: USGS Open File Report 77-356. 25 p.
Denny, M.D., Johnson, L.R., 1991. The explosion seismic source function: models and McKeown, F.A., Dickey, D.D., Ellis, W.L., 1967. Maps and Classification of Explosion-
scaling laws reviewed. In: Taylor, S.R. (Ed.), Explosion Source Phenomenology. 65. Induced Fractures in Yucca Flat, Nevada Test Site: U.S. Geological Survey Technical
pp. 1–24 AGU Monograph. Letter NTS-195, Supp. 1.
Di Traglia, F., Calvari, S., D’Auria, L., Nolesini, T., Bonaccorso, A., Fornaciai, A., Esposito, Menderes, A., Erener, A., Sarp, G., 2015. Automatic detection of damaged buildings after
A., Cristaldi, A., Favalli, M., Casagli, N., 2018. The 2014 effusive eruption at earthquake Hazard by using remote sensing and information technologies. Proc.
Stromboli: new insights from in situ and remote-sensing measurements. Remote Sens. Earth Planet. Sci. 15, 257–262. ISSN 1878-5220. https://doi.org/10.1016/j.proeps.
10 (12). https://doi.org/10.3390/rs10122035. 2015.08.063.
Dickey, D.D., 1968. Fault displacement as a result of underground nuclear explosions, In Merkle, D.H., 1980. Basic Mechanisms of Spall from near-Surface Explosions; Defense
Nevada Test Site. Geol. Soc. Am. Memoir 110, 219–232. Technical Information Center report. 100 p.
Dickey, D.D., 1969. Strain associated with the Benham underground nuclear explosion. Morris, R.H., 1973. Topographic and Isobase Maps of the CANNIKIN sink, Amchitka
Bull. Seismol. Soc. Am. 59, 2221–2230. Island, Alaska, U.S. Geological Survey Technical Report USGS-474-175. (10 p).
Eisler, J.D., Chilton, F., 1964. Spalling of the Earth’s surface by underground nuclear Mueller, R.A., Murphy, J.R., 1971. Seismic characteristics of underground nuclear deto-
explosions. J. Geophys. Res. 69 (24), 5285–5293. https://doi.org/10.1029/ nations, part I. Seismic spectrum scaling. Bull. Seismol. Soc. Am. 67, 135–158.
JZ069i024p05285. Niederheiser, R., Mokros, M., Lange, J., Petschko, H., Prasicek, G., Elberink, S.O., 2016.
Erban, L.E., Gorelick, S.M., Zebker, H.A., 2014. Groundwater extraction, land subsidence, Deriving 3D point cloud from terrestrial photographs – comparison of different
and sea-level rise in the Mekong Delta, Vietnam. Environ. Res. Lett. 9, 084010. sensors and software. In: International Archives of the Photogrammetry, Remote
Favalli, M., Fornaciai, A., Nannipieri, L., Harris, A., Calvari, S., Lormand, C., 2018. UAV- Sensing, and Spatial Information Sciences, Volume XLA-B5, 12–19 July. Czech
based remote sensing surveys of lava flow fields: a case study from Etna’s 1974 Republic, Prague.
channel-fed lava flows. Bull. Volcanol. 80 (29). https://doi.org/10.1007/s00445- Orkild, P.P., Townsend, D.R., Baldwin, M.J., 1983. Chapter A; Geologic investigations. In:
018-1192-6. Geologic and Geophysical Investigations of Climax Stock Intrusive, Nevada, USGS
Frazer, B.T., Congalton, R.G., 2018. Issues in unmanned aerial systems (UAS) data col- Open File Report 83-377, (92 p).
lection of complex forest environments. Remote Sens. 10 (6). https://doi.org/10. Pabian, F., Coblentz, D., 2018. Observed surface disturbances associated with the DPRK’s
3390/rs10060908. 3 September 2017 underground nuclear test. Seismol. Res. Lett. 89 (6), 2017–2024.
Galloway, D.L., Hudnut, K.W., Ingebritsen, S.E., Phillips, S.P., Peltzer, G., Rogez, F., https://doi.org/10.1785/0220180120.
Rosen, P.A., 1998. Detection of aquifer system compaction and land subsidence using Pasyanos, M.E., Myers, S.C., 2018. The coupled location/depth/yield problem for North
interferometric synthetic aperture radar, Antelope Valley, Mojave Desert, California. Korea’s declared nuclear tests. Seismological Research Letters 89 (6), 2059–2067.
Water Resour. Res. 34 (10), 2573–2585. https://doi.org/10.1785/0220180109.
Garcia, M.N., 1989. Photogrammetric methods applied to surface effects mapping and Patton, H.J., 2015. New Insights into the Explosion Source from SPE, EOS Trans. AGU,
volumetric studies at the Nevada test site, Nevada. Photogramm. Eng. Remote. Sens. Abstract S51F-05, 2015 AGU Fall Meeting, San Francisco, CA.
55 (8), 1197–1201. Patton, H.J., Taylor, S.R., 2011. The apparent explosion moment: inferences of volumetric
Glasstone, S., Dolan, P.J., 1977. The Effects of Nuclear Weapons, U.S. Department of moment due to source medium damage by underground nuclear explosions. J.
Defense. 653 p. Geophys. Res. 116, B03310. https://doi.org/10.1029/2010JB007937.
Goetz, J., Brenning, A., Marcer, M., Bodin, X., 2018. Modeling the precision of structure- Phang, M.K., Simpson, T.A., Brown, R.C., 1983. Investigation of Blast-Induced
from-motion multi-view stereo digital elevation models from repeated close-range Underground Vibrations from Surface Mining. Department of Interior Office of
aerial surveys. Remote Sensing of Environment 210 (208). https://doi.org/10.1016/ Surface Mining Report, U.S. (107 p).
j.rse.2018.03.013. Piras, M., Taddia, G., Forno, M.G., Gattaglio, M., Aicardi, I., Dabove, P., Lo Russo, S.,
Grasso, D.N., 2003. Geologic Surface Effects of Underground Nuclear Testing, Buckboard Lingua, A., 2017. Detailed geologic mapping in mountain areas using an unmanned
Mesa, Climax Stock, Dome Mountain, Frenchman Flat, Rainier/Aqueduct Mesa, and aerial vehicle: application to the Rodoretto Valley, NW Italian Alps. Geomat. Nat.
Shoshone Mountain, Nevada test Site, Nevada, U.S. Geological Survey Open-File Hazards Risk 8, 137–149.
Report 03-125. Rougier, E., Patton, H.J., Knight, E.E., Bradley, C.R., 2011. Constraints on burial depth
Gupta, V., Pabian, F., 1998. Commercial satellite imagery and the CTBT verification and yield of the 25 May 2009 North Korean test from hydrodynamic simulations in a
process. In: The Nonproliferation Review. 1998. Spring-Summer, pp. 89–97. granite medium. Geophys. Res. Lett. 38https://doi.org/10.1029/2011GL048269.
Hakala, W.W., 1970. Subsidence caused by an underground nuclear explosion. In: L16316.
Proceedings of the Symposium on Engineering with Nuclear Explosives, 14-16 Jan Schultz-Fellenz, E.S., Coppersmith, R.T., Sussman, A.J., Swanson, E.M., Cooley, J.A.,
1970. American Nuclear Society/U.S. Atomic Energy Commission, Las Vegas, NV, pp. 2018. Detecting surface changes from an underground explosion in granite using
1428–1455. unmanned aerial system photogrammetry. Pure Appl. Geophys. 175 (9), 3159–3177.
Henderson, J.R., Smith, M.O., Zelinski, M.E., 2014. Overhead detection of underground https://doi.org/10.1007/s00024-017-1649-0.
nuclear explosions using multi-sepctral and infrared imaging. Pure Appl. Geophys. Snelson, C.M., Abbott, R.E., Broome, S.T., Mellors, R.J., Patton, H.J., Sussman, A.J.,
171 (3–5), 763–777. https://doi.org/10.1007/s00024-012-0574-5. Townsend, M.J., Walter, W.R., 2013. Chemical explosion experiments to improve
Higgins, S., Overeem, I., Tanaka, A., Syvitski, J.P.M., 2013. Land subsidence at nuclear test monitoring. Eos 94, 237–239.
22
E.S. Schultz-Fellenz, et al. Remote Sensing of Environment 246 (2020) 111871
Tannant, D.D., 2015. Review of photogrammetry-based techniques for characterization September 2017 North Korean nuclear test. Science. https://doi.org/10.1126/
and hazard assessment of rock faces. Int. J. Geohazard. Environ. 1 (2), 76–87. science.aar7230.
Thurber, C.H., Quin, H.R., Richards, P.G., 1993. Accurate locations of nuclear explosions Warrick, J.A., Ritchie, A.C., Adelman, G., Adelman, K., Limber, P.W., 2017. New tech-
in Balapan, Kazakhstan, 1987 to 1989. Geophys. Res. Lett. 20 (5), 399–402. niques to measure cliff change from historical oblique aerial photographs and
Tonkin, T.N., Midgley, N.G., 2016. Ground control networks for image based surface structure-from-motion photogrammetry. J. Coast. Res. 33 (1), 39–55.
reconstruction: an investigation of optimum survey designs using UAV derived Wei, M., 2017. Location and source characteristics of the 2016 January 6 north Korean
imagery and structure-from-motion photogrammetry. Remote Sens. 8 (9). https:// nuclear test constrained by InSAR. Geophys. J. Int. 209, 762–769.
doi.org/10.3390/rs8090786. Wilder, D., Yow Jr., J., 1984. Structural Geology Report Spent Fuel Test – Climax, Nevada
Townsend, M., Prothro, L., Obi, C., 2012. Geology of the Source Physics Experiment Site, Test Site, UCRL-53381, Prepared by Lawrence Livermore National Laboratory,
Climax stock, Nevada National Security Site. DOE/NV/25946–1448. National Livermore, CA, October.
Security Technologies, LLC, Las Vegas, NV. Wilmarth, V.R., McKeown, F.A., 1960. Structural effects of Rainier, Logan, Blanca un-
U.S. Department of Energy, 2015. United States Nuclear Tests: July 1945 Through derground nuclear explosions, Nevada Test Site, Nye County, Nevada. In: U.S.
September 1992, DOE/NV-209 REV16. (186 p). Geological Survey Prof. Paper. 400–B U.S. Geological Survey.
Viecelli, J.A., 1973. Spallation and the generation of surface waves by an underground Yocky, D.A., West, R.D., Riley, R.M., Calloway, T.M., 2018. Monitoring surface phe-
explosion. J. Geophys. Res. 78, 2475–2487. https://doi.org/10.1029/ nomena created by an underground chemical explosion using fully polarimetric
JB078i014p02475. VideoSAR. IEEE Trans. Geosci. Rem. Sens. 57 (5), 2481–2493. https://doi.org/10.
Vincent, P., Larsen, S., Galloway, D., Laczniak, R.J., Walter, W.R., Foxall, W., Zucca, J.J., 1109/TGRS.2018.2873979.
2003. New signatures of underground nuclear tests revealed by satellite radar in- Zelinski, M.E., Henderson, J., Smith, M., 2014. Use of Landsat 5 for change detection at
terferometry. Geophys. Res. Lett. 30 (22). https://doi.org/10.1029/2003GL018179. 1998 Indian and Pakistani nuclear test sites. IEEE J. Sel. Top. Appl. Earth Obs.
Wang, T., Shi, Q., Nikkhoo, M., Wei, S., Barbot, S., Dreger, D., Bürg-Mann, R., Motagh, M., Remote Sens. 7 (8), 3453–3460.
Chen, Q.F., 2018. The rise, collapse, and compaction of Mt. Mantap from the 3
23