Professional Documents
Culture Documents
Sergi Blanco-Cuaresma1?
1 Harvard-Smithsonian Center for Astrophysics, 60 Garden Street, Cambridge, MA 02138, USA
ABSTRACT
Multiple codes are available to derive atmospheric parameters and individual chemical
abundances from high-resolution spectra of AFGKM stars. Almost all spectroscopists
have their own preferences regarding which code and method to use. But the intrinsic
differences between codes and methods lead to complex systematics that depend on
multiple variables such as the selected spectral regions and the radiative transfer code
used. I expand iSpec, a popular open-source spectroscopic tool, to support the most
well-known radiative transfer codes and assess their similarities and biases when using
multiple set-ups based on the equivalent-width method and the synthetic spectral-
fitting technique (interpolating from a pre-computed grid of spectra or synthesizing
with interpolated model atmospheres). This work shows that systematic differences
on atmospheric parameters and abundances between most of the codes can be re-
duced when using the same method and executing a careful spectral feature selection.
However, it may not be possible to ignore the remaining differences, depending on
the particular case and the required precision. Regarding methods, equivalent-width-
based and spectrum-fitting analyses exhibit large differences that are caused by their
intrinsic differences, which is significant given the popularity of these two methods.
The results help to identify the key caveats of modern spectroscopy that all scientists
should be aware of before trusting their own results or being tempted to combine
atmospheric parameters and abundances from the literature.
Key words: stars: fundamental parameters – stars: abundances – stars: atmospheres
– techniques: spectroscopic
Non-LTE
Customizable isotopes X X X
Continuum scattering X X
Average synthesis time in seconds (480 - 680 nm) ∼123 ∼56 ∼222 ∼68 ∼360
Table 1. Summary of radiative transfer code features. ’Customizable’ denotes the possibility of changing values without recompiling the
program; ’BPO’ stands for Barklem-Piskunov-O’Mara (Barklem et al. 2000); and AG stands for Ali-Griem (Ali & Griem 1965, 1966).
Turbospectrum
MOOG Synth
comparing line-by-line equivalent-width code results, some
SPECTRUM
MOOG EW
WIDTH9
SYNTHE
systematics are observed for certain elements, and major
SME
Grid
disagreements appear with larger reduced equivalent widths
MOOG EW 381 258 165 168 166 159 165 175 (see Fig. 4). Similar systematics are also observed for syn-
1256 350 thesis codes, but the size of the reduced equivalent width
WIDTH9 258 269 107 110 111 102 109 111 does not seem to have a major impact on the results be-
908
Grid 165 107 321 280 254 264 251 261 300 tween different codes (see Figs 5 and 6). This shows the
1582
importance of executing line-by-line differential analysis to
SPECTRUM 168 110 280 305 257 273 256 275
1619 250 minimize different systematics between codes.
Turbospectrum 166 111 254 257 296 244 257 257 In total, considering the abundances within ±0.05 dex
1546
SME 159 102 264 273 244 302 242 265 200 with respect to the solar abundance, there are only 45 ab-
1549 sorption lines in common between all the codes (of which
MOOG Synth 165 109 251 256 257 242 288 242 26 correspond to neutral iron and one to ionized iron). It
1522 150
SYNTHE 175 111 261 275 257 265 242 311 would not be possible to determine atmospheric parameters
1586
with this limited number of lines. Instead, given the differ-
ent nature of the equivalent-width method and the synthetic
spectral technique, I created one line selection for each ap-
Figure 1. Absorption lines in common for which a ±0.05 dex proach (hereafter, the common line selection). The common
abundance (±0.10 for MOOG EW and WIDTH9) was derived line selection is composed of 258 lines (where 146 correspond
with a particular code when analysing the NARVAL solar spec- to neutral iron and 11 to ionized iron) for equivalent-width
trum with the highest signal-to-noise ratio. The number below
methods (i.e. MOOG EW and WIDTH9), and of 205 lines
each code name correspond to the sum of all the values in the
for Grid plus the rest of the synthesis codes. The numbers
row minus the lines that correspond to the same code. The label
Grid corresponds to the results obtained when interpolating from are higher for the former because a less strict limit was re-
a pre-computed grid of synthetic spectra. quired for this method (i.e. the limit was set to ±0.10 instead
of 0.05, as explained in Section 3.5.6; otherwise, not enough
ionized iron lines would be left).
Merely by looking at the colour-coding of the results Regarding lines selected for chemical abundance deter-
we can see two separate islands: equivalent-width codes mination where the constraints were more relaxed, as de-
(MOOG EW and WIDTH9) and synthesis codes (Grid, scribed in Section 3.5.6, an average of ∼1 200 lines were
SPECTRUM, Turbospectrum, SME, MOOG Synth AND selected for all the codes, with the exception of WIDTH9
SYNTHE). These two groups have a greater number of lines and Grid, for which ∼900 and ∼1 400 lines were selected.
in common within themselves but not so many across each This is coherent with the original distribution of derived
other. These differences can be intrinsic to how these meth- abundances shown in Fig. 7, where WIDTH9 underperforms
ods work: one only considers the area of an absorption line, compared with MOOG EW. Equivalent-width codes show a
while the other takes into account the full shape of the line larger variance with a skewed distribution favouring larger
profile including blends (see also section 5.1 in Casamiquela abundances, and Grid has the largest number of lines around
et al. 2017). When comparing line-by-line abundances for zero.
each element from the two methods, it can be seen that the
equivalent-width method provides larger abundances than
synthesis, because the latter can reproduce and account for 4.2 Impact on atmospheric parameters
blends (if the synthesis is forced to ignore blends, the agree-
4.2.1 Full Gaia Benchmark Stars data set
ment with equivalent-width results increases, as shown in
section 5.1 in Casamiquela et al. 2017). At the same time, Using the common line selection, I compared the derived
saturated lines (those with a greater reduced equivalent atmospheric parameters for the Gaia Benchmark Stars by
width) depart from a Gaussian profile (used to determine the computing the mean difference between each radiative trans-
equivalent width), and the equivalent-width method derives fer code and calculating the robust standard deviation10 (i.e.
smaller abundances. The example shown in Fig. 2 compares dispersion) of these differences (Fig. 8). Ideally, we would like
codes that use the same radiative transfer core code; thus, both quantities to be as close as possible to zero, meaning
these differences do not arise from major differences in their that the precision is high between different pairs of radia-
implementation but from the intrinsic differences between tive transfer codes. The dispersion found in the three atmo-
the two methods. spheric parameters again shows two islands that separate
In a previous discarded analysis (not included in this equivalent-width methods from synthesis methods with pre-
work), when interpolating from a grid of spectra that was cisions higher within each group but not lower between the
computed with only two microturbulences (0.00 and 4.00 km two groups.
s−1 ), a lower number of lines in common with pure synthesis In terms of median differences, a clear bias is observed
was found. Hence, increasing the number of data points to
cover four microturbulences (0.00, 1.00, 2.00, and 4.00 km
s−1 ) led to a higher agreement between Grid and the rest 10Function mad std from the astropy.stats package (The Astropy
of the synthesis codes. Collaboration et al. 2018; Astropy Collaboration et al. 2013):
A line-by-line comparison between Grid and SPEC- σ ≈ MAD
−1 ≈ 1.4826 MAD where Φ−1 (P) is the normal inverse
Φ (3/4)
TRUM (the code used to pre-compute the grid) shows no cumulative distribution function evaluated at probability P = 3/4
0.2
0.0
0.2
0.4
-0.25±0.21 -0.10±0.16 -0.09±0.17 -0.15±0.17 -0.12±0.14
0.4 Mn Ni Si Ti V
MOOG Synth - MOOG EW
0.2
0.0
0.2
0.4
6 5 6 5 6 5 6 5 6 5
-0.09±0.19 0.02±0.25 -0.16±0.15 -0.17±0.19 No lines in common
0.4 Fe Ca Co Cr Mg
SYNTHE - WIDTH9
0.2
0.0
0.2
0.4
-0.29±0.20 -0.10±0.16 -0.12±0.23 -0.17±0.18 -0.13±0.13
0.4 Mn Ni Si Ti V
SYNTHE - WIDTH9
0.2
0.0
0.2
0.4
6 5 6 5 6 5 6 5 6 5
Figure 2. Solar abundance difference between equivalent-width and synthesis codes as a function of reduced equivalent width for various
elements. The median and absolute median deviation are indicated in the upper left of each subplot.
for the surface gravity and a less significant systematic in periment described in Section 3.8, the results of which are
effective temperature, where the equivalent-width methods presented in Section 4.5.
provide consistently lower and higher values, respectively. To be able to visually compare all the parameters for
This effect may be driven by the differences in the microtur- all radiative transfer codes at the same time, I normalized11
bulence velocity, as shown in Fig. 9. The microturbulence all the values from Fig. 8 and added them together as shown
parameter represents ensemble velocity fields that are not in Fig. 10 (left plot). In addition, I repeated the same op-
available in 1D model atmospheres (in 3D models, the micro- eration for all the results obtained when the best line se-
turbulence parameter is not necessary), and these velocity lection (hereafter the ’own lines’ selection) for each code is
fields have broadening effects (depth-independent) on the used (right plot). Using the best line selection improves the
line opacity (the parameter serves to desaturate the line). statistics by increasing the number of lines, but it introduces
The differences shown for the microtubulence velocity, es- more inhomogeneities into the analysis. The former effect
pecially between the equivalent-width method and the syn- dominated for synthesis codes because the agreement among
thetic spectral-fitting technique, could be caused by a com- them slightly increased (mainly for MOOG SYNTH), while
pensatory effect on differences in the derived effective tem-
peratures and surface gravities or by real differences between
11 All the values were scaled to unit norm (vector length) us-
the methods and codes. The latter is explored with the ex-
ing the sklearn.preprocessing.normalize function (Buitinck et al.
2013; Pedregosa et al. 2011).
0.1
0.0
0.1
0.2
-0.01±0.09 0.00±0.05 -0.00±0.06 -0.00±0.08 -0.01±0.07
0.2 Mn Ni Si Ti V
Grid - SPECTRUM
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
Figure 3. Solar abundance difference between synthesis and interpolation from pre-computed grid of spectra (i.e., Grid) as a function of
reduced equivalent width for different elements. Median and absolute median deviation are indicated on the upper left of each subplot.
0.1
0.0
0.1
0.2
0.01±0.01 0.01±0.02 0.02±0.09 0.04±0.01 0.02±0.01
0.2 Mn Ni Si Ti V
WIDTH9 - MOOG EW
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
Figure 4. Solar abundance difference between equivalent width codes as a function of reduced equivalent width for different elements.
Median and absolute median deviation are indicated on the upper left of each subplot.
the latter was more significant for equivalent-width methods, set-ups using the selection of common lines or the best lines
where WIDTH9 results separated from MOOG and they got for each code plus enabling/disabling the following options.
slightly more similar to the synthesis results.
• In addition to the selected lines, consider the wings of H-
Assessing the precision between pairs of codes allows us α/β and the Mg triplet. Enabling this option is not possible
to verify what codes lead to the most similar results, but for the equivalent-width methods, for which the results in
does not verify which code and/or set-up obtains the results Fig. 11 are just duplicated.
closest to the expected reference parameters (e.g. a pair of • Run a second full iteration as described in Section 3.6,
codes may be very imprecise because only one of them is where the normalization is repeated but using a synthetic
very accurate). The accuracy of the results (the difference spectrum as a template (which matches the atmospheric pa-
with respect to the Gaia Benchmark Stars reference values) rameters found in a first full iteration) and re-determine the
is shown in Fig. 11. I ran the analysis with eight different atmospheric parameters.
0.2
0.1
0.0
0.1
0.2
0.2
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
0.01±0.01 -0.02±0.05 0.01±0.02 0.00±0.04 -0.02±0.02
0.2 Fe Ca Co Cr Mg
SME - SPECTRUM
0.1
0.0
0.1
0.2
-0.02±0.03 -0.01±0.02 -0.02±0.02 -0.01±0.03 -0.00±0.02
0.2 Mn Ni Si Ti V
SME - SPECTRUM
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
Figure 5. Solar abundance difference between synthesis codes as a function of reduced equivalent width for different elements. Median
and absolute median deviation are indicated on the upper left of each subplot.
The equivalent-width method presents a higher disper- malized and added all the values from Figs 11 and 12, as
sion for all the atmospheric parameters. It also has the low- shown in Fig. 13. As a general rule, using the best line se-
est level of agreement when analysing several spectra cor- lection instead of the common line selection leads to a bet-
responding to the same star, as shown in Fig. 12. Metal- ter accuracy for all the codes, thanks to the increase in the
licity is not included in that figure because the results are statistics without sacrificing quality.
very similar across codes: the median robust standard devia-
The codes MOOG EW and WIDTH lead to similar re-
tion per star is about 0.03 dex for equivalent-width methods
sults for the equivalent-width method, with MOOG EW be-
and 0.01 dex for synthesis methods. The synthetic spectral-
ing the best of the two when using its own line selection and
fitting technique performs better in this test mainly because
executing a second full iteration normalizing with a synthetic
the Gaia Benchmark Stars include a wide range of FGKM
spectrum matching the atmospheric parameters found in the
stars and the equivalent-width method is not the best option
first full iteration. This second full iteration does not have
for all of them (see Section 4.2.2). For instance, the accuracy
the same positive effect for all the codes. Its major contribu-
of the equivalent-width method degrades more strongly with
tion is improving the dispersion per star for most synthesis
cooler stars owing to blends and with metal-poor stars owing
codes, as shown in Fig. 12, but sometimes it slightly wors-
to the lack of iron lines.
ens the overall results. The effect of this second full iteration
In order to visually compare all the parameters for all could be due to the template-based normalization or to the
radiative transfer codes and set-ups at the same time, I nor- execution of an extra batch of iterations until convergence
0.1
0.0
0.1
0.2
-0.01±0.04 -0.00±0.05 -0.02±0.06 -0.01±0.05 -0.01±0.04
0.2 Mn Ni Si Ti V
MOOG Synth - SPECTRUM
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
0.01±0.02 -0.00±0.01 0.04±0.04 -0.02±0.03 -0.00±0.01
0.2 Fe Ca Co Cr Mg
SYNTHE - SPECTRUM
0.1
0.0
0.1
0.2
0.00±0.03 0.01±0.01 0.01±0.02 0.03±0.02 0.02±0.02
0.2 Mn Ni Si Ti V
SYNTHE - SPECTRUM
0.1
0.0
0.1
0.2
6 5 6 5 6 5 6 5 6 5
Figure 6. As Fig. 5
for the determination of atmospheric parameters is reached. agreement is outstanding. Synthetic solar spectra for each
I executed a validation test with Grid using only one full code are also shown in the bottom subplots of the same fig-
iteration with the best line selection but allowing the pro- ure. SME and Turbospectrum are close together with lower
cess that determines the atmospheric parameter to run for normalized fluxes, while MOOG is on the other extreme with
a greater maximum number of iterations (12 instead of 6), higher normalized fluxes. Grid, SPECTRUM and SYNTHE
and the results did not change significantly (rms decreased have a large region of overlap with each other and they are
by less than 0.01 for 11 spectra, and the rest remained at generally closer to the observed spectrum. These discrepan-
roughly the same level). This is a strong indication that the cies reflect differences in how the broadening of the hydrogen
effects of adding the second full iteration are caused mainly lines is computed by each code.
by the template-based normalization. Determining the effective temperatures using the wings
For the synthetic spectral-fitting methods, adding the of the hydrogen lines is a recognized strategy (Niemczura
wings of H-α/β and the Mg triplet generally improves the et al. 2014; Cayrel et al. 2011), and is understood to be
results for Grid, SPECTRUM and SYNTHE, while it wors- very difficult (Barklem et al. 2002). In this context, Giribaldi
ens the results for Turbospectrum, SME and MOOG Synth. et al. (2018) showed how normalization plays a major role
To rule out that the normalization process is not favouring and identified a systematic of 28 K for the Sun when using
some of the codes, a comparison of an observed NARVAL H-α. Given the differences found in this work for the consid-
solar spectrum and an observed solar ATLAS (Hinkle et al. ered radiative transfer codes, I executed an extra analysis in
2000) is shown in the top subplots of Fig. 14, where the which I determined the effective temperature for all the Gaia
Benchmark Stars using the wings of H-α and H-β separately 4.3 Impact on chemical abundances
and together, while the rest of parameters were fixed to their
4.3.1 Full Gaia Benchmark Stars data set
reference values. The results are shown in Fig. 15. HΚ is the
worse modelled line of the two, as shown in the middle sub- Individual chemical abundances were derived by fixing the
plots; however, when combined with H-α (right subplots) atmospheric parameters to the reference values and using
the results improve or remain similar for all of the codes the best line selection for each method. The iron abundances
except MOOG. Turbospectrum, SME and MOOG show the tend to be used as a proxy for metallicity, and indeed Fig. 22
largest systematics, and this may be the reason why adding shows very similar patterns to Fig. 8 (bottom plot), where
these regions to the different analyses presented in this work equivalent-width codes and synthesis codes form separate
does not improve the overall results. If I limit the validation islands. However, the dispersion is worse in Fig. 22 for the
to the solar spectra, the closest effective temperature to the equivalent-width codes. Imposing the same atmospheric pa-
reference value is obtained when using only H-α with Grid, rameters on all the spectra probably worsens the results be-
SPECTRUM and SYNTHE, as shown in Table 2. cause, as shown in Section 4.2, the microturbulence velocity
The best global results (i.e. considering all the meth- does not have exactly the same effect for all the methods.
ods/codes) are obtained using each code’s own line selec- The rest of the parameters may play a role too, and the
tion. I used these results to assess the accuracy and preci- abundance determination may compensate for the discrep-
sion as a function of effective temperature, surface gravity ancies from other parameters when enforcing a certain tem-
and metallicity. Figs 16 and 17 illustrate accuracies by com- perature or gravity that does not match what our analysis
paring the results to the reference values, and they show would have found with our models, codes and set-up.
that the biggest disagreements tend to happen with cold In order to compare visually the precision for all the
and/or metal-poor stars, which is especially significant for analysed elements simultaneously among all the codes, I
the equivalent-width method, as explained in the next sec- added the normalized differences and dispersion and rep-
tion. In terms of agreement between the two equivalent- resent them in Fig. 23. The results indicate that the pattern
width codes (see the left subplots in Fig. 18), discrepancies observed for iron abundances can be generalized for the rest
seem to be mainly influenced by the stellar metallicity, al- of the elements.
though higher discrepancies also appear for lower and higher Regarding the accuracy of all the derived individual
effective temperatures and surface gravities. Metallicity also chemical abundances with fixed atmospheric parameters
affects the level of agreement between synthetic spectral- (Fig. 24), equivalent-width methods outperform synthesis
fitting codes (see Fig. 19), and certain code pairs also show methods for calcium abundances but not for the rest of
Turbospectrum
Turbospectrum
Common lines Common lines
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
250
MOOG EW 0 -23 -22 -46 -50 -54 -10 -71 MOOG EW 0 30 191 171 184 157 172 199
34.50 100 171.50
WIDTH9 23 0 -18 -34 -41 -52 1 -46 WIDTH9 30 0 203 201 224 197 201 203
28.50 201.00 200
Grid 22 18 0 15 -12 -9 39 8 50 Grid 191 203 0 24 40 33 37 24
4.50 35.00
teff (dispersion)
150
teff (median)
SPECTRUM 46 34 -15 0 -11 -23 25 -3 SPECTRUM 171 201 24 0 30 14 40 9
7.00 27.00
0 Turbospectrum 184 224 40
Turbospectrum 50 41 12 11 0 -6 37 11 30 0 31 27 32
8.50 31.50 100
SME 54 52 9 23 6 0 46 18 SME 157 197 33 14 31 0 46 16
7.50 50 32.00
MOOG Synth 10 -1 -39 -25 -37 -46 0 -29 MOOG Synth 172 201 37 40 27 46 0 50 50
13.00 43.00
SYNTHE 71 46 -8 3 -11 -18 29 0 100 SYNTHE 199 203 24 9 32 16 50 0
28.00
1.50 0
:: logg (median) :: logg (dispersion)
Turbospectrum
Turbospectrum
Common lines Common lines
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
0.20 0.40
MOOG EW 0.00 -0.03 -0.04 0.03 -0.02 0.00 0.09 -0.01 MOOG EW 0.00 0.04 0.32 0.33 0.32 0.33 0.32 0.31
0.01 0.32
0.15 0.35
WIDTH9 0.03 0.00 -0.01 0.04 0.03 0.02 0.09 0.03 WIDTH9 0.04 0.00 0.34 0.36 0.33 0.34 0.29 0.35
0.03 0.34
0.10 0.30
Grid 0.04 0.01 0.00 0.02 -0.03 0.01 0.08 0.02 Grid 0.32 0.34 0.00 0.09 0.09 0.09 0.21 0.07
logg (dispersion)
0.01 0.09
0.05 0.25
logg (median)
SPECTRUM -0.03 -0.04 -0.02 0.00 -0.04 0.00 0.07 0.00 SPECTRUM 0.33 0.36 0.09 0.00 0.10 0.04 0.10 0.01
0.01 0.10
0.00 0.20
Turbospectrum 0.02 -0.03 0.03 0.04 0.00 0.02 0.11 0.03 Turbospectrum 0.32 0.33 0.09 0.10 0.00 0.08 0.13 0.07
0.01 0.10
0.05 0.15
SME 0.00 -0.02 -0.01 0.00 -0.02 0.00 0.08 0.01 SME 0.33 0.34 0.09 0.04 0.08 0.00 0.11 0.03
0.01 0.08
0.10 0.10
MOOG Synth -0.09 -0.09 -0.08 -0.07 -0.11 -0.08 0.00 -0.08 MOOG Synth 0.32 0.29 0.21 0.10 0.13 0.11 0.00 0.09
0.08 0.12
0.15 0.05
SYNTHE 0.01 -0.03 -0.02 0.00 -0.03 -0.01 0.08 0.00 SYNTHE 0.31 0.35 0.07 0.01 0.07 0.03 0.09 0.00
0.01 0.07
0.20 0.00
:: MH (median) :: MH (dispersion)
Turbospectrum
Turbospectrum
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
0.10
MOOG EW 0.00 0.01 0.04 0.04 0.03 0.05 0.05 0.03 0.06 MOOG EW 0.00 0.01 0.07 0.09 0.09 0.10 0.09 0.10
0.04 0.09
WIDTH9 -0.01 0.00 0.03 0.04 0.04 0.03 0.06 0.02 WIDTH9 0.01 0.00 0.08 0.08 0.09 0.09 0.07 0.09
0.03 0.04 0.08 0.08
Grid -0.04 -0.03 0.00 0.00 -0.01 0.01 0.02 0.00 Grid 0.07 0.08 0.00 0.01 0.03 0.03 0.04 0.03
0.01 0.02 0.03
MH (dispersion)
0.06
MH (median)
SPECTRUM -0.04 -0.04 0.00 0.00 -0.01 0.00 0.01 0.00 SPECTRUM 0.09 0.08 0.01 0.00 0.03 0.01 0.03 0.01
0.00 0.02
0.00 Turbospectrum 0.09 0.09 0.03 0.03 0.00 0.04 0.03 0.03
Turbospectrum -0.03 -0.04 0.01 0.01 0.00 0.01 0.02 0.01
0.01 0.03 0.04
SME -0.05 -0.03 -0.01 0.00 -0.01 0.00 0.00 0.00 0.02 SME 0.10 0.09 0.03 0.01 0.04 0.00 0.03 0.01
0.01 0.03
MOOG Synth -0.05 -0.06 -0.02 -0.01 -0.02 0.00 0.00 -0.01 0.04 MOOG Synth 0.09 0.07 0.04 0.03 0.03 0.03 0.00 0.03 0.02
0.01 0.03
SYNTHE -0.03 -0.02 0.00 0.00 -0.01 0.00 0.01 0.00 0.06 SYNTHE 0.10 0.09 0.03 0.01 0.03 0.01 0.03 0.00
0.03
0.00 0.00
Figure 8. Median and robust standard deviation of the difference in effective temperature, surface gravity or metallicity between different
radiative transfer codes when analysing the Gaia Benchmark Stars and using the common line selection (subtraction sense: column minus
row).
the elements. It is worth remembering that the reference group analysed, how results were combined, and how out-
chemical abundances were determined by combining spec- liers were treated or removed (Adibekyan et al. 2015), the
troscopic results obtained by different groups using their own reference values may be biased towards one method or code,
techniques (abundances cannot be obtained independently depending on the element. For instance, when considering
from spectroscopy, in contrast to the effective temperature calcium abundances derived with Turbospectrum but using
and surface gravity). Thus, depending on how many differ- only lines in common with the groups ULB and GAU from
ent methods were used, how many stars and elements each Jofré et al. 2015 (which used synthesis with Turbospectrum)
Turbospectrum
Turbospectrum
Common lines Common lines
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
0.6 0.6
MOOG EW 0.00 -0.10 -0.29 -0.34 -0.34 -0.32 -0.26 -0.33 MOOG EW 0.00 0.06 0.33 0.47 0.47 0.40 0.39 0.47
0.30 0.40
WIDTH9 0.10 0.00 -0.22 -0.28 -0.28 -0.26 -0.25 -0.27 0.4 WIDTH9 0.06 0.00 0.36 0.43 0.46 0.42 0.40 0.45 0.5
0.26 0.41
Grid 0.29 0.22 0.00 0.02 0.02 0.02 0.06 0.02 Grid 0.33 0.36 0.00 0.04 0.04 0.06 0.09 0.05
0.2 0.4
vmic (dispersion)
0.02 0.06
vmic (median)
SPECTRUM 0.34 0.28 -0.02 0.00 0.00 0.00 0.03 0.00 SPECTRUM 0.47 0.43 0.04 0.00 0.01 0.02 0.04 0.01
0.00 0.03
0.0 0.3
Turbospectrum 0.34 0.28 -0.02 0.00 0.00 0.00 0.04 0.00 Turbospectrum 0.47 0.46 0.04 0.01 0.00 0.04 0.04 0.02
0.00 0.04
SME 0.32 0.26 -0.02 0.00 0.00 0.00 0.04 0.00 0.2 SME 0.40 0.42 0.06 0.02 0.04 0.00 0.07 0.01 0.2
0.00 0.05
MOOG Synth 0.26 0.25 -0.06 -0.03 -0.04 -0.04 0.00 -0.03 MOOG Synth 0.39 0.40 0.09 0.04 0.04 0.07 0.00 0.04
0.01 0.4 0.06 0.1
SYNTHE 0.33 0.27 -0.02 0.00 0.00 0.00 0.03 0.00 SYNTHE 0.47 0.45 0.05 0.01 0.02 0.01 0.04 0.00
0.00 0.03
0.6 0.0
Figure 9. Median and robust standard deviation of the difference in microturbulence velocity between different radiative transfer codes
when analysing the Gaia Benchmark Stars and using one common line selection for equivalent width methods plus another common one
for synthetic spectral-fitting technique.
Turbospectrum
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
(Normalized | Teff| + | logg| + | MH|)
dispersions
SYNTHE 1.52 1.39 0.31 0.07 0.45 0.22 0.79 0.00 SYNTHE 2.12 1.31 0.36 0.23 0.41 0.13 0.54 0.00
median
median
4.76 5.10
0.00 0.00
Figure 10. Sum of the normalized absolute median differences and normalized robust standard deviation for effective temperature,
surface gravity and metallicity when analysing the Gaia Benchmark Stars. Lower numbers indicate the codes lead to more similar results
(higher precision).
then the median difference and robust standard deviation go the reference macroturbulence velocity and rotation) while
down to −0.03 ± 0.08 and −0.01 ± 0.06, respectively, from the fixing the rest of the parameters to their reference values,
original −0.09±0.11 dex. Similarly, there are several elements and then calculating the iron abundance using the reference
for which equivalent-width codes strongly underperform. For parameters plus the microturbulence and resolution found. I
instance, if I consider cobalt results with MOOG EW and I obtained 0.00±0.03 and −0.02±0.02 dex for Grid and SPEC-
use the same spectra and absorption lines in common with TRUM respectively, which show lower dispersions than the
the groups EPI, POR and UCM from Jofré et al. 2015 (which values −0.05 ± 0.10 and −0.06 ± 0.12 dex obtained with all
used equivalent-width with MOOG) then the median differ- the parameters fixed.
ence and robust standard deviation go to 0.00 ± 0.05 and
0.00 ± 0.03 and 0.00 ± 0.02, respectively, from the original Finally, when considering derived abundances instead
0.22 ± 0.30 dex. of line-by-line differential ones (i.e. the derived abundance
I also showed in Section 4.2 that the microturbulence for a particular absorption line and target star minus the de-
velocity does not have exactly the same effect for all the rived abundance for the same absorption line in the reference
methods, thus imposing the same reference value affects each star, here the Sun), the accuracy of the results and level of
code differently. To assess this effect, I used Grid and SPEC- agreement between codes significantly worsens. Line-by-line
TRUM (i.e. interpolating from a grid of spectra and syn- differential analysis helps to reduce systematics, such as the
thesizing) with their best line selection, and I repeated the ones presented in Section 4.1, although the more different
analysis by first computing the microturbulence velocity and the target star is from the reference star, the less effective
resolution for each star (which will compensate for errors in this strategy is.
Common+wings [R]
Common+wings [R]
Common+wings
Common+wings
Own+wings [R]
Own+wings [R]
Common [R]
Common [R]
Own+wings
Own+wings
Common
Common
Own [R]
Own [R]
325
182.00
135.00
151.50
129.00
159.00
155.00
145.00
127.50
26.50
Own
Own
6.50
5.00
1.00
1.00
20.50
100
8.00
2.00
MOOG EW 260 327 260 327 236 283 300
MOOG EW 30 120 30 120 69 139 69 139 236 283
94.50 271.50
WIDTH9 18 87 18 87 5 81 WIDTH9 275 322 275 322 243 332 243 332 275
5 81
Difference dispersion
-20 -16 129.00
149 98
18.00
SPECTRUM 44 -28 -3 -6 7 -6 -3 0 SPECTRUM 196 128 118 102 156 147 124 115 225
3.00 126.00
Turbospectrum -6 -25 -49 -69 -9 0 Turbospectrum 149 129 156 119 119 119
34.00
-29 -39 -54 130 115 200
124.00
SME 23 -38 -69 -92 0 -4 -44 -36 SME 205 161 213 143 162 163 196 140
37.00 162.50 175
MOOG Synth 69 6 131 97 2 -7 111 90 50 MOOG Synth 142 133 126 139 178 152 141 148
79.50 141.50
SYNTHE 0 -41 -2 -7 2 SYNTHE 162 137 122 80 139 158 150
2.00
-4 1 -2 106 106
129.50
100 125
Common+wings [R]
Common+wings [R]
Common+wings
Common+wings
Own+wings [R]
Own+wings [R]
Common [R]
Common [R]
Own+wings
Own+wings
Common
Common
Own [R]
Own [R]
0.15
Own
Own
0.07
0.10
0.07
0.04
0.05
0.04
0.04
0.03
0.29
0.28
0.21
0.19
0.26
0.26
0.18
0.16
0.40
MOOG EW -0.10-0.05-0.10-0.050.02-0.020.02-0.02 MOOG EW 0.45 0.44 0.45 0.44 0.41 0.33 0.41 0.33
0.04 0.10 0.42
WIDTH9 -0.11-0.09-0.11-0.09-0.08-0.10-0.08-0.10 WIDTH9 0.41 0.42 0.41 0.42 0.36 0.37 0.36 0.37 0.35
Absolute median difference
0.10 0.39
Grid -0.04-0.10-0.03-0.03-0.09-0.12-0.04-0.04 Grid 0.24 0.28 0.16 0.16 0.22 0.24 0.12 0.18
Difference dispersion
0.05
0.04 0.20
SPECTRUM -0.03-0.10-0.04-0.03-0.05-0.03-0.03-0.01 SPECTRUM 0.26 0.25 0.13 0.11 0.25 0.24 0.10 0.09 0.30
0.03 0.18
Turbospectrum -0.09-0.18-0.15-0.16-0.16-0.17-0.16-0.14 0.00 Turbospectrum 0.27 0.25 0.25 0.13 0.27 0.27 0.20 0.13
0.16 0.25 0.25
SME -0.06-0.13-0.12-0.13-0.01-0.03-0.10-0.08 SME 0.28 0.27 0.21 0.22 0.22 0.22 0.17 0.15
0.09 0.05 0.22
MOOG Synth 0.01-0.010.22 0.19 0.00-0.010.14 0.15 MOOG Synth 0.40 0.39 0.21 0.22 0.40 0.40 0.23 0.24 0.20
0.08 0.32
SYNTHE -0.08-0.10-0.03-0.04-0.05-0.04-0.03-0.02 0.10 SYNTHE 0.29 0.21 0.12 0.10 0.24 0.21 0.15 0.10
0.04 0.18 0.15
0.15
:: MH (median) :: MH (dispersion)
Common+wings [R]
Common+wings [R]
Common+wings
Common+wings
Own+wings [R]
Own+wings [R]
Common [R]
Common [R]
Own+wings
Own+wings
Common
Common
Own [R]
0.13
Own [R]
Own
Own
0.04
0.04
0.02
0.04
0.01
0.04
0.10
0.08
0.10
0.06
0.08
0.07
0.07
0.07
0.01
0.01
0.04 0.12
MOOG EW -0.03-0.05-0.03-0.050.04 0.01 0.04 0.01 MOOG EW 0.10 0.13 0.10 0.13 0.12 0.07 0.12 0.07
0.01 0.11
WIDTH9 -0.02-0.03-0.02-0.03-0.01-0.02-0.01-0.02 WIDTH9 0.13 0.12 0.13 0.12 0.13 0.11 0.13 0.11 0.11
Absolute median difference
Figure 11. Median and robust standard deviation of the difference in effective temperature with respect to the reference values when
analysing the Gaia Benchmark Stars and using different radiative transfer codes with several set-ups: using lines in common within
equivalent-width and synthesis methods (labelled as ’Common’); using the best lines for each code (i.e. their own lines, which are not
necessarily good for other codes, labelled as ’Own’); using the wings of H-α/β and the Mg triplet (labelled as ’Wings’); and repeating the
normalization (labelled as ”[R]”) but using a synthetic spectrum that matches the atmospheric parameters found in the first iteration.
MNRAS 000, 1–22 (2018)
18 S. Blanco-Cuaresma
4.3.2 Limited Gaia Benchmark Stars data set different pattern shown for metallicities between -2.0 and
0.0 dex is particularly puzzling. The effect of the microturbu-
Similarly to in Section 4.2.2, in order to explore a more lim-
lence velocity shows a small but increasing systematic when
ited region of the parameter space than the Gaia Bench-
going towards higher values (i.e. it is not just a constant
mark Stars cover, I selected individual chemical abundances
offset between codes). Alpha enhancement does not have an
for stars with reference effective temperature higher than
impact on MOOG results, probably because MOOG does
4 500 K and metallicity greater than -1.0 dex. Then I added
not re-compute the electron density but directly uses the
the normalized median difference and robust standard dis-
values from the model atmosphere (i.e. changing the alpha
persion between codes for all the analysed elements, as
parameter does not have an effect unless a full new model
shown in Fig. 25. Filtering out stars that are less convenient
atmosphere is computed with the changed alpha parame-
for the equivalent-width method does not erase the system-
ter). WIDTH9 leads to more stable results, despite signif-
atic differences already observed in Fig. 25 and described in
icantly reducing the number of layers in the model atmo-
Section 4.3.1.
sphere, while MOOG median abundances show an offset of
When comparing the results to the reference values as
0.10 dex when only 12 layers are used instead of the original
shown in Fig. 26, the median differences and robust standard
56
deviations improve for all the codes compared with Fig. 24,
Regarding synthesis (see Figs 29 and 30), lower effective
but more significantly for the equivalent-width methods,
temperatures lead to increasing discrepancies in the contin-
with MOOG EW obtaining better results than WIDTH9.
uum and absorption line core depths. At the coolest end
(2 800 K), Turbospectrum and SME are relatively close, with
4.4 The non-observed data set experiment the deepest continuum among all the codes. MOOG is at the
other end of the range, with a continuum depth similar to
The analysis of the data set of 672 normalized synthetic spec- the Sun. In terms of surface gravity, all the codes compute
tra (112 spectra synthesized with the five codes included in a continuum depth that is generally in better agreement for
this analysis plus 112 interpolated with the pre-computed giant stars, while line core depths show the opposite pat-
grid) described in Section 3.7 represents a major computa- tern, with the exception of MOOG, which is systematically
tional effort, involving hundreds of CPU hours. Apart from deeper than the rest of the codes (the opposite is true for
the determination of atmospheric parameters, it has led line depths). Changes in metallicity show a high level of
to the determination of more than two million abundances agreement for absorption line depths, although small dis-
from more than 60 000 absorption lines analysed with each crepancies in continuum depth are present for solar values.
method and code. Interestingly, variations in alpha abundances lead to very
The outcome of this experiment, summarized in Fig. 27, different continuum depth patterns among the codes. The
reproduces very closely the same main results as obtained highest agreement is found for absorption line depths with
using the observed data set. This ensures that the conclu- solar alpha abundances, while MOOG and Turbospectrum
sions from this work are not affected by observational biases deviate from the rest for negative values. Microturbulence
such as instrument effects, night conditions, raw data pro- effects are only evident on the continuum depths, where all
cessing, or the inability of models to perfectly reproduce the codes keep an extremely small constant difference for
physical processes. all tested values. Finally, when the number of layers in the
model atmosphere is reduced, SME is the code that deviates
4.5 The one variable at a time experiment the most from the reference point.
Common+wings [R]
Line Data. Kurucz CD-ROM No. 18. Cambridge, Mass.:
Common+wings
Own+wings [R]
Smithsonian Astrophysical Observatory, 1993., 18
Common [R]
Majewski S. R., et al., 2017, AJ, 154, 94
Own+wings
Common
Mucciarelli A., Pancino E., Lovisi L., Ferraro F. R., Lapenna E.,
Own [R]
2013, ApJ, 766, 78
Own
18.50
12.50
13.00
10.50
11.50
8.50
7.00
9.00
Ness M., Hogg D. W., Rix H.-W., Ho A. Y. Q., Zasowski G., 2015, 40
ApJ, 808, 16
Niemczura E., Smalley B., Pych W., 2014, Determination of
MOOG EW 32 40 32 40 27 20 27 20
29.50
Atmospheric Parameters of B-, A-, F- and G-Type Stars, WIDTH9 38 48 38 48 23 43 23 43 35
Common+wings [R]
MOOG: LTE line analysis and spectrum synthesis, Astro-
Common+wings
physics Source Code Library (ascl:1202.009)
Own+wings [R]
Tabernero H. M., González Hernández J. I., Montes D., 2013, in
Common [R]
Own+wings
Guirado J. C., Lara L. M., Quilis V., Gorgas J., eds, Highlights
Common
Own [R]
of Spanish Astrophysics VII. pp 673–673
Own
The Astropy Collaboration et al., 2018, preprint,
0.03
0.01
0.02
0.01
0.02
0.01
0.03
0.02
(arXiv:1801.02634) 0.08
Tsantaki M., Andreasen D. T., Teixeira G. D. C., Sousa S. G., MOOG EW 0.06 0.07 0.06 0.07 0.06 0.03 0.06 0.03
0.06
Santos N. C., Delgado-Mena E., Bruzual G., 2018, MNRAS, WIDTH9 0.09 0.10 0.09 0.10 0.08 0.07 0.08 0.07 0.07
Temperature [K] X X X X X
Depth [cm] X X
Table A1. Model atmosphere fields required as input values for each radiative transfer code. This list respects the expected input order
as required by the used version of iSpec.
1.0 H- 1.0 H-
Common+wings
0.8
Common [R]
Own+wings
0.9
Common
Own [R]
2.0 0.6
0.8
Own
8.04
8.82
7.93
8.36
6.69
7.37
7.03
7.27
1.0 1.0
(Normalized | Teff| + | logg| + | MH|)
MOOG EW 1.47 1.85 1.47 1.85 1.29 1.11 1.29 1.11 1.8
11.44 0.9 0.8
WIDTH9 1.58 1.78 1.58 1.78 1.30 1.67 1.30 1.67 1.6 0.6
12.66
0.8
Grid 0.66 0.84 0.69 0.65 0.64 0.80 0.58 0.65 655.5 656.5 657.5 485.6 486.1 486.6
Wavelength (nm) Wavelength (nm)
5.50 1.4
SPECTRUM 0.92 0.86 0.66 0.49 0.67 0.62 0.50 0.49
5.21
Turbospectrum 0.83 0.96 0.93 0.93 0.79 0.94 0.86 0.88 1.2
7.11
SME 0.91 0.92 0.90 0.99 0.61 0.75 0.88 0.85
6.80 1.0 Figure 14. Hydrogen line regions from a NARVAL-observed solar
MOOG Synth 0.90 0.72 1.05 1.13 0.70 0.77 1.01 1.06 spectrum and the solar ATLAS (top), plus the same NARVAL-
7.35 observed solar spectrum and the corresponding synthetic spectra
SYNTHE 0.79 0.89 0.65 0.54 0.69 0.72 0.60 0.57 0.8 generated with each code (bottom).
dispersions
median
5.44
0.6
3796
3927
4197
4286
4474
4587
4858
4983
5059
5123
5308
5522
5792
5868
5902
6083
6121
6223
6554
3796
3927
4197
4286
4474
4587
4858
4983
5059
5123
5308
5522
5792
5868
5902
6083
6121
6223
6554
Figure 15. Difference between the derived effective temperature and its reference value for each spectrum analysed with the synthetic
spectral-fitting codes when using only the wings of H-α (left subplots), H-β (middle subplots) and both of them together (right subplots).
The vertical thick grey line denotes the Sun. The colour-coding represents the metallicity of each star (see right subplots in Fig. 16 for
colour-code interpretation). All the subplots are sorted taking into account the reference effective temperature. The median and absolute
median deviation are indicated in the upper right of each subplot.
MOOG EW :: teff 69 +/- 236 MOOG EW :: logg 0.02 +/- 0.41 MOOG EW :: MH 0.04 +/- 0.12
1000 2 1.0
500 1 0.5
0 0 0.0
500 1 0.5
1000 2 1.0
WIDTH9 :: teff 5 +/- 243 WIDTH9 :: logg -0.08 +/- 0.36 WIDTH9 :: MH -0.01 +/- 0.13
1000 2 1.0
500 1 0.5
0 0 0.0
500 1 0.5
1000 2 1.0
3796
3927
4197
4286
4474
4587
4858
4983
5059
5123
5308
5522
5792
5868
5902
6083
6121
6223
6554
0.68
1.05
1.43
1.64
2.51
2.77
2.9
3.58
3.79
4.0
4.1
4.2
4.27
4.3
4.41
4.44
4.53
4.6
4.63
-2.43
-1.46
-1.31
-1.23
-1.0
-0.82
-0.62
-0.5
-0.45
-0.37
-0.33
-0.1
-0.05
0.01
0.06
0.13
0.21
0.24
0.3
Figure 16. Difference between the derived parameter and its reference value for each spectra analyzed with the equivalent method
width when using their best line selection (i.e., own lines). The vertical thick gray line denotes the Sun. The color coding represent the
metallicity of each star. All the subplots are sorted taking into account the reference value of the corresponding atmospheric parameter.
Median and absolute median deviation are indicated on the upper right of each subplot.
0.68
1.05
1.43
1.64
2.51
2.77
2.9
3.58
3.79
4.0
4.1
4.2
4.27
4.3
4.41
4.44
4.53
4.6
4.63
-2.43
-1.46
-1.31
-1.23
-1.0
-0.82
-0.62
-0.5
-0.45
-0.37
-0.33
-0.1
-0.05
0.01
0.06
0.13
0.21
0.24
0.3
Figure 17. As Fig. 16, but for spectra analyzed with the synthetic spectral-fitting technique.
Element name X X X X
Wavelength [Å] X X X X
Wavelength [nm] X
loggf X X X X X
Transition type: X X
Fudge factor (common for the same atomic number and ion)
or van der Waals damping parameter (classic or AO theory) if present X
Table A2. Atomic line list fields required as input values for each radiative transfer code. Transition type indicates whether the α and
σ parameters used in the Anstee and O’Mara broadening theory are provided (Anstee & O’Mara 1991, 1995, coded as AO type;) or the
classic van der Waals broadening should be used (GA type) as described in SPECTRUM documentation. Fudge factors are arbitrary
non-physical values used to increase the line broadening to compensate for unknowns. This list respects the expected input order as
required by the used version of iSpec.
teff
teff
500 500
1000 1000
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
2
6635
WIDTH9 - MOOG EW -0.09 +/- 0.16
2
SPECTRUM - MOOG EW -0.17 +/- 0.38
1 1
0 0
logg
logg
1 1
2 2
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
WIDTH9 - MOOG EW -0.03 +/- 0.06 SPECTRUM - MOOG EW -0.04 +/- 0.07
1.0 1.0
0.5 0.5
0.0 0.0
MH
MH
0.5 0.5
1.0 1.0
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
500
1000
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
3807
4197
4374
4587
4954
5059
5231
5522
5810
5902
6099
6223
6635
Grid-SPECTRUM -0.04 +/- 0.07 Turbo.-SPECTRUM -0.04 +/- 0.14 SME-SPECTRUM 0.00 +/- 0.04 MOOG S.-SPECTRUM 0.03 +/- 0.09 SYNTHE-SPECTRUM 0.00 +/- 0.04
2
1
0
logg
1
2
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
1.05
1.43
2.09
2.77
3.52
3.79
4.06
4.2
4.3
4.41
4.49
4.6
4.67
Grid-SPECTRUM 0.00 +/- 0.02 Turbo.-SPECTRUM 0.01 +/- 0.01 SME-SPECTRUM 0.00 +/- 0.01 MOOG S.-SPECTRUM 0.01 +/- 0.03 SYNTHE-SPECTRUM -0.01 +/- 0.02
1.0
0.5
0.0
MH
0.5
1.0
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
-2.09
-1.31
-1.16
-0.82
-0.53
-0.45
-0.34
-0.1
-0.04
0.06
0.14
0.24
0.33
Figure 19. As Fig. 18, but only for the synthetic spectral-fitting technique.
Turbospectrum
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
(Normalized | Teff| + | logg| + | MH|)
dispersions
SYNTHE 1.20 1.63 0.34 0.10 0.20 0.23 0.55 0.00 SYNTHE 1.33 1.56 0.41 0.16 0.55 0.25 0.42 0.00
median
median
4.25 4.69
Teff > 4500 K and [Fe/H] > -1.0 dex
0.00 Teff > 4500 K and [Fe/H] > -1.0 dex
0.00
Figure 20. As Fig. 10, but considering only Gaia Benchmark Stars with effective temperatures greater than 4 500 K and metallicities
greater than -1.0 dex.
Common+wings [R]
Common+wings
Own+wings [R]
Common [R]
Own+wings
Common
Own [R]
2.0
Own
8.82
8.93
8.47
8.38
7.18
7.72
7.60
7.62
0.8
median
6.76
Turbospectrum
Turbospectrum
Own lines all fixed Own lines all fixed
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
0.20 0.30
MOOG EW 0.00 0.00 -0.11 -0.11 -0.08 -0.10 -0.10 -0.11 MOOG EW 0.00 0.02 0.19 0.19 0.16 0.15 0.14 0.16
0.10 0.15
0.15
WIDTH9 0.00 0.00 -0.09 -0.08 -0.08 -0.09 -0.09 -0.08 WIDTH9 0.02 0.00 0.13 0.15 0.12 0.13 0.13 0.13 0.25
0.08 0.13
0.10
Grid 0.11 0.09 0.00 0.00 0.01 0.00 -0.01 -0.01 Grid 0.19 0.13 0.00 0.01 0.04 0.03 0.04 0.02
0.20
[Fe/H] (dispersion)
0.01 0.04
[Fe/H] (median)
0.05
SPECTRUM 0.11 0.08 0.00 0.00 0.01 0.00 0.00 0.00 SPECTRUM 0.19 0.15 0.01 0.00 0.03 0.01 0.04 0.02
0.00 0.03
0.00 0.15
Turbospectrum 0.08 0.08 -0.01 -0.01 0.00 -0.01 -0.01 -0.01 Turbospectrum 0.16 0.12 0.04 0.03 0.00 0.02 0.01 0.02
0.01 0.03
0.05
SME 0.10 0.09 0.00 0.00 0.01 0.00 0.00 0.00 SME 0.15 0.13 0.03 0.01 0.02 0.00 0.03 0.01 0.10
0.00 0.03
0.10
MOOG Synth 0.10 0.09 0.01 0.00 0.01 0.00 0.00 0.00 MOOG Synth 0.14 0.13 0.04 0.04 0.01 0.03 0.00 0.03
0.01 0.04 0.05
0.15
SYNTHE 0.11 0.08 0.01 0.00 0.01 0.00 0.00 0.00 SYNTHE 0.16 0.13 0.02 0.02 0.02 0.01 0.03 0.00
0.01 0.02
0.20 0.00
Figure 22. Median and robust standard deviation of the difference in iron abundance between different radiative transfer codes when
analysing the Gaia Benchmark Stars and fixing all the atmospheric parameters to the reference ones and using the best line selection for
each code.
MOOG Synth
SPECTRUM
MOOG EW
WIDTH9
SYNTHE
SME
Grid
MOOG Synth 6.33 5.31 1.05 0.85 0.53 0.61 0.00 0.60
median
15.29
1
SYNTHE 6.25 5.57 0.83 0.55 0.68 0.30 0.60 0.00
14.77
0
0.20
[Mg/H]
[Mn/H]
[Ca/H]
[Co/H]
[Mg/H]
[Mn/H]
[Fe/H]
[Sc/H]
[Cr/H]
[Ca/H]
[Co/H]
[Ni/H]
[Fe/H]
[Sc/H]
[Si/H]
[Ti/H]
[Cr/H]
[Ni/H]
[V/H]
[Si/H]
[Ti/H]
[V/H]
0.10
0.18
MOOG EW 0.05 0.02 0.22 0.11 0.09 0.08 0.09 0.07 0.14 0.05 0.19 MOOG EW 0.08 0.08 0.30 0.16 0.17 0.27 0.13 0.10 0.19 0.10 0.22
0.09 0.16
WIDTH9 0.05 0.04 0.19 0.14 0.06 0.07 0.08 0.08 0.05 0.07 0.09 WIDTH9 0.09 0.11 0.25 0.17 0.16 0.21 0.13 0.11 0.08 0.13 0.14 0.16
0.07 0.05 0.13
Grid -0.05-0.09-0.03-0.03-0.010.01-0.03-0.04-0.03-0.03-0.03 Grid 0.10 0.10 0.08 0.07 0.05 0.08 0.10 0.10 0.06 0.07 0.04
Difference dispersion
Median difference
0.03 0.08 0.14
SPECTRUM -0.06-0.08-0.03-0.050.00 0.03-0.02-0.05-0.02-0.03-0.01 SPECTRUM 0.12 0.10 0.09 0.09 0.06 0.08 0.13 0.10 0.08 0.05 0.13
0.03 0.09
Turbospectrum -0.03-0.09-0.02-0.010.00 0.02-0.02-0.02-0.01-0.03-0.02 0.00 Turbospectrum 0.10 0.11 0.05 0.04 0.06 0.09 0.06 0.09 0.06 0.05 0.07
0.02 0.06
0.12
SME -0.07-0.08-0.02-0.06-0.02-0.01-0.03-0.020.00-0.03-0.02 SME 0.13 0.11 0.05 0.08 0.05 0.10 0.09 0.11 0.07 0.04 0.10
0.02 0.09
MOOG Synth -0.03-0.08-0.01-0.010.00-0.00-0.02-0.02-0.01-0.02-0.02 0.05 MOOG Synth 0.09 0.13 0.06 0.08 0.06 0.10 0.06 0.10 0.07 0.05 0.12 0.10
0.02 0.08
SYNTHE -0.06-0.08-0.03-0.03-0.010.01-0.03-0.02-0.01-0.03-0.03 SYNTHE 0.12 0.12 0.06 0.05 0.07 0.10 0.10 0.10 0.06 0.04 0.10
0.03 0.10 0.08
0.10
0.06
:: Median difference :: Difference dispersion
Own lines all fixed Own lines all fixed
Figure 24. Median and robust standard deviation of the difference in individual abundances between the reference values and different
radiative transfer codes when fixing all the atmospheric parameters to the reference ones when analysing the Gaia Benchmark Stars.
The best line selection for each code was used. The median dispersion per star is equal or below 0.02 dex for all the cases.
MOOG Synth
SPECTRUM
MOOG EW
WIDTH9
SYNTHE
SME
Grid
MOOG Synth 5.51 5.69 1.92 1.61 1.23 1.28 0.00 1.21
median
18.44
1
SYNTHE 6.04 5.61 1.59 1.11 1.25 0.54 1.21 0.00
17.36
Teff > 4500 K and [Fe/H] > -1.0 dex
0
[Mg/H]
[Mn/H]
[Ca/H]
[Co/H]
[Fe/H]
[Sc/H]
[Cr/H]
[Mg/H]
[Mn/H]
[Ni/H]
[Si/H]
[Ca/H]
[Co/H]
[Ti/H]
[Fe/H]
[Sc/H]
[Cr/H]
[V/H]
[Ni/H]
[Si/H]
[Ti/H]
0.04
[V/H]
0.09
MOOG EW 0.04 0.00 0.05 0.03 0.00 0.00 0.02 0.04 0.02 0.02 0.08 MOOG EW 0.07 0.04 0.09 0.05 0.04 0.12 0.03 0.06 0.05 0.06 0.12
0.02 0.06
WIDTH9 0.02 0.00 0.04 0.04 0.00 0.04 0.01 0.05 0.02 0.02 0.03 0.02 WIDTH9 0.04 0.09 0.08 0.06 0.19 0.12 0.04 0.07 0.03 0.06 0.07 0.08
0.02 0.07
Grid 0.10 0.07 0.05 0.04 0.05 0.08 0.05 0.07 0.04 0.03 0.04
Difference dispersion
Grid -0.06-0.05-0.01-0.02-0.010.00-0.03-0.02-0.03-0.03-0.03
Median difference
0.03 0.05
SPECTRUM -0.04-0.040.00-0.020.00 0.01-0.02-0.02-0.03-0.03-0.02 SPECTRUM 0.09 0.09 0.06 0.05 0.03 0.10 0.06 0.09 0.06 0.03 0.09 0.07
0.02 0.06
Turbospectrum -0.03-0.030.00-0.020.00-0.01-0.02-0.01-0.02-0.03-0.02 0.00 Turbospectrum 0.10 0.07 0.03 0.04 0.04 0.06 0.03 0.07 0.04 0.03 0.07
0.02 0.04 0.06
SME -0.03-0.04-0.01-0.03-0.01-0.02-0.03-0.01-0.02-0.03-0.02 SME 0.09 0.07 0.02 0.04 0.04 0.07 0.06 0.10 0.05 0.03 0.04
0.02 0.05
MOOG Synth -0.02-0.03-0.00-0.030.00-0.01-0.03-0.01-0.03-0.03-0.02 MOOG Synth 0.07 0.08 0.03 0.04 0.06 0.07 0.06 0.09 0.05 0.03 0.05 0.05
0.02 0.02 0.06
SYNTHE -0.04-0.04-0.01-0.03-0.01-0.02-0.03-0.02-0.02-0.03-0.03 SYNTHE 0.10 0.07 0.03 0.06 0.04 0.09 0.06 0.10 0.04 0.03 0.04
0.03 0.06
0.04
0.04
:: Median difference :: Difference dispersion 0.03
Own lines all fixed Own lines all fixed
Figure 26. As Fig. 24 but considering only Gaia Benchmark Stars with effective temperatures greater than 4 500 K and metallicities
greater than -1.0 dex.
Turbospectrum
Synthetic data set Synthetic data set
MOOG Synth
MOOG Synth
SPECTRUM
SPECTRUM
MOOG EW
MOOG EW
WIDTH9
WIDTH9
SYNTHE
SYNTHE
SME
SME
Grid
Grid
10
(Normalized | Teff| + | logg| + | MH|)
MOOG EW 0.00 4.35 8.17 8.48 9.78 8.98 8.75 8.34 MOOG EW 0.00 7.84 39.0938.1333.6335.8235.6837.46 40
56.86 227.65
(Normalized | [Element/H]|)
WIDTH9 4.35 0.00 8.38 7.32 8.38 8.21 9.27 7.63 WIDTH9 7.84 0.00 37.8337.3733.2836.0534.5237.21 35
53.53 8 224.10
Grid 8.17 8.38 0.00 2.13 2.96 2.48 6.02 2.54 Grid 39.0937.83 0.00 5.60 7.66 8.44 9.04 7.74 30
32.70 115.40
SPECTRUM 8.48 7.32 2.13 0.00 1.98 1.19 4.86 0.78 6 SPECTRUM 38.1337.37 5.60 0.00 6.45 5.45 7.39 5.17 25
26.74 105.56
Turbospectrum 9.78 8.38 2.96 1.98 0.00 2.46 7.20 2.56 Turbospectrum 33.6333.28 7.66 6.45 0.00 5.48 2.72 5.52 20
35.33 4 94.75
SME 8.98 8.21 2.48 1.19 2.46 0.00 4.80 0.99 SME 35.8236.05 8.44 5.45 5.48 0.00 6.43 3.48 15
29.12 101.17
10
dispersions
MOOG Synth 8.75 9.27 6.02 4.86 7.20 4.80 0.00 3.77 MOOG Synth 35.6834.52 9.04 7.39 2.72 6.43 0.00 5.77
median
2
44.66 101.56
5
dispersions
SYNTHE 8.34 7.63 2.54 0.78 2.56 0.99 3.77 0.00 SYNTHE 37.4637.21 7.74 5.17 5.52 3.48 5.77 0.00
median
26.61 102.35
0 0
Figure 27. As Fig. 10 and 23 (left and right plots, respectively), but using the results from the analysis of the synthetic spectra built
for the non-observed data set experiment.
0.0 0.00
Figure 28. Median and absolute median deviation (error bars) Figure 30. As Fig. 29, but considering the depth at the line
difference in abundance over reference abundance (i.e. MOOG peaks for the common selection.
abundances for the Sun, zero-point represented by the intersection
of the two thick grey lines) when varying selected atmospheric
parameters and setting the rest to the reference values for the Sun. MOOG EW WIDTH9
The lower right plot shows the results when all the atmospheric
0.2 5 0.2
parameters are set to the solar reference and the number of layers
median(abundance - abundanceref)
0.0000 0.5
median(abundance - abundanceref)
0.025 0.000
0.0005
0.000 0.001
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5 0.0
rhox temperature pgas 0.00
0.0000 0.0000 0.0000 0.5 1.0 1.5 0.5 1.0 1.5
0.0005 0.0005 0.0005 loggf rad
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5 0.02 0.1
xne abross accrad
0.002
0.0000 0.0000 0.01
0.000
0.0
0.0005 0.0005 0.00
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5
vturb logtau5 pelectron 0.5 1.0 1.5 0.5 1.0 1.5
Stark Waals
0.0
median(line depth - line depthref)
0.05 0.001
0.1 0.5 0.0000
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5 0.000
rhox temperature pgas 0.0005
0.005 0.005 0.001
0.00 0.5 1.0 1.5 0.5 1.0 1.5
0.05 0.000 0.000 loggf rad
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5 0.001
xne abross accrad 0.0000
0.000
0.005 0.00 0.01 0.0005 0.001
0.000 0.05 0.00
0.01 0.5 1.0 1.5 0.5 1.0 1.5
0.5 1.0 1.5 0.5 1.0 1.5 0.5 1.0 1.5 Stark Waals
vturb logtau5 pelectron
0.0 0.005
0.000
0.2 0.005
0.5 1.0 1.5 0.5 1.0 1.5
loggf rad
0.005 0.01
0.000 0.00
0.01
0.005
0.5 1.0 1.5 0.5 1.0 1.5
Stark Waals
Figure 36. As Fig. 35, but considering the depth at the line
peaks for the common selection.