Professional Documents
Culture Documents
the second and third moment. We determine all possible first, second and third moments of entropy
production for a white noise process. As a consequence, we obtain a lower bound for the skewness
of the current fluctuations in dissipative devices such as transistors, thereby demonstrating that the
Gaussianity assumption widely used in electronic engineering is thermodynamically inconsistent.
Introduction.—Stochastic thermodynamics extends As the main result of this article, we find the relations
and generalizes the laws of conventional thermodynamics that hold between the mean, variance and skewness of en-
and equilibrium statistical physics to mesoscopic systems tropy production any white noise that is thermodynam-
in which random fluctuations are non negligible [1–3]. ically consistent (in that it satisfies LDB). The bounds
The theory is able to describe possibly strongly nonlin- apply in particular to the flow (e.g., electric current) go-
ear systems operating far from equilibrium [4]. Modern ing through a purely dissipative device, in both equilib-
nanoscale electronic devices, operating either in classi- rium and far-from-equilibrium conditions. Our bound
cal [5–8] or quantum regime [2, 9–13], constitute one re- contains as particular cases several important special
cent field of application of this theory. Recent contribu- cases encountered in electronics, mechanics and chem-
tions were dedicated to reliability assessment [14, 15], or istry: Johnson-Nyquist [36, 37] or Einstein diffusion pro-
relation between noise and energy dissipation in digital cess (Brownian motion [38]); shot noise or any bidirec-
CMOS circuits in non-stationary conditions [16–18]. tional Poisson process [6, 8, 39]. Moreover, because any
The local detailed balance (LDB) relation [3, 19] results colored noise can be regarded as a white noise passing
from the first principle of microscopic reversibility, and through a linear filter, we also introduce a corrected for-
formulates the entropy production in terms of probabil- mula including the filtering effect of some system (e.g.
ities of direct and time-reversed trajectories. It holds in experimental setup) through its impulse response.
wide range of situations [1]. From the LDB one can de- Problem Statement.— For a real random observable X,
rive a host of important results, such as the fluctuation let mk = hX k i be its kth moment, for k = 1, 2, 3, . . . In
relation [20], or the thermodynamic uncertainty relations this paper, h·i always denotes the expectation operator,
(TUR) [21–27]. The TURs provide a fundamental lower i.e. ensemble average. The Hamburger moment problem,
bound for the variance of entropy production ∆σ, and in probability theory, consists in characterising all possi-
more generally observables antisymmetric under time re- ble sequences m1 , m2 , m3 , . . . , mk that indeed emerge as
versal [21, 28–30]. the k first moments of some arbitrary random observable
Beyond mean and variance, characterization of higher- X. For instance for k = 2, we find that real numbers m1
order moments, like the skewness (the third central mo- and m2 are valid moments if and only if m2 ≥ m21 . One
ment) quantifying the asymmetry of the fluctuations, may also state the problem for random observables of a
provides finer information about the random physical certain type, for instance nonnegative random variables
process [31], especially far from equilibrium [6, 30]. The (Stieltjes problem). We find that real numbers m1 and
topic is covered to a much lesser extent. Other theoret- m2 are moments of some nonnegative random observable
ical works focus on special cases, notably noninteract- if and only if m2 ≥ m21 and m1 ≥ 0. The extension for
ing systems [32], unicyclic [29, 32] and multicyclic [29] arbitrary k is a standard topic of probability theory.
Markovian networks. As broadly reviewed in [7], skew- In this article we ask which real numbers can possibly
ness of electrical current fluctuations was experimentally arise as the moments (or, equivalently, cumulants) of en-
reported in tunnel junctions [9, 11], avalanche diodes [5], tropy production of a (classical) system satisfying LDB,
quantum devices [10] and metallic wire at cryogenic tem- as defined below.
perature [31]. We also analyse the near-equilibrium situation, and
In the present work, we derive a methodology to derive the case of white noise. We characterise all possible cu-
tight bounds on moments of entropy production. Besides mulants of order one (mean), two (variance) and three
recovering the generalized TUR [33–35] and Salazar’s (skewness) for thermodynamically consistent white noise.
third-moment bound [30], it allows to find bounds on Consequences of the local detailed balance.—Let Ω be
higher moments. As an illustration, we derive a novel, a probability space with probability measure p and an
tight, bound between second and third moment. We also involution ω 7→ ω (‘involution’ means that ω = ω). This
write the tightest relations that hold close to equilibrium defines p(A) = p(A) for any event A ⊆ Ω. Without loss
(in the limit of low entropy production). of generality, and for the sake of simplicity of notations,
2
from the origin and meeting S. This cone is gener- where ∆q is the random charge increment (integral of
ated by positive linear combinations of points of the form white noise current over ∆t), kB is Boltzmann’s constant
(s tanh(s/2), s2 , s3 tanh(s/2), s4 , . . .). and T is the constant temperature of the environment,
This cone is equivalently characterized by the con- assimilated to a uniform thermal bath. Thus, entropy
vex set of all values taken by the ‘scaled coordi- production and charge increment over a same time inter-
nates’ (m2 /m1 , m3 /m1 , m4 /m1 , . . .) (for all non-zero val are related by (9), proportional through a constant
points in S) indicating the directions of the half- factor, the ‘thermodynamic force’ V /kB T . Likewise, the
lines in C. In this representation, C is the con- electrical current q̇ can be identified up to the same multi-
vex hull of points (m2 /m1 , m3 /m1 , m4 /m1 , . . .) = plicative constant to the entropy production rate σ̇, both
s s3 described by a white noise.
( tanh(s/2) , s2 , tanh(s/2) , . . .). For the first three moments,
we thus have Similar situations occur in various context where a
r
m3 purely dissipative system subjected to a constant ‘ther-
modynamic force’ (mechanical force, gradient of chemical
m2 m1 m3
2< ≤ and >0 (7) potential, of temperatures, of concentration, etc.) gen-
m1 1 m3
r
m1 erates a random ‘flow’ (speed, chemical flow, heat flow,
tanh
2 m1 matter flow, etc.).
or Characterizing the moments of entropy production
m2 is thus characterizing the moments of electric current
= 2 and m3 = 0 (8)
m1 (speed, heat flow, etc.) in response to a given external
Notice that the r.h.s. of (7) converges to 2 for m3 /m1 → force, a problem of fundamental importance.
0. The (non-zero) moments (m1 , m2 , m3 ) of entropy pro- For any such white noise, the entropy production ∆σ
duction necessarily satisfy (7) or (8). This is a necessary over a time interval ∆t can be broken down as the sum of
condition, not sufficient in general, since the cone C is independent entropy productions over smaller intervals.
larger than S. Nevertheless, intuitively, the cone C is a Thus the cumulants c1 , c2 , c3 , . . . of entropy production
good approximation of S ‘near the origin’. We make this over time ∆t are proportional to ∆t, for any ∆t (small
intuition precise. or large). Indeed the cumulants are additive for the sum
Consider Cǫ the (convex) set of points of the form of independent variables. Let us recall that the first cu-
(m2 /ǫ, m3 /ǫ, . . .), for all points (ǫ, m2 , m3 , m4 . . .) in S. mulant c1 is the mean (of entropy production over a time
Thus Cǫ encodes the ‘slice’ of S with coordinate m1 = ǫ. interval ∆t), while c2 is the variance and c3 is the third
By convexity of S (which contains the origin), the set Cǫ central moment — sometimes called skewness because it
is increasing with ǫ: if ǫ < ǫ′ then Cǫ ⊃ Cǫ′ . As ǫ → 0, captures the non-symmetric nature of fluctuations on ei-
then Cǫ converges to C: every point in C is eventually ther side of the mean. The white noise is thus character-
in Cǫ for small enough ǫ. Thus C, which is larger than ized by the cumulant rates ck /∆t, which do not depend
S, can be seen as a good approximation of S for those on ∆t, and which we denote ċk (same unit as an inverse
points with small enough coordinate m1 = ǫ ≈ 0. time). For instance ċ1 is the mean entropy production
Said otherwise, any numbers m1 , m2 , m3 satisfying (7) rate.
or (8) are possible moments m1 , m2 , m3 of entropy pro- In the limit of short time intervals ∆t → 0, the cu-
duction, provided that m1 is small enough. mulants ck and the moments mk coincide: for instance
Moments and cumulants of white noise.—The typical c2 = m2 − m21 = m2 + O(∆t2 ), while c2 is proportional to
situation of interest where the bounds (7) and (8) apply ∆t. Similarly, c3 = m3 − 3m2 m1 + 2m31 = m3 + O(∆t2 ),
is the entropy production of any overdamped stationary etc.
Markov process over any infinitesimal time interval, as Thus, the relations (7)(8) hold for cumulants of white
m1 = h∆σi vanishes with the time interval ∆t → 0. noise, which satisfy either
Let us examine a specific case of particular practical r
c3
importance: the case of white noise, which can be seen
c2 c1 c3
as a Markov process with a single state (no memory of 2< ≤ 1 r c and c > 0 (10)
the past). c1 3 1
tanh
A specific example is the electrical current flowing 2 c1
through an arbitrary dissipative electronic device, like an or
homogeneous semiconductor or metallic bar or a nonlin- c2
ear diode or transistor, subjected to a constant voltage V . = 2 and c3 = 0 (11)
c1
The random current is adequately modelled as a white
noise process [6, 7]. The total entropy production over a In this equation, the ratios c2 /c1 and c3 /c1 do not de-
time interval ∆t reads pend on observation time ∆t and can be replaced (equiv-
V alently) with the rate ratios ċ2 /ċ1 and ċ3 /ċ1 . See Figure 2
∆σ = ∆q (9) for illustration.
kB T
4
Imry’s 70th Birthday (World Scientific, 2010) pp. 211– [28] J.-C. Delvenne and G. Falasco, Physical Review E 109,
221. 014109 (2024).
[10] V. F. Maisi, D. Kambly, C. Flindt, and J. P. Pekola, [29] T. Wampler and A. C. Barato, Journal of Physics A:
Physical Review Letters 112, 036801 (2014). Mathematical and Theoretical 55, 014002 (2021).
[11] P. Février, C. Lupien, and B. Reulet, in 25th Inter- [30] D. S. Salazar, Physical Review E 106, L042101 (2022).
national Conference on Noise and Fluctuations (ICNF [31] E. Pinsolle, S. Houle, C. Lupien, and B. Reulet, Physical
2019), CONF (ICLAB, 2019). review letters 121, 027702 (2018).
[12] C. Y. Gao and D. T. Limmer, Physical Review Research [32] K. Ptaszyński, Physical Review E 106, 024119 (2022).
3, 033169 (2021). [33] G. Falasco, M. Esposito, and J.-C. Delvenne, New Jour-
[13] N. Freitas, J.-C. Delvenne, and M. Esposito, Physical nal of Physics 22, 053046 (2020).
Review X 10, 031005 (2020). [34] P. P. Potts and P. Samuelsson, Physical Review E 100,
[14] N. Freitas, K. Proesmans, and M. Esposito, Physical 052137 (2019).
Review E 105, 034107 (2022). [35] Y. Hasegawa and T. Van Vu, Physical review letters 123,
[15] L. Van Brandt, D. Flandre, and J.-C. Delvenne, in IEEE 110602 (2019).
EDTM 2024, Bangalore, India (2024) accepted, invited [36] J. B. Johnson, Physical review 32, 97 (1928).
talk. [37] H. Nyquist, Physical review 32, 110 (1928).
[16] L. Van Brandt and J.-C. Delvenne, Applied Physics Let- [38] A. Einstein, Investigations on the theory of the Brownian
ters 122 (2023). movement (1905).
[17] D. H. Wolpert and A. Kolchinsky, New Journal of Physics [39] J. L. Wyatt and G. J. Coram, IEEE Transactions on
22, 063047 (2020). Electron Devices 46, 184 (1999).
[18] D. Yoshino and Y. Tokura, Journal of the Physical Soci- [40] J. Guioth and D. Lacoste, Europhysics Letters 115,
ety of Japan 92, 124004 (2023). 60007 (2016).
[19] C. Maes, SciPost Physics Lecture Notes , 032 (2021). [41] R. Kubo, Reports on progress in physics 29, 255 (1966).
[20] C. Jarzynski, Physical Review Letters 78, 2690 (1997). [42] D. Applebaum, Lévy processes and stochastic calculus
[21] J. M. Horowitz and T. R. Gingrich, Nature Physics 16, (Cambridge university press, 2009).
15 (2020). [43] Y. Tsividis and C. McAndrew, Operation and Modeling of
[22] A. C. Barato and U. Seifert, Physical review letters 114, the MOS Transistor, The Oxford Series in Electrical and
158101 (2015). Computer Engineering Series (Oxford University Press,
[23] P. Pietzonka, A. C. Barato, and U. Seifert, Journal 2011).
of Statistical Mechanics: Theory and Experiment 2016, [44] S. Tedja, J. Van der Spiegel, and H. H. Williams, IEEE
124004 (2016). transactions on electron devices 41, 2069 (1994).
[24] P. Pietzonka, A. C. Barato, and U. Seifert, Physical [45] L. Van Brandt, F. Silveira, J.-C. Delvenne, and D. Flan-
Review E 93, 052145 (2016). dre, Solid-State Electronics 208, 108715 (2023).
[25] M. Polettini, A. Lazarescu, and M. Esposito, Physical [46] A. Dechant, arXiv preprint arXiv:2306.00417 (2023).
Review E 94, 052104 (2016). [47] A. Dechant, J. Garnier-Brun, and S.-i. Sasa, Physical
[26] J. M. Horowitz and T. R. Gingrich, Physical Review E Review Letters 131, 167101 (2023).
96, 020103 (2017). [48] N. Ohga, S. Ito, and A. Kolchinsky, Physical Review
[27] K. Proesmans and C. Van den Broeck, Europhysics Let- Letters 131, 077101 (2023).
ters 119, 20001 (2017). [49] T. Van Vu, V. T. Vo, and K. Saito, arXiv preprint
arXiv:2305.18000 (2023).