Stochastic Models I (for first-year doctoral students)

Attribution Non-Commercial (BY-NC)

6 views

Stochastic Models I (for first-year doctoral students)

Attribution Non-Commercial (BY-NC)

- 11 Mathematics Ncert Ch02 Relations and Functions Misc Sol
- UT Dallas Syllabus for cs3341.501 05f taught by Pankaj Choudhary (pkc022000)
- Stat Anal Published v1.1, 1-28-09
- 024173762
- Ex_2_10_FSC_part2
- C4_January_2006_Mark_Scheme
- SSRN-id1704415
- bertoin
- Chapter 01 Probability L1 2015
- Ackermann
- Lecture Random Processes
- Documento de Trabajo 20 2012
- 673642
- Function-2.docx
- Tugas elhing
- Analysis of the Dynamic Traveling Salesman Problem with Different Policies
- hmmrevisited-110329122929-phpapp02
- Stochastic Analysis of a Cold Standby System with Server Failure
- 20. a Node Distribution of the Random Waypoint
- Discrete Dist.

You are on page 1of 3

Justify your answers; show your work. 1. Selling Flour: The Grainery. (30 points) The Grainery is a store that sells our to bakers. Suppose that bakers come to the Grainery according to a Poisson process with a rate of per week. Suppose that each baker asks to buy a random amount of our, which is distributed according to a random variable X having cumulative distribution function (cdf) G with density g and a mean of m pounds. Let the successive quantities requested by the bakers be independent and identically distributed, independent of the arrival process. The store uses an (s, S ) inventory policy: Whenever the stores inventory level of our drops below s pounds, the store immediately places an order from a centralized warehouse to bring its inventory level up to S pounds, where S > s. Assume that the delivery time from the warehouse to the Grainery is negligible; i.e., assume that these orders are delivered to the Grainery immediately after the last baker whose request takes the inventory level below s leaves. (The baker whose request takes the inventory level below s cannot receive any of the new order. That baker receives only part of his request if his request exceeds the current supply. This is the case of lost sales; i.e., there is no commitment to ll the rest of the order later. After that baker leaves, the new inventory is S .) (a) Give an expression for the long-run rate that the Grainery places orders to replace its stock of our. Indicate how the numerical value can be obtained. (b) Let X (t) be the inventory of our at the Grainery at time t. Explain why the limit of P (X (t) x) as t exists and give an expression for that limit. (c) How does the answer in part (b) simplify when the cdf G is exponential? (d) Is the cumulative distribution function of the limiting inventory level in part (c) continuous? Explain. (e) How does the answer (b) simplify when the mean m becomes relatively small compared to S s? (To make this precise, suppose that the mean-m random variable X X (m) introduced above is constructed from a mean-1 random variable Z by letting X (m) = mZ . Then let m 0.) 2. Random Clockwise Walk Around the Circle. (30 points) Consider a random walk on the circle, where each step is a clockwise random motion. At each step, the angle is at one of the values k/2, 0 k 3. That is, there is a sequence of independent clockwise motions on the circle among the four angles k/2, 0 k 3. Let transitions take place at positive integer times. In each step, the walk moves in a clockwise motion j/2 with probability (j + 1)/10 for 0 j 3. Henceforth, let state k represent k/2, then we have the following transition matrix for transitions among the four states 0, 1, 2 and 3: 0.1 0.2 0.3 0.4 0 1 0.4 0.1 0.2 0.3 . P = 0.3 0.4 0.1 0.2 2 0.2 0.3 0.4 0.1 3

(a) Show that there exists a distance (metric) d on the space of probability vectors of length 4 and a constant c with 0 < c < 1 such that, for any two probability vectors u (u1 , u2 , u3 , u4 ) and v (v1 , v2 , v3 , v4 ), d(uP, vP ) cd(u, v ) . (b) Find the smallest such constant c in part (a), such that the inequality is valid for all u and v , and prove that it is smallest. (c) Use part (a) to show that there exists a unique stationary probability vector for P , i.e., a probability vector (1 , 2 , 3 , 4 ) satisfying = P. (d) Use part (a) to show that d(uP n , ) Kcn , n 1,

where c and K are constants, independent of u, and identify the best possible constant K (the smallest constant that is valid for all u). (e) Find the stationary probability vector . 3. Customers at an ATM. (40 points) Suppose that customers arrive at a single automatic teller machine (ATM) according to a Poisson process with rate per minute. Customers use the ATM one at a time. There is unlimited waiting space. Assume that all potential customers join the queue and wait their turn. (There is no customer abandonment.) Let the successive service times at the ATM be mutually independent, and independent of the arrival process, with a cumulative distribution function G having density g and mean 1/. Let Q(t) be the number of customers at the ATM at time t, including the one in service, if any. (a) Prove that Q(t) as t with probability 1 if / > 1. (b) Is the stochastic process {Q(t) : t 0} a Markov process? Explain. (c) Identify random times Tn , n 1, such that the stochastic process {Xn : n 1} is an irreducible innite-state discrete-time Markov chain (DTMC), when Xn = Q(Tn ) for n 1. (d) Find conditions under which the state Xn at time n of the DTMC {Xn : n 1} in part (c) converges in distribution to a proper steady-state limit as n , and determine that limiting steady-state distribution. (e) In the setting of part (d), what is the steady-state probability that the system is empty (at these embedded random times)? (f) How does the steady-state distribution determined in part (d) simplify when the servicetime cdf is G(x) = 1 ex , x 0 ? (g) Find

n

lim P (Xn = j )

(h) What is the heavy-trac approximation for the steady-state distribution found in part (d)? (i) State and prove a limit theorem justifying the approximation in part (h).

- 11 Mathematics Ncert Ch02 Relations and Functions Misc SolUploaded byUnnati Aggarwal
- UT Dallas Syllabus for cs3341.501 05f taught by Pankaj Choudhary (pkc022000)Uploaded byUT Dallas Provost's Technology Group
- Stat Anal Published v1.1, 1-28-09Uploaded byJerry Lobdill
- 024173762Uploaded byh_tanquoc
- Ex_2_10_FSC_part2Uploaded byFakhar Abbas
- C4_January_2006_Mark_SchemeUploaded byMihir Patel
- SSRN-id1704415Uploaded byKhalid Manzoor
- bertoinUploaded by_azra_
- Chapter 01 Probability L1 2015Uploaded byHairi Yusri
- AckermannUploaded byAnonymous NWZv6WhZ
- Lecture Random ProcessesUploaded byYongfu Wind
- Documento de Trabajo 20 2012Uploaded byalbi_12291214
- 673642Uploaded byRobertBellarmine
- Function-2.docxUploaded byB M
- Tugas elhingUploaded byHarry Galung
- Analysis of the Dynamic Traveling Salesman Problem with Different PoliciesUploaded byAgostina Cortez
- hmmrevisited-110329122929-phpapp02Uploaded byJames Johnson
- Stochastic Analysis of a Cold Standby System with Server FailureUploaded byinventionjournals
- 20. a Node Distribution of the Random WaypointUploaded byHarsh
- Discrete Dist.Uploaded byHazel Daryl Celis
- Multi-state System Reliability Analysis and Optimization for Engineers and Industrial Managers(UGF-Universal Generating Function Method)Uploaded byJay Archer
- DynamicsUploaded byManauwar Ansari
- Plugin Science 24Uploaded byAsk Bulls Bear
- Hidden Markov Models 2005Uploaded byRichardMoreno
- s to Chas Tic AnalysisUploaded byLeandro Fosque
- Examples of Variational Inference With Gaussian-Gamma DistributionUploaded byJun Wang
- Notation in Probability and Statistics - WikipediaUploaded byM Hussain Raza Birmani
- Markov ProcessUploaded bySharmaineMiranda
- Lecture 02Uploaded bymalik786
- Distribución fischerUploaded byEdEsQ

- midtermTwoF07solsUploaded bySongya Pan
- midtermTwo6711F12solsUploaded bySongya Pan
- Midterm Two 6711 f 12Uploaded bySongya Pan
- midtermTwo6711F10solsUploaded bySongya Pan
- Midterm Two 6711 f 10Uploaded bySongya Pan
- midtermOne6711F12solsUploaded bySongya Pan
- Midterm One 6711 f 12Uploaded bySongya Pan
- midtermOne6711F10solsUploaded bySongya Pan
- Midterm One 6711 f 10Uploaded bytabrupt
- midtermOne6711F08solsUploaded bySongya Pan
- Midterm One 6711 f 08Uploaded bySongya Pan
- Lect 0910Uploaded bySongya Pan
- Lect 0905Uploaded bySongya Pan
- Lect 0903Uploaded bySongya Pan
- homewkLTUploaded bySongya Pan
- homewk13SolsUploaded bySongya Pan
- homewk13Uploaded bySongya Pan
- homewk12SolsUploaded bySongya Pan
- homewk12Uploaded bySongya Pan
- homewk11SolsUploaded bySongya Pan
- homewk11Uploaded bySongya Pan
- homewk10SolsUploaded bySongya Pan
- homewk10Uploaded bySongya Pan
- homewk9SolsUploaded bySongya Pan
- homewk9Uploaded bySongya Pan
- homewk8SolsUploaded bySongya Pan
- homewk8Uploaded bySongya Pan
- homewk7SolsUploaded bySongya Pan
- homewk7Uploaded bySongya Pan

- WHO_CG_annex_1Uploaded byDaychi
- Audi 80 ElectronicUploaded byFane Orbeanu
- Industrial Analog ControllersUploaded byAhmed Nahrawy
- PGMonthly 2000 02 24Uploaded bygutenberg
- GLASS pptUploaded bypriyanka
- SCF Rules & RegulationsUploaded byapi-3791717
- MME20110200005_90260471Uploaded byiescobarz
- San Diego v. Roe, 543 U.S. 77 (2004)Uploaded byScribd Government Docs
- Case Study GuideUploaded byThe Cropper Foundation
- Alligation or MixtureUploaded bynavya
- Altair Hyper Works Hypermesh 8.0 Tutorial MeshingUploaded bynguyendando
- The role of the rigged Hilbert Space in Quantum Mechanics - Rafael de la Madrid.pdfUploaded byMihalis Nikolaou
- Disaster Mgt. Handbook Bengal Govt.Uploaded byAbhijeet Gandage
- Chuck ManualUploaded bycamilo527
- M-pestleUploaded byAshfaque Khan
- c 04154343Uploaded bywtyuifd
- Mass 12 Training-planUploaded byVan Bivens
- STbook17JUploaded bySamuel Kins
- Industrial Odor ControlUploaded byQuamie Mortley
- ggbsUploaded byபுருஷோத்தமன் சரவணன்
- Chap 002Uploaded byDennis Higgins
- ECG LectureUploaded byDeepankar Srigyan
- No. 14 & 16 Drainage Projects, Dredging, Excavation, Land ReclamationUploaded byCo Kho Martin
- b Stg Agent Guide LinuxUploaded byBaki-Nadu Judit
- AgUploaded byAntony Neciosup
- aeaugsept2011webversionUploaded bynelson.rodriguezm6142
- External Metric Thread Table ChartUploaded byVarun Kumar
- Scope of Human Resource Development & Personnel ManagementUploaded bydeyutpal211
- Thesis.pdfUploaded byArchie Harmon
- Ginkgo Biloba in the Treatment of TinnitusUploaded byfahmi rosyadi

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.