Enter your search into one or more of the boxes below:
You can refine your search by selecting from any of the options below:
Markov Models and Optimization

Markov Models and Optimization (Hardback)

Usually despatched within 2 weeks.
Order now for Free delivery in the UK.
More on delivery...


This book presents a radically new approach to problems of evaluating and optimizing the performance of continuous-time stochastic systems. This approach is based on the use of a family of Markov processes called Piecewise-Deterministic Processes (PDPs) as a general class of stochastic system models. A PDP is a Markov process that follows deterministic trajectories between random jumps, the latter occurring either spontaneously, in a Poisson-like fashion, or when the process hits the boundary of its state space. This formulation includes an enormous variety of applied problems in engineering, operations research, management science and economics as special cases; examples include queueing systems, stochastic scheduling, inventory control, resource allocation problems, optimal planning of production or exploitation of renewable or non-renewable resources, insurance analysis, fault detection in process systems, and tracking of maneuvering targets, among many others. The first part of the book shows how these applications lead to the PDP as a system model, and the main properties of PDPs are derived.

There is particular emphasis on the so-called extended generator of the process, which gives a general method for calculating expectations and distributions of system performance functions. The second half of the book is devoted to control theory for PDPs, with a view to controlling PDP models for optimal performance: characterizations are obtained of optimal strategies both for continuously-acting controllers and for control by intervention (impulse control). Throughout the book, modern methods of stochastic analysis are used, but all the necessary theory is developed from scratch and presented in a self-contained way. The book will be useful to engineers and scientists in the application areas as well as to mathematicians interested in applications of stochastic analysis.

Science & MathematicsMathematicsApplied mathematicsStochasticsScience & MathematicsMathematicsProbability & statistics Publisher: Taylor & Francis Ltd Publication Date: 01/08/1993 ISBN-13: 9780412314100  Details: Type: Hardback Format: Books
Availability: Usually despatched within 2 weeks. Login for Quick Checkout Add to Basket

More books by M. H. A. Davis

Leave Review


Delivery Options

All delivery times quoted are the average, and cannot be guaranteed. These should be added to the availability message time, to determine when the goods will arrive. During checkout we will give you a cumulative estimated date for delivery.

Location 1st Book Each additional book Average Delivery Time
UK Standard Delivery FREE FREE 3-5 Days
UK First Class £4.50 £1.00 1-2 Days
UK Courier £7.00 £1.00 1-2 Days
Western Europe** Courier £17.00 £3.00 2-3 Days
Western Europe** Airmail £5.00 £1.50 4-14 Days
USA / Canada Courier £20.00 £3.00 2-4 Days
USA / Canada Airmail £7.00 £3.00 4-14 Days
Rest of World Courier £22.50 £3.00 3-6 Days
Rest of World Airmail £8.00 £3.00 7-21 Days

** Includes Austria, Belgium, Denmark, France, Germany, Greece, Iceland, Irish Republic, Italy, Luxembourg, Netherlands, Portugal, Spain, Sweden and Switzerland.

Delivery Help & FAQs

Returns Information

If you are not completely satisfied with your purchase*, you may return it to us in its original condition with in 30 days of receiving your delivery or collection notification email for a refund. Except for damaged items or delivery issues the cost of return postage is borne by the buyer. Your statutory rights are not affected.

* For Exclusions and terms on damaged or delivery issues see Returns Help & FAQs

You might also like

Quantum Fields and Processes: A...
John Gough; Joachim Kupsch
Stochastic Physics and Climate Modelling
Tim Palmer; Paul Williams
Theory of Stochastic Objects:...
Athanasios Christou Micheas
Probability on Graphs: Random...
Geoffrey Grimmett
Latest Blog
On Memory and Forgetting

David Whitehouse talks to us about memory and forgetting, and how his personal experience influenced his new novel, The Long Forgotten.

The End of the F***ing World creator, Charles Forsman, picks his favourite coming of age books

The End of the F***ing World creator, Charles Forsman, picks his favourite coming of age books.

#FoylesFive: Annihilation

With the release of Annihilation on Netflix it's the perfect time to catch up with the book that starts Jeff VanderMeer's unsettling Southern Reach trilogy.

View all Blog Entries
Show/Hide Tweets
© W&G Foyle Ltd