Stochastic processes: an introduction

Some Background on ProbabilityIntroduction Probability Conditional probability and independence Discrete random variables Continuous random variables Mean and variance Some standard discrete probability distributions Some standard continuous probability distributions Generating functions Conditional expectationSome Gambling ProblemsGambler's ruin Probability of ruin Some numerical simulations Duration of the game Some variations of gambler's ruinRandom WalksIntroduction Unrestricted random walks The probability distribution after n steps First returns of the symmetric random walkMarkov ChainsS