Information Package / Course Catalogue
Stochastic Processes
Course Code: EK453
Course Type: Area Elective
Couse Group: First Cycle (Bachelor's Degree)
Education Language: Turkish
Work Placement: N/A
Theory: 3
Prt.: 0
Credit: 3
Lab: 0
ECTS: 5
Objectives of the Course

To give information about basic concept of stochastic processes, concept of random processes, stationary, independences, first order, second order stationary process. To introduce Markov processes, counting processes, renewal processes, Brownian motion with specific examples.

Course Content

Introduction to stochastic processes, Stationary, Independence, First order stationary process, Second order stationary process, Classifications of the stochastic processes, Purely random process, Markov process, Markov chain: discrete parameters, Transition probabilities, Recurrent and non-recurrent states and classes, Chapman-Kolmogorov equation, Mean absorption, first passage, and recurrence times, Limit theorems for occupation times, Limit theorems for transition probabilities, Markov chain: continuous parameters, Transition probabilities and intensities, Kolmogorov differential equations, Limit theorems for transition probabilities, Birth-death processes, Counting processes, Poisson processes, Non-homogeneous, compound Poisson processes Renewal processes, Examples of renewal processes, The renewal equation, The mean function of renewal processes, Brownian Motion, Introduction to Brownian Motion, Examples for Brownian Motion

Name of Lecturer(s)
Learning Outcomes
1.The students learn concept of stochastic process, stationary, independency
2.The students learn the classifications of the stochastic processes
3.The students comprehend the discrete and continuous parameters Markov chains
4.The students obtain information about Counting and Renewal processes
5.To be able to handle derivative and partial derivative equations of stochastic models
Recommended or Required Reading
1.Scott, M., 2012, Applied Stochastic Processes, www.math.uwaterloo.ca/~mscott/Notes.pdf
2.Karlin, S. 1968, A First Course Stochastic Processes, Academic Press, New York.
3.Parzen, E. 1962, Stochastic Processes, Holden Day, San Francisco, CA.
Weekly Detailed Course Contents
Week 1 - Theoretical
1. Introduction to stochastic processes, 1.1 Stationary, 1.2 Independence, 1.3 First order stationary process, 1.4 Second order stationary process
Week 2 - Theoretical
2. Classifications of the stochastic processes, 2.1 Purely random process, 2.2 Markov process
Week 3 - Theoretical
3. Markov chain: discrete parameters , 3.1 Transition probabilities, 3.2 Recurrent and non-recurrent states and classes, 3.3 Chapman-Kolmogorov equation
Week 4 - Practice
Applications
Week 5 - Theoretical
3.4 Mean absorption, first passage, and recurrence times, 3.5 Limit theorems for transition probabilities
Week 6 - Practice
Applications
Week 7 - Practice
Applications
Week 8 - Practice
Applications
Week 9 - Theoretical
4. Markov chain: continuous parameters, 4.1 Transition probabilities and intensities, 4.2 Kolmogorov differential equations, 4.3 Limit theorems for transition probabilities, 4.4 Birth-death processes
Week 10 - Theoretical
5. Counting processes, 5.1 Poisson processes, 5.2 Non-homogeneous, compound Poisson processes
Week 11 - Theoretical
6. Renewal counting processes, 6.1 Examples of renewal processes, 6.2 The renewal equation, 6.3 The mean function of renewal counting processes
Week 12 - Theoretical
7. Brownian Motion, 7.1 Introduction to Brownian Motion, 7.2 Examples of Brownian Motion
Week 13 - Practice
Applications
Week 14 - Practice
Applications
Assessment Methods and Criteria
Type of AssessmentCountPercent
Midterm Examination1%40
Final Examination1%70
Workload Calculation
ActivitiesCountPreparationTimeTotal Work Load (hours)
Lecture - Theory94363
Lecture - Practice64342
Midterm Examination110111
Final Examination110111
TOTAL WORKLOAD (hours)127
Contribution of Learning Outcomes to Programme Outcomes
PÇ-1
PÇ-2
PÇ-3
PÇ-4
PÇ-5
PÇ-6
PÇ-7
PÇ-8
PÇ-9
OÇ-1
4
4
4
4
4
4
4
4
4
OÇ-2
3
3
3
3
3
3
3
3
3
OÇ-3
3
2
5
3
2
5
3
2
2
OÇ-4
2
2
5
2
5
2
5
5
2
OÇ-5
3
3
3
3
3
3
3
3
3
Adnan Menderes University - Information Package / Course Catalogue
2026