Information Package / Course Catalogue
Information Theory & Coding
Course Code: EEE537
Course Type: Area Elective
Couse Group: Second Cycle (Master's Degree)
Education Language: Turkish
Work Placement: N/A
Theory: 3
Prt.: 0
Credit: 3
Lab: 0
ECTS: 8
Objectives of the Course

The goal of this course is to introduce the main concepts of information theory and to present the theory and applications of source and channel coding to the students.

Course Content

Joint entropy, conditional entropy, mutual information, limits on source and channel coding, encoding and decoding of linear block codes, convolutional codes and maximum likelihood decoding, trellis coded modulation.

Name of Lecturer(s)
Lec. Mümtaz YILMAZ
Learning Outcomes
1.To be able to determine entropy and mutual information
2.To acquire knowledge about source and channel coding theorems
3.To be able to apply linear block encoding and decoding methods
4.To gain insight about convolutional codes and maximum likelihood decoding
5.To be able to design trellis coded modulation schemes
Recommended or Required Reading
1.T. M. Cover and J. A. Thomas, Elements of Information Theory,
2.Lin, S. ve Costello, D.J., Error Control Coding, Fundamentals and Applications, Prentice-Hall.
3.S. B. Wicker., Error control systems for digital communication and storage, Prentice-Hall.
Weekly Detailed Course Contents
Week 1 - Theoretical
Information measure, entropy
Week 2 - Theoretical
Joint entropy, conditional entropy, mutual information
Week 3 - Theoretical
Introduction to data compression and source coding
Week 4 - Theoretical
Huffman coding, Lempel-Ziv algorithm
Week 5 - Theoretical
Channel Capacity, Gaussian Channel, Shannon’s channel coding theorem
Week 6 - Theoretical
Linear Block Codes: Encoders
Week 7 - Theoretical
Linear Block Codes: Decoders
Week 8 - Theoretical
Reed-Muller codes
Week 9 - Theoretical
BCH and Reed-Solomon codes.
Week 10 - Theoretical
Decoding BCH and Reed-Solomon codes
Week 11 - Theoretical
Convolutional Codes, generator polynomials, state and trellis diagrams
Week 12 - Theoretical
Maximum likelihood decoding of convolutional codes, Viterbi algorithm
Week 13 - Theoretical
Trellis Coded Modulation
Week 14 - Theoretical
Project Presentations
Assessment Methods and Criteria
Type of AssessmentCountPercent
Final Examination1%70
Assignment4%15
Project2%15
Workload Calculation
ActivitiesCountPreparationTimeTotal Work Load (hours)
Lecture - Theory143384
Assignment45020
Project220040
Individual Work143042
Final Examination112214
TOTAL WORKLOAD (hours)200
Contribution of Learning Outcomes to Programme Outcomes
PÇ-1
PÇ-2
PÇ-3
PÇ-4
PÇ-5
PÇ-6
PÇ-7
OÇ-1
5
4
4
5
3
3
4
OÇ-2
4
5
4
4
3
3
3
OÇ-3
5
4
5
5
3
3
4
OÇ-4
4
5
4
4
3
3
4
OÇ-5
5
4
5
5
3
3
4
Adnan Menderes University - Information Package / Course Catalogue
2026