|
|
Main menu for Browse IS/STAG
Course info
KMI / TIKO
:
Course description
Department/Unit / Abbreviation
|
KMI
/
TIKO
|
Academic Year
|
2024/2025
|
Academic Year
|
2024/2025
|
Title
|
Information Theory and Coding
|
Form of course completion
|
Exam
|
Form of course completion
|
Exam
|
Accredited / Credits
|
Yes,
5
Cred.
|
Type of completion
|
Combined
|
Type of completion
|
Combined
|
Time requirements
|
Přednáška
2
[Hours/Week]
Exercise
1
[Hours/Week]
|
Course credit prior to examination
|
Yes
|
Course credit prior to examination
|
Yes
|
Automatic acceptance of credit before examination
|
No
|
Included in study average
|
YES
|
Language of instruction
|
Czech, English
|
Occ/max
|
|
|
|
Automatic acceptance of credit before examination
|
No
|
Summer semester
|
0 / -
|
0 / -
|
0 / -
|
Included in study average
|
YES
|
Winter semester
|
0 / -
|
0 / -
|
0 / 10
|
Repeated registration
|
NO
|
Repeated registration
|
NO
|
Timetable
|
Yes
|
Semester taught
|
Winter semester
|
Semester taught
|
Winter semester
|
Minimum (B + C) students
|
not determined
|
Optional course |
Yes
|
Optional course
|
Yes
|
Language of instruction
|
Czech, English
|
Internship duration
|
0
|
No. of hours of on-premise lessons |
|
Evaluation scale |
A|B|C|D|E|F |
Periodicity |
každý rok
|
Evaluation scale for credit before examination |
S|N |
Periodicita upřesnění |
|
Fundamental theoretical course |
No
|
Fundamental course |
No
|
Fundamental theoretical course |
No
|
Evaluation scale |
A|B|C|D|E|F |
Evaluation scale for credit before examination |
S|N |
Substituted course
|
None
|
Preclusive courses
|
N/A
|
Prerequisite courses
|
N/A
|
Informally recommended courses
|
N/A
|
Courses depending on this Course
|
N/A
|
Histogram of students' grades over the years:
Graphic PNG
,
XLS
|
Course objectives:
|
The students become familiar with basic concepts of information theory and coding.
|
Requirements on student
|
Active participation in class. Completion of assigned homeworks. Passing the oral (or written) exam.
|
Content
|
The course provides introduction to information theory and its applications, and coding.
" Entropy, conditional and joint entropy, mutual information.
" Basic inequalities of information theory.
" AEP (asymptotic equipartition property) and its applications.
" Selected applications of information theory.
" Basic concepts of coding.
" Optimal codes.
" Error correcting codes (basic concepts, block codes, linear codes).
|
Activities
|
|
Fields of study
|
|
Guarantors and lecturers
|
-
Guarantors:
doc. RNDr. Jan Konečný, Ph.D. ,
-
Lecturer:
prof. RNDr. Radim Bělohlávek, Ph.D., DSc. (100%),
doc. RNDr. Jan Konečný, Ph.D. (100%),
-
Tutorial lecturer:
prof. RNDr. Radim Bělohlávek, Ph.D., DSc. (100%),
Mgr. Eliška Foltasová (100%),
doc. RNDr. Jan Konečný, Ph.D. (100%),
|
Literature
|
-
Basic:
Cover T. M. Elements of Information Theory. J. Wiley, 2006. ISBN 0471241954.
-
Basic:
Adámek J. Foundations of Coding. Wiley-Interscience, 1991. ISBN 0471621874.
-
Basic:
West, R. L., Turner, L. H. (2017). Introducing Communication Theory. McGraw-Hill.
-
Basic:
Adámek J. Kódování. SNTL Praha, 1989.
-
Recommended:
Yeung, R. W. A First Course in Information Theory. Springer, New York, USA, 2002.
-
Recommended:
Ash R. Information Theory. Dover, New York, 1965. ISBN 0-486-66521.
-
On-line library catalogues
|
Prerequisites - other information about course preconditions |
- |
Competences acquired |
2. Comprehension: Classify basic types of error-correcting codes. |
Teaching methods |
|
Assessment methods |
|
|
|
|