| Course title | |||||
| 情報理論 [Information Theory] | |||||
| Course category | technology speciality courses,ets. | Requirement | Credit | 2 | |
| Department | Year | 2～4 | Semester | 1st | |
| Course type | 1st | Course code | 022808 | ||
| Instructor(s) | |||||
| 堀田 政二 [HOTTA Seiji] | |||||
| Facility affiliation | Faculty of Engineering | Office | Email address | ||
| Course description |
|
The purpose of the information theory is to understand the mathematical theory for efficiency and reliable remote communication technologies. Therefore, it is a required subject for students learning the fundamental information theory and its applications. In this lecture, the mathematical definition of information, source coding theorem, communication channels, and channel coding theorem are reviewed mainly with the original prints and textbooks. Also, the basic knowledge in this field also will be introduced. |
| Expected Learning |
|
Learners who complete this course will be able to understand: - the notion of entropy and information, - the fundamental limits of data compression, - the theoretical limits of error correction. Corresponding criteria in the Diploma Policy: See the Curriculum maps (computer and information science, diploma policy type B). |
| Course schedule |
|
1. Introduction & binary code 2. Probability theory (sets, permutation, random variable, Bayes' theorem) 3. Probability distribution (random variable, probability distribution, central limit theorem) 4. Probability process (Markov process, stationary distribution) 5. Definition of information (self-information, entropy, Shannon’s fundamental inequality) 6. Source and channel models 7. Examination 1 8. Mutual information 9. Ttransinformation and channel capacity 10. Basis of source coding (encoding and decoding) 11. Basis of channel coding (error detecting and correction, Shannon's first fundamental theorem) 12. Expanded source coding (block Huffman coding) 13. Parity check (Hamming code, Shannon's 2nd fundamental theorem) 14. Coding theory (linear code, cyclic code) 15. Examination 2 |
| Prerequisites |
| This lecture is part of the courses in the department of computer and information science. In addition to 30 hours that students spend in the class, and they are recommended to spend 60 hours for preparing and revising the lectures. |
| Required Text(s) and Materials |
| Prints are distributed in the lecture. |
| References |
| S. Miki and H. Yoshikawa, "Information theory," 2000, ISBN:978-4-339-01202-6. |
| Assessment/Grading |
| Examination1 (40%) and Examination2 (60%) |
| Message from instructor(s) |
| I want students to develop a deeper understanding of information theory that is the basic technology for digital communications. I would also like to encourage students to learn how to calculate and evaluate the limitation of coding and channel capacity that we consider during the lectures, and to learn how we conduct research. |
| Course keywords |
| Information Theory, entropy, Shannon's first and second fundamental theorem |
| Office hours |
| From 10:00 to 12:00 on Monday. Also, students can contact the chief instructor via e-mail. |
| Remarks 1 |
| Remarks 2 |
| Related URL |
| http://web.tuat.ac.jp/~s-hotta/IT/ |
| Lecture Language |
| Japanese |
| Language Subject |
| Last update |
| 2/28/2019 4:38:40 PM |