| Course title | |||||
| 情報理論演習 [Information Theory : Laboratory Exercises] | |||||
| Course category | technology speciality courses,ets. | Requirement | Credit | 1 | |
| Department | Year | 2～4 | Semester | 1st | |
| Course type | 1st | Course code | 022811 | ||
| Instructor(s) | |||||
| 堀田 政二 [HOTTA Seiji] | |||||
| Facility affiliation | Faculty of Engineering | Office | Email address | ||
| Course description |
|
The purpose of this exercise is to understand the information theory more deeply via real-life practices. Therefore, it is a required subject for students training the fundamental information theory and its applications. In this exercises, real-life problems of source coding, communication channels, and channel coding are introduced via practices mainly with the original prints. |
| Expected Learning |
|
Learners who complete this course will be able to solve: - the notion of entropy and information, - the fundamental limits of data compression, - the theoretical limits of error correction. Corresponding criteria in the Diploma Policy: See the Curriculum maps (computer and information science, diploma policy type C). |
| Course schedule |
|
1. Introduction & binary code 2. Probability theory (sets, permutation, random variable, Bayes' theorem) 3. Probability distribution (random variable, probability distribution, central limit theorem) 4. Probability process (Markov process, stationary distribution) 5. Definition of information (self-information, entropy, Shannon’s fundamental inequality) 6. Source and channel models 7. Examination 1 8. Mutual information 9. Ttransinformation and channel capacity 10. Basis of source coding (encoding and decoding) 11. Basis of channel coding (error detecting and correction, Shannon's first fundamental theorem) 12. Expanded source coding (block Huffman coding) 13. Parity check (Hamming code, Shannon's 2nd fundamental theorem) 14. Coding theory (linear code, cyclic code) 15. Examination 2 |
| Prerequisites |
| This exercise is part of the courses in the department of computer and information science. In addition to 30 hours that students spend in the class, and they are recommended to spend 15 hours for preparing and revising the lectures. |
| Required Text(s) and Materials |
| Prints are distributed in the exercise. |
| References |
| Texts use in the lecture ``Information theory''. |
| Assessment/Grading |
| Exercises (50%), Examination1 (20%) and Examination2 (30%) |
| Message from instructor(s) |
| I want students to develop a deeper understanding of information theory that is the basic technology for digital communications. I would also like to encourage students to learn how to calculate and evaluate the limitation of coding and channel capacity that we consider during the lectures, and to learn how we conduct research. |
| Course keywords |
| Information Theory, entropy, Shannon's first and second fundamental theorem |
| Office hours |
| From 10:00 to 12:00 on Monday. Also, students can contact the chief instructor via e-mail. |
| Remarks 1 |
| Remarks 2 |
| Related URL |
| http://web.tuat.ac.jp/~s-hotta/ITE/ |
| Lecture Language |
| Japanese |
| Language Subject |
| Last update |
| 2/27/2019 12:20:20 PM |