Information and coding theory (2016-2017)

Last modification: 28 May 2017 10:00

Informations

  • In the statement of the first TP, exercise 7 is now: Prove that H(X ,Y|Z) = H(X |Z)+ H(Y|X,Z). The previous expression was wrong.
  • In the project 3, be careful that data matrices have been transposed! In order to use your previous codes, you only have to transpose matrices.
  • Do not forget to read and follow the policy for plagiarism (here) otherwise, you expose yourself to measures taken by the ULg against plagiarism (here).
  • New with MatLab? I suggest you to follow this short tutorial to get used to Matlab (here).
  • Follow the guidelines to submit your project. The deadline is the deadline: delays are not acceptable. The mail subject and the name of the archive have to be correct.
  • Bayes Net Toolbox for Matlab (required for all projects): Download, Installation and Documentation.

Agenda

07/02 Theoretical course
Presentation of the practical part of the course
14/02 Theoretical course
Project 0
20/02 Deadline Deadline for project 0
21/02 Theoretical course
Exercise session : Entropy calculus (Statement)
To prepare: Revise lesson 1 and lesson 2.
02/03 Project 1 Statement
07/03 Q&A About project 1
14/03 Q&A About project 1
15/03 Deadline Deadline for project 1
21/03 Project 2
Exercise session : Graphical models (Statement)		 Statement and data
9/04 Deadline Deadline for project 2
18/04 Project 3 Statement and data
9/05 Deadline Deadline for project 3
  • TP3 statement and TP4 statement.

    • Frequently asked questions (F.A.Q.)

    It is strongly recommanded to participate to Q&A sessions and to read the F.A.Q. section before any mail question.
      Project 1
    • Let us assume that you have an array TAB (as generated by generate_samples for example) with 3 variables/columns (var 1 = A, var 2 = B, var 3 = C) and 100 lines/samples, entropy(1,TAB) will give you H(A) and cond_entropy(3,2,TAB) will give you H(C|B) where "var" and "cond" are variable id or simply the number of the column corresponding to the variable.
      Moreover, for question 7 , you could adapt your function to deal with cond_entropy(3,[1,2],TAB) which will return H(C|A,B). You can also "modify" the array "samples" to aggregate several columns into one ([0 1 6] --> '016' for example) and still use the function of question 2.

      • Project 2
    • Be careful, the corresponding number to each variable can be retrieved in the given script part2.m. Using the order in the statement by counting is not correct.
    • Of course, "PRESS" is equivalent to "PRSS".
    • In the statement of project 2, the justification of Q10 is related to Q7 and not Q6.