CpE 491: Information Systems Engineering II[1]

(Homework 1)

Assigned on: January 29, 2001

Due back on: February 12, 2001àFeb 23, 2001

  1. Consider a binary random variable X = {0, 1}, with probability Pr(0) = p. Compute the entropy of X for a range of values of p [0, 1]. Plot the values with respect to p. Draw your conclusions from it. Use a simple MATLAB or C routine if you want. You can use MATLAB to plot the graph.
  2.  Calculate the entropy for the Sena image (which you can download from ftp://ftp.mkp.com/pub/Sayood/uncompressed_software/datasets/images/)
  3. Use the Huffman code related programs from the same site and design a Huffman code for this image. Use this to compress the image and decode the image and see how it looks. (attach the print outs of the compressed and original images with your answer sheets).

(Hint: Don’t wait until the day before to download your datasets and your software!)



[1] K.P. Subbalakshmi, 208 Burchard building