The Science of Digital Media

by Jennifer Burg

• A Primer of Digital Media by Yue-Ling Wong (introductory level)
• The Art of Digital Media by Yue-Ling Wong (for art students)
• The Science of Digital Media by Jennifer Burg (for computer science and other science/math students)

The Science of Digital Media, Chapters and Learning Supplements

• Preface
• Chapter 1. Digital Data Representation and Communication
  • Chapter 1. Digital Data Representation and Communication (text)
  • Modeling Sound as a Waveform
    • Worksheet
  • Modeling Images as Waveforms
    • Worksheet
  • Visualizing Waveforms in MATLAB
    • Interactive tutorial
  
  
• Chapter 2. Digital Image Representation
  • Chapter 2. Digital Image Representation (text)
  • Discrete Cosine Transform
    • Programming worksheet
    • Interactive tutorial
    • Worksheet
    • Mathematical Modeling (worksheet)
  • Aliasing
    • Interactive tutorial
    • Worksheet
  • Aliasing in Rendering
    • Interactive tutorial
    • Worksheet
    • Programming worksheet
  • Color Models
    • Converting Between Color Models (programming worksheet)
    • The CIE Chromaticity Diagram (programming worksheet)
    • The the XYZ Color Model and the CIE Chromaticity Diagram (mathematical modeling)
  • Curves and Vector Graphics
    • Interactive tutorial
    • Worksheet
    • Drawing Bezier Curves (hands-on exercise)
  • Algorithmic Art
    • Algorithmic Spirals (interactive tutorial)
    • Koch Snowflakes (programming worksheet)
    • Mandelbrot and Julia Fractals (interactive tutorial)
    • Mandelbrot and Julia Fractals (programming worksheet)
  • More Practice and Creative Discovery
    • Pixel Dimensions, Resolution, and Image Size (worksheet)


• Chapter 3. Digital Image Processing
  • Chapter 3. Digital Image Processing (text)
  • LZW Compression
    • Interactive tutorial
    • Worksheet
    • Programming worksheet
  • Huffman Encoding
    • Interactive tutorial
    • Worksheet
    • Programming worksheet
  • JPEG Compression
    • Interactive tutorial
    • Worksheet
  • Indexed Color
    • Interactive tutorial
    • Worksheet
    • The Octree Algorithm for Indexed Color (programming worksheet)
  • Dithering
    • Interactive tutorial
    • Worksheet
    • Programming worksheet
  • Blending Modes
    • Programming worksheet
  • Histograms
    • Interactive tutorial
    • Worksheet
  • Curves for Color Adjustment
    • Interactive tutorial
    • Worksheet
  • Convolution
    • Interactive tutorial
    • Worksheet
  • Interpolation for Resampling
    • Worksheet


• Chapter 4. Digital Audio Representation
  • Chapter 4. Digital Audio Representation (text)
  • Audio Aliasing
    • Interactive tutorial
    • Worksheet
    • Mathematical Modeling (worksheet)
  • Audio Dithering
    • Interactive tutorial
    • Mathematical Modeling (worksheet)
  • Noise Shaping
    • Mathematical Modeling (worksheet)
  • Non-Linear Companding and mu-Law Encoding
    • Interactive tutorial
    • Mathematical Modeling (worksheet)
    • Implementing mu-Law Encoding (programming worksheet)
  • Fourier Transform
    • Introduction to the Fourier Transform (interactive tutorial)
    • Introduction to the Fourier transform (worksheet)
    • Implementing the Fourier transform (programming worksheet)
    • Comparison of DFT and DCT (interactive tutorial)
    • Comparison of DFT and DCT (worksheet)
    • Windowing Functions for the Fourier Transform (interactive tutorial)
    • FFT and Spectral Leakage (worksheet)
    • Fourier Transform and Windowing Functions (mathematical modeling)
  • RMS
    • Mathematical Modeling (worksheet)
  • MIDI
    • Working with MIDI (to appear)
    • Capturing and Interpreting MIDI Signals
  • More Practice and Creative Discovery
    
    • Working with Digital Audio (hands-on exercise)


• Chapter 5. Digital Audio Processing
  • Chapter 5 Digital Audio Processing (text)
  • Dynamics Processing
    • Interactive tutorial
    • Worksheet
  • Filters
    • Creating Your Own FIR Filter with the Windowing Method (mathematical modeling)
    • Z-Transforms, Zero-Pole Diagrams, and Filters (interactive tutorial -- UNDER CONSTRUCTION)
      
    • Creating FIR and IIR Filters with MATLAB's toolbox (mathematical modeling)
    • Creating a Filter Via a Transfer Function (mathematical modeling)


• Chapter 6. Digital Video Representation and Communication
  • Chapter 6 Digital Video Representation and Communication (text)
  • Amplitude Modulation
    • Mathematical Modeling (worksheet)


• Chapter 7. Digital Video Processing
  • Chapter 7 Digital Video Processing (text)
    
  • Chroma Keying
    • Programming Exercise (worksheet)
• Chapter 8. Multimedia Authoring
  • Chapter 8 Multimedia Authoring (text)
  • Comparison of Multimedia Languages
    • Programming Exercise (worksheet)




NOTE: You need the Shockwave plug-in in your web browser to view the interactive tutorials. Mac users need to turn on Rosetta in Safari to enable Shockwave.




This material is based on work supported by the National Science Foundation under Grants No. DUE-0340969 and DUE-0127280. (PI: Yue-Ling Wong; Co-PI: Jennifer Burg)