CS395/495(26)  Image Based Modeling and Rendering

Instructor: Jack Tumblin
Office: jet@cs.northwestern.edu;   http://www.cs.northwestern.edu/~jet/
            (847) 467-2129
            Rm 350 CS Dept (1890 Maple Ave),
LookLab: Rm 227 (no phone yet). 

Class Newsgroup: c95.ibmr (click here)  Share questions and advice.

Textbook:   Multiple View Geometry 
                    in Computer Vision

Richard Hartley and Andrew Zisserman, Cambridge University Press (c)2000.
plus a additional readings available on the Web.

Classes: Tues/Thurs 4:30-6:00pm , with a 10-minute mid-point break.
                    Part 1: 4:30-5:10  (?Help Sessions on some Thursdays?)
                        (10 min break) 
                    Part 2: 5:20-6:00 (Lecture--don't miss it!)

--I recommend doing assigned readings BEFORE attending class.  
    Otherwise you won't have any good questions to ask, which are also strongly encouraged.
--Please don't skip class to work on your project:
    instead, come to class and ask/learn how to do the hard parts. It's far more efficient.

Grading:   5 Self-Contained Programming Projects
                  1 Written Midterm Exam.
                  (I changed my mind: no final exam):

Filename Prefix Topic Due Date Weight
p1<your last name> Image Grid Viewer Tues April 16   5%
p2<your last name> 2D Projective Image Warper Thurs May 9 15%
  Homework 1 Thurs May 16 5%?
p3<your last name> 3D Projective Image Warper   20%
p4<your last name> Monocular Camera Calibrator   20%
p5<your last name> 2-Image Epipolar Geometry Finder   20%

Homework Turn-in Instructions: click here

Schedule:

Week Date Topic Reading Lecture Notes
1 April  4 (Thurs) Admin details, Introduction, Background Review --- IBMRlecture01.ppt
2 April  9,11 2D Homogeneous Coordinates & Transformations,  ideal points, line at infinity Chapter 1 'Projective Transformations of  2-Space' 
Sections 1.0--1.6
IBMRlecture02.ppt
IBMRlecture03.ppt

 

3 April 16,18
Project 1 due 
Tues April 16
2D View Interpolation:, conics and angular measures. SVD review. Chapter 1 'Projective Transformations of  2-Space' 
Sections 1.7--end of chapter.
IBMRlecture04.ppt review.txt
IBMRlecture05.ppt
April 23,25

Project 2 assign

Camera views of points in 3D; height fields and more Chapter 2 'Projective Transformations of 3-Space' IBMRlecture06.ppt
IBMRlecture07.ppt
4 Apr 30,May 2
Homework1 assign
May 7,9
Finding an unknown matrix: Good Estimation & Optimization Methods Finish Chapter 2.

Chapter 3-3.6.  Skim through to the end of Chapter 4.
"Conjugate Gradient Method without the Agonizing Pain", Jonathan Shewchuk

IBMRlecture08.ppt
IBMRlecture09.ppt

IBMRlecture10.ppt
IBMRlecture11.ppt

5 May 7,9

Drop Day: May10

Project 2 due May 9
Camera Views using Computer Vision Jargon Chapter 5 
(Little is new but notation!)
Midterm Review

6 May 14,16
Where am I?  Finding the Camera Matrix from known 3D Points Chapter 6, skim through to the end of Chapter 7 IBMRlecture11.ppt
IBMRlecture12.ppt
7 Merging Multiple Camera Views Chapter 8: Epipolar Geometry and the Fundamental Matrix IBMRlecture13.ppt
IBMRlecture14.ppt
8 May 21,23 Seminal IBMR Papers I *  (2 papers chosen in class) IBMRlecture15.ppt
IBMRlecture16.ppt
9 May 28,30
Seminal IBMR Papers II* (2 papers chosen in class) IBMRlecture17.ppt
IBMRlecture18.ppt
10  June 4,6 
(last class week)

IBMR Research Topics and their precursors (e.g. Nagging Problems)
Project Demos 

(resolution and data-bloat, boundaries, sampling, depth discontinuities, transparency, particles, visual perception & tone mapping) 

No reading : Finish your project,
But come to class!
IBMRlecture19.ppt
11 Exam Week
     

* (a close study of a 2 high-quality journal papers chosen by student consensus
Suggestions:
        -Depth-sorting pixels without depth values: 'Plenoptic Sampling'(McMillan95)
        -Click the Corners, Make a Building: the 'Facade' system (Debevec96)
        -Making Mona Lisa Turn her head: 3D reprojection without depth (Seitz 98)       
        -Your Own Magic Wand: Shape from Shadows (Bouget98)
         -BTFs; why texture maps are not enough(Dana99)
        -Image-based Visual Hulls (2001)
        -Polynomial Texture Maps (Malzbender2001)

 

Useful IBMR Links: (Please contribute to this list) 
                    PLY file reader/writer code, model repositories
                    Freeware 3D model viewer (NAME?)
                    MATLAB basics
                    Any and all SIGGRAPH short courses on IBMR topics
                    Computer Vision Conferences and Journals (ICCV, etc.)
                    Microsoft Computer Vision Library
                     Intel Computer Vision Library
                    Let me know if you find other good tools, tutorials, etc.