CS395/495(26)  Image Based Modeling and Rendering

Instructor: Jack Tumblin
Office: jet@cs.northwestern.edu;   http://www.cs.northwestern.edu/~jet/
            (847) 467-2129
            Rm 350 CS Dept (1890 Maple Ave),
LookLab: Rm 227 (no phone yet). 

Class Newsgroup: c95.ibmr (click here)  Share questions and advice.

Textbook:   Multiple View Geometry 
                    in Computer Vision

Richard Hartley and Andrew Zisserman, Cambridge University Press (c)2000.
plus some additional readings available on the Web.

Classes: Tues/Thurs 4:30-6:00pm , with a 10-minute mid-point break.
                    Lecture Part 1: 4:30-5:10  Lecture(?Help Sessions on some Thursdays?)
                        (10 min break) 
                    Lecture Part 2: 5:20-6:00 (Lecture--don't miss it!)

--I recommend doing assigned readings BEFORE attending class.  
    Otherwise you won't have any good questions to ask, which are also strongly encouraged.
--Please don't skip class to work on your project:
    instead, come to class and ask/learn how to do the hard parts. It's far more efficient.

Grading:   5 Self-Contained Programming Projects
                  1 Written Midterm Exam.
                  (I changed my mind: no final exam):

Project and Homework Turn-in Instructions: click here

Projects:

Filename Prefix Topic Assign Date Due Date Weight
p1<your last name> Image Grid Viewer Thu April 4 Tue April 16   4%
p2<your last name> 2D Projective Image Warper Thu April 25 Thu May 9 22%
p3<your last name> Normalized DLT & Sampson Error Thu May 9 Thu May 23 22%
p4<your last name> 3D Panoramic Warps Thu May 25 Tues June 11 22%

Homework:

Filename Prefix Topic Assign Date Due Date Weight
(handwritten only) Homework 1 Thu May 2 Thu May 16 15%
Homework 2 Tue May 21 Thu May 30 15%
  Homework 3 CANCELLED (lets be reasonable!) 0%

 

Schedule:

Week Date Topic Reading Lecture Notes
1 April  4 (Thurs) Admin details, Introduction, Background Review --- IBMRlecture01.doc
2 Tue April  9

Thu April 11

2D Homogeneous Coordinates & Transformations,  ideal points, line at infinity Chapter 1 
Sections 1.0--1.6
IBMRlecture02.doc
IBMRlecture03.doc
3

Tue April 16:
Proj1 due 

April 18

2D View Interpolation:, conics and angular measures. 
SVD review.
Chapter 1 
Sections 1.7--end of chapter.
IBMRlecture04.doc  review.txt
IBMRlecture05.doc
4 Tue April 23

Thu April 25
Proj2 assign

Camera views of points in 3D; height fields and more Chapter 2 'Projective Transformations of 3-Space' IBMRlecture06.ppt
IBMRlecture07.doc
5 Tue Apr 30

Thu May 2
HW1 assign

P3 Conclusions

'Estimation: Finding H from many error-prone points" 

Finish Chapter 2.

Chapter 3.1-3.2.4: DLT and estimation methods

IBMRlecture08.doc
IBMRlecture09.doc
6 Tue May 7

Thu May 9
Drop Day: May10
Proj3 Assigned

Estimation: The 4D 'Correspondence Space'

Sampson Error, DLT normalized, Model Space methods

Chapter 3.2-3.5 IBMRlecture10.doc

IBMRlecture11.doc

7 Tue May 14
Proj2 due(delayed)

Thu May 16
HW1 Due, HW2 Assign
Warps and Panoramas

Light Probes 

Class Notes only
(Try some image warping with your Proj 1 code)  
IBMRlecture12.doc
IBMRlecture13.doc
8 Tue May 21

Thu May 23
Proj3 due,Proj4 assign

Camera Model: Link 2D & 3D
All about the camera matrix P
Chapter 5.0-5.2 IBMRlecture14.doc
IBMRlecture15.doc
9 Tue May 28
HW3 assign (cancelled)

Thu May 30
HW2 Due 

Finding the Camera Matrix 

More One-Camera Geometry

-Finish Chapter 5,
-skim Chapter 6 (it's the same idea as Chapter 3)
Chapter 7
IBMRlecture16.ppt
IBMRlecture17.ppt
10 (last class week)
 Tue June 4

Thu June 6 

Epipolar Geometry, Stereo Reconstruction Chapter 9 IBMRlecture18.ppt
IBMRlecture19.ppt
11
Exam Week
TuesProj4 due, HW3 Due(cancel)
Finish your project & homework