CS395/495(26)  Image Based Modeling and Rendering
Northwestern University

Class Meetings: Tues/Thurs 4:30-6:00pm 
                             Room 342, 1890 Maple Avenue
                 Part 1: 3:30-4:10 
                        (10 min break) 
                     Part 2: 4:20-4:00 (?Help Sessions on some Thursdays?)

Textbook:  Handouts + 
 Multiple View Geometry  in Computer Vision
Richard Hartley and Andrew Zisserman, Cambridge University Press (c)2000.

TA: Abhinav Dayal abhinav@cs.northwestern.edu  http://www.cs.northwestern.edu/~abhinav/info.html 
Office: 2nd Floor, 1890 Maple Ave.
TA  Office Hours for IBMR:
            Wed: 3:00 to 4:00 PM
         Fri: 3:00 to 4:00 PM

Instructor: Jack Tumblin
Office: jet@cs.northwestern.edu;   http://www.cs.northwestern.edu/~jet/
            (847) 467-3500 (e-mail is usually faster)
            Rm 350 CS Dept. Northwestern University
            1890 Maple Avenue 3rd Floor
LookLab: Rm 227 (no phone). 

Class Newsgroup:   c95.ibmr (click here)  Share questions and advice.

--I recommend doing assigned readings BEFORE attending class.  
    You'll have better questions (strongly encouraged) and you're less likely to fall behind. 
--Please don't skip class to work on your project: 
    instead, come to class and ask/learn how to do the hard parts. It's far more efficient.

Helpful Online Reading Materials: 
Essential OpenGL:
   The OpenGL Programming Guide
3rd Edition: The Official Guide to Learning OpenGL, Version 1.2 (e.g. "The Red Book")  Mason Woo, OpenGL Architecture Review Board, Jackie Neider, Tom Davis, Dave Shreiner ISBN 0201604582paperback.  

Also consider OpenGL Reference Manual, 3rd Edition

Web searches offer endless online introductions, help and tutorials, including:
--Official Site:  www.opengl.org  news, books, tutorials, standards & revisions 
--Other Books: http://www.opengl.org/developers/documentation/books.html 
--OpenGL Overview: http://www.opengl.org/developers/about/overview.html  
--Code Help: www.codeguru.com/opengl/index.shtml 

Multiview Geometry Tutorials, Related Courses:

Important Conferences and Journals:
CVPR2003 June... (driving distance!) Several Students are going...
SIGGRAPH 2003 July...

Grading:    Several Programming Projects, sporadic written homework  
                  1 Take-Home Midterm Exam.
                  1 Take-Home Final Exam.
Project and Homework ====>>> Turn-in Instructions: click here  <<<====


Filename Prefix Topic Assign Date Due Date Weight
pA<your last name> Projective P2 Warps in 3D  Thu April 10 Thu April 24 (delayed)   10%
pB<your last name> Interactive P2 Rectifications  Thu April 24 Thu May 1 15%
Mid<your last name> Take-Home Midterm Exam  Solution  Thu May 1 Thu May 8 15%
pC<your last name> Light Probe as Panoramic Camera  Thu May 8 Thu May  15 15%
pD<your last name> Textured, Inflated Silhouette Fans  Thu May19 Fri May 30 25%
Fin<your last name> Take-Home Final Exam

Final Exam Solution.pdf

 Thu June 5  Thu June 12 3:30pm 20% 


Week Date Topic Reading Lecture Notes
1 Tue April 1

Thurs April  3

Admin details, Introduction

2D Projective Geometry

--- IBMRlecture01.ppt


2 Tue April  8

Thu April 10
ProjA Assign

2D Projective Geometry: transformations,  ideal points, the enclosing line at infinity Chapter 1 
Sections 1.0--1.6
(Stephen Wolfram)



Tue April 15:

April 17
ProjA Due 

2D Projective Geometry: conics and angular measures. SVD Review and uses. Chapter 1 
Sections 1.7--end of chapter.

SVD Handout



4 Tue April 22

Thu April 24
ProjB Assign

2D Projective Geometry:
4+ point correspondence, DLT. Estimation: find H from many error-prone points. 
Chapter 3.1-3.2

Finish Chapter 3.



5 Tue Apr 29

Thu May 1
Proj B Due
MidTerm Assign

3D Projective Geometry: 
P3 points, planes, lines and conics.

Chapter 2




6 Tue May 6

Thu May 8
MidTerm Due
ProjC Assign

Warps, Panoramas, and Light Probes

Cameras Matrix P

Chapter 5


7 Tue May 13

Thu May 15
ProjC Due
ProjD Assign
Where am I? Camera Calibration: define, find the intrinsic and extrinsic params. of the P matrix. Chapter 6.1,6.2,

Chapter 7



8 Tue May 20

Thu May 22

Epipolar Geometry: 
  3D reconstruction, How to Blunt the Correspondence Problem; 
Structured light/dark, silhouettes, etc.

IBMR Palliatives: Background Subtraction, Silhouette fans, Visual Hulls, Voxel Carving, Point Clouds, User Interaction
Chapter 8.0-8.4
Chapter 9

"3D Capture on Your Desktop", Bouget, ICCV98



9 Tue May 27

Thu May 29
 ProjD Due tomorrow
Physics: Light and Materials Measurement: color, irradiance, radiance, BRDF, misc. invariants.

Camera, Display, & Surface abilities,  high-contrast problems, Helmholtz Reciprocity, Scattering. Perception & Loopholes for Shape

"Light Field Rendering" Levoy, Hanrahan SIG94

"View Morphing", Seitz, Dyer SIGGRAPH'95;

"Polyhedral Visual Hulls for Real Time Rendering" Matusik et al., EGRW01

"Recovering High Dynamic Range Radiance Maps from Photographs" Debevec,Malik SIGG97



10 (last class week)
 Tue June 3

Thu June 5
Take-Home Exam:
June 5 Assign

Image-Only IBMR:
2D:  Morphs & deep pixels
2.5D: Depth textures, Impostors 
3D: Fans, concentric mosaics...
4D: Light fields, Illum Fields... 
5D+: surface light fields, 

Hybrids and IBMR Completeness:
Light, Shape & Surface tradeoffs
  Conclusions and Future Work

"Image Metamorphosis" Beier, NeelySIGG'92 (html-no pictures)

"Polynomial Texture Maps" Malzbender, SIGGRAPH 2001



11 Exam Week
Final Exam Due
Thu. June 12
Take-Home Exam 
due Thu June 12 3:30pm

Last Updated: 10/13/2003  For Jack