CS395/495(26)  Image Based Modeling and Rendering
Northwestern University


Class Meetings: Tues/Thurs 4:30-6:00pm 
                             Room 342, 1890 Maple Avenue
   
                 Part 1: 3:30-4:10 
                        (10 min break) 
                     Part 2: 4:20-4:00 (?Help Sessions on some Thursdays?)

Textbook:  Handouts + 
 Multiple View Geometry  in Computer Vision
Richard Hartley and Andrew Zisserman, Cambridge University Press (c)2000.

TA: Abhinav Dayal abhinav@cs.northwestern.edu  http://www.cs.northwestern.edu/~abhinav/info.html 
Office: 2nd Floor, 1890 Maple Ave.
TA  Office Hours for IBMR:
            Wed: 3:00 to 4:00 PM
   
         Fri: 3:00 to 4:00 PM

Instructor: Jack Tumblin
Office: jet@cs.northwestern.edu;   http://www.cs.northwestern.edu/~jet/
            (847) 467-3500 (e-mail is usually faster)
            Rm 350 CS Dept. Northwestern University
            1890 Maple Avenue 3rd Floor
LookLab: Rm 227 (no phone). 

Class Newsgroup:   c95.ibmr (click here)  Share questions and advice.

--I recommend doing assigned readings BEFORE attending class.  
    You'll have better questions (strongly encouraged) and you're less likely to fall behind. 
--Please don't skip class to work on your project: 
    instead, come to class and ask/learn how to do the hard parts. It's far more efficient.

Helpful Online Reading Materials: 
Essential OpenGL:
   The OpenGL Programming Guide
3rd Edition: The Official Guide to Learning OpenGL, Version 1.2 (e.g. "The Red Book")  Mason Woo, OpenGL Architecture Review Board, Jackie Neider, Tom Davis, Dave Shreiner ISBN 0201604582paperback.  

Also consider OpenGL Reference Manual, 3rd Edition

Web searches offer endless online introductions, help and tutorials, including:
--Official Site:  www.opengl.org  news, books, tutorials, standards & revisions 
--Other Books: http://www.opengl.org/developers/documentation/books.html 
--OpenGL Overview: http://www.opengl.org/developers/about/overview.html  
--Code Help: www.codeguru.com/opengl/index.shtml 

Multiview Geometry Tutorials, Related Courses:
http://black1.csl.uiuc.edu/~yima/ECE497.html
http://www.cs.unc.edu/~marc/tutorial/index.html
http://www.cc.gatech.edu/classes/AY2003/cs8803d_fall/index.html
 

Important Conferences and Journals:
CVPR2003 June... (driving distance!) Several Students are going...
SIGGRAPH 2003 July...

Grading:    Several Programming Projects, sporadic written homework  
                  1 Take-Home Midterm Exam.
                  1 Take-Home Final Exam.
Project and Homework ====>>> Turn-in Instructions: click here  <<<====

Assignments:

Filename Prefix Topic Assign Date Due Date Weight
pA<your last name> Projective P2 Warps in 3D  Thu April 10 Thu April 24 (delayed)   10%
pB<your last name> Interactive P2 Rectifications  Thu April 24 Thu May 1 15%
Mid<your last name> Take-Home Midterm Exam  Solution  Thu May 1 Thu May 8 15%
pC<your last name> Light Probe as Panoramic Camera  Thu May 8 Thu May  15 15%
pD<your last name> Textured, Inflated Silhouette Fans  Thu May19 Fri May 30 25%
Fin<your last name> Take-Home Final Exam

Final Exam Solution.pdf

 Thu June 5  Thu June 12 3:30pm 20% 

Schedule:

Week Date Topic Reading Lecture Notes
1 Tue April 1

Thurs April  3

Admin details, Introduction

2D Projective Geometry

--- IBMRlecture01.ppt

IBMRlecture02.ppt

2 Tue April  8

Thu April 10
ProjA Assign

2D Projective Geometry: transformations,  ideal points, the enclosing line at infinity Chapter 1 
Sections 1.0--1.6
(Stephen Wolfram)

IBMRlecture03.ppt

3

Tue April 15:

April 17
ProjA Due 

2D Projective Geometry: conics and angular measures. SVD Review and uses. Chapter 1 
Sections 1.7--end of chapter.

SVD Handout

IBMRlecture04.ppt

IBMRlecture05.ppt

4 Tue April 22

Thu April 24
ProjB Assign

2D Projective Geometry:
4+ point correspondence, DLT. Estimation: find H from many error-prone points. 
Chapter 3.1-3.2

Finish Chapter 3.

IBMRlecture06.ppt

IBMRlecture07.ppt

5 Tue Apr 29

Thu May 1
Proj B Due
MidTerm Assign

3D Projective Geometry: 
P3 points, planes, lines and conics.

Chapter 2

IBMRlecture08.ppt 

review.txt 

IBMRlecture09.ppt

6 Tue May 6

Thu May 8
MidTerm Due
ProjC Assign

Warps, Panoramas, and Light Probes

Cameras Matrix P

Chapter 5
IBMRlecture10,ppt

IBMRlecture11.ppt

7 Tue May 13

Thu May 15
ProjC Due
ProjD Assign
Where am I? Camera Calibration: define, find the intrinsic and extrinsic params. of the P matrix. Chapter 6.1,6.2,

Chapter 7

IBMRlecture12.ppt

IBMRlecture13.ppt

8 Tue May 20

Thu May 22

Epipolar Geometry: 
  3D reconstruction, How to Blunt the Correspondence Problem; 
Structured light/dark, silhouettes, etc.

IBMR Palliatives: Background Subtraction, Silhouette fans, Visual Hulls, Voxel Carving, Point Clouds, User Interaction
Chapter 8.0-8.4
Chapter 9

"3D Capture on Your Desktop", Bouget, ICCV98

IBMRlecture14.ppt

IBMRlecture15.ppt

9 Tue May 27


Thu May 29
 ProjD Due tomorrow
Physics: Light and Materials Measurement: color, irradiance, radiance, BRDF, misc. invariants.

Camera, Display, & Surface abilities,  high-contrast problems, Helmholtz Reciprocity, Scattering. Perception & Loopholes for Shape

"Light Field Rendering" Levoy, Hanrahan SIG94

"View Morphing", Seitz, Dyer SIGGRAPH'95;

"Polyhedral Visual Hulls for Real Time Rendering" Matusik et al., EGRW01

"Recovering High Dynamic Range Radiance Maps from Photographs" Debevec,Malik SIGG97

IBMRlecture16.ppt

IBMRlecture17.ppt

10 (last class week)
 Tue June 3

Thu June 5
Take-Home Exam:
June 5 Assign

Image-Only IBMR:
2D:  Morphs & deep pixels
2.5D: Depth textures, Impostors 
3D: Fans, concentric mosaics...
4D: Light fields, Illum Fields... 
5D+: surface light fields, 

Hybrids and IBMR Completeness:
Light, Shape & Surface tradeoffs
  Conclusions and Future Work

Papers:
"Image Metamorphosis" Beier, NeelySIGG'92 (html-no pictures)


"Polynomial Texture Maps" Malzbender, SIGGRAPH 2001

IBMRlecture18.ppt

IBMRlecture19.ppt

11 Exam Week
 
Final Exam Due
Thu. June 12
Take-Home Exam 
due Thu June 12 3:30pm
k

Last Updated: 10/13/2003  For Jack