CS 7322: Computer Vision II

Schedule

**TENTATIVE**
Official Georgia Tech Calendar for Fall 1997
Meeting Time: 4:35pm - 5:55pm (Monday/Wednesday)
Location: CoC 102

[C2000 Logo] Classroom 2000 Lectures for CS7322 Spring 1998 [C2000 Logo]

 
Week 
Date 
Topic 
  Notes
1  CheckWednesday 
4/1
2 CheckMonday 
4/6
  • Image motion
  • Readings:
    • Read Rosenfeld, Shah & Jain, Cedras and Shah (Handed out 4/1/98)
  • Weekly Assignnment #1
    • Read Rosenfeld Chapter and write a brief overview of what it means to recognize expressions using image motion.
CheckWednesday 
4/8
  • Session in a Computer LAB (SGI Lab)
  • Main directory on CoC Filesystem /net/hi2/cpl/classes/cs7322_98_spring
    • bin/ contains optical flow code
    • dev/ contains development tools for sgi/ and wintel/
    • images/ contains images
    • users/ where you can store your stuff.
3 CheckMonday 
4/13
  • Recognition of Image Motion
  • Assign papers for leading discussions.
  • Readiings
    • Polana, R. and R. Nelson, "Temporal Texture and Activity Recognition", Chapter 5, 1997. (Handed out in class 4/1/98).

      • Discussions Led by:  Irfan Essa 
    • Davis, J. and A. Bobick, "The Representation and Recognition of Action Using Temporal Templates",  In Proceedings of CVPR, 1997. (PS Version)

      • Discussions Led by: Huong Quynh Dinh (NOTES)
CheckWednesday 
4/16
       
  • Discuss Final Projects *CHANGES: Swapped with 4/20*
  • Weekly Assignnment #2: Using methods discussed in Wed 4/8/98's class write a small program to take an image sequence and generate "motion change" and "motion history" images
4  CheckMonday 
4/20
  • People Tracking with Models *CHANGES: Swapped with 4/16*
  • Readings:
    • Rohr, K., "Human Movement Anaylsis Based on Explicit Motion Models", Chapter 8, In Shah, M. and R. Jain (Editors), Motion-based Recognition, Kluwer-Academic Publishers, 1997. (Handed Out 4/13)

      • Discussions Led by:  Tony Haro 
    • Baumberg, A. and D. Hogg, "Learning Deformable Models for Tracking the Human Body", Chapter 3, In Shah, M. and R. Jain (Editors), Motion-based Recognition, Kluwer-Academic Publishers, 1997.(Handed Out 4/13)

      • Discussions Led by:  Alexander Stoytchev 
    • Bregler, C., J.Malik, "Video Motion Capure", Tech Report: UCB//CSD-97-973 (Paper in gziped PS (843KB) or PDF (2.3MB)), 1998.

      • Discussions Led by:  Mike Cramer *MOVED to 5/13*
 Tony Haro's Slides
CheckWednesday 
4/22
  • Motion
  • Readings:
    • Adiv, G., "Determining 3-D Motion and Structure from Optical Flow Generated by Several Moving Objects", In PAMI(7), No. 4, July 1985, pp. 384-401 (Handed Out 4/15/98)
    • Black, M. J. and Anandan, P., "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields", Computer Vision and Image Understanding, CVIU, 63(1), pp. 75-104, Jan. 1996. (abstract) (software) (Handed Out 4/13/98)
    • Wang, J. Y. and E. Adelson, "Representing Moving Images with Layers", In IEEE Trans. on Image Proc. Special Issue: Image Sequence Compression vol 3, no. 5, p. 625-638, September 1994. (PS Version).

      • Discussions Led by: Arno Schoedl
 Arno Schoedl's Slides
5 CheckMonday 
4/27
  • Facial Motions
  • Readings:
    • Essa, I. and A. Pentland. "A Vision System for Observing and Extracting Facial Action Parameters", In Proceedings of IEEE Computer Vision Pattern Recognition Conference 1994, Seattle, WA., June 1994.  (PS [1.1MB]| PDF [.3MB]) 
    • Essa, I. and A. Pentland. "Facial Expression Recognition using a Dynamic Model and Motion Energy", In, Proceedings of the International Conference on Computer Vision 1995, Cambridge, MA., May 1995. (Abstract | PS | PDF)

      • Discussions Led by:  James Mossman 
    • Black, M. J. and Yacoob, Y., Recognizing facial expressions in image sequences using local parameterized models of image motion, Int. Journal of Computer Vision, 25(1), pp. 23-48, 1997. also Xerox PARC, Technical Report SPL-95-020, March 1995. (download from WWW page,  PDF[601k])

      • Discussions Led by:  Drew Steedly
 James Mossman's Slides
CheckWednesday 
4/29
  • Estimation and Detection Methods
  • Final Project Proposal Due.
  • Readings:
    • Chapter 11, "Tutorial: The Kalman Filter" by T. Lacey. In TINA algorithms' guide, by N. Thacker. Electronic Systems Group, U. of Sheflield. 1997. Pages 133-140 & 141-143 in PS, Pages 133-140 & 141-143 in PDF.

      • Discussions Led by:  Gabe Brostow and Irfan Essa.
 Interesting Links
6 CheckMonday 
5/4
  • HMMs
  • Readings:
    • Rabiner, Lawrence, & Juang, "Theory and Implementation of Hidden Markov Models", Chapter 6 in Fundamentals of Speech Recognition, Prentice-Hall 1993. (Handed Out 4/27).
    • Hidden Markov Models for Speech (from Entropic Inc.)

      • Discussions Led by:  Irfan Essa & Rob Orr.
 Rob Orr's Slides
CheckWednesday 
5/6
  • Applications of HMMs
  • Readings:
    • Starner, T., and Alex Pentland (1996) "Real-Time American Sign Language Recognition from Video Using Hidden Markov Models" PAMI July 1997.  (PS Version)

      • Discussions Led by:  George Magiros  
    • Oliver, N.,  A. Pentland, F. Berard and J. Coutaz, "LAFTER: Lips and Face Tracker", In Proceedings of Computer Vision and Pattern Recognition Conference '97, 1997. (PS Version)

      • Discussions Led by:  Ying Chen 
    • *3rd Paper Moved to 5/18/98*
  • Weekly Assignnment #3: "What are Kalman Filters good for?. Explain whay you would use them and for what specific task?  Please be specific about the task."
      •  
7  CheckMonday 
5/11
  • Human Action Recognition I
  • Readings:
    • *First Paper moved to 5/18*
    • Ju, S. X., Black, M. J., and Yacoob, Y., "Cardboard people: A parameterized model of articulated motion", In 2nd Int. Conf. on Automatic Face- and Gesture-Recognition, Killington, Vermont, Oct 1996, pp.38-44.  (download from WWW page)

      • Discussions Led by:  Xiaozheng Zhang 
    • Niyogi and Adelson "Analyzing gait with spatiotemporal surfaces" in CVPR 1996. (PS)
    • Niyogi and Adelson "Analyzing and recognizing walking figures in XYT" in IEEE Worshop on Nonrigid Motion Analysis, 1994. (PS) *READ THIS ONE of the two*

      • Discussions Led by:  Tim Lassige
CheckWednesday 
5/13
  • Human Action Recognition II
  • Readings:
    • Bregler, C., J.Malik, "Video Motion Capure", Tech Report: UCB//CSD-97-973 (Paper in gziped PS (843KB) or PDF (2.3MB)), 1998.

      • Discussions Led by:  Mike Cramer  *MOVED from4/20* 
    • Yacoob, Y. and Black, M. J., Parameterized modeling and recognition of activities, in: Sixth International Conf. on Computer Vision, ICCV'98, Mumbai, India, Jan. 1998, pp. 120-127. (postscript), (abstract)

      • Discussions Led by:  Joe Bayes
  • Weekly Assignnment #4: "What are HMMs good for?. Explain whay you would use them and for what specific task?  Please be specific about the task."
8  CheckMonday 
5/18
  • Catch UP *CHANGES* 
  • Progress Report Due
  • Discuss Projects
  • Readings:
    • *3rd Paper Moved from 5/5/98*

      • J. Yamato, J. Ohya, and K. Ishii. Recognizing human action in time-sequential images using Hidden Markov Models. Proc. 1992 ICCV, p. 379-385. IEEE Press,1992. (Handed Out: 5/4/98). 
      Discussions Led by:  Todd Delaune 
    • *First Paper moved from 5/11*
      1. Seitz, S., and C. Dyer, "View-Invariant Analysis of Cyclic Motion",  To appear in Int. J. Computer Vision, 25(3), 1997. (23M postscript or 2.7M gzip'ed postscript) [Assigned to: Bayes, Brostow, Chen, Cramer, Daniels, Delaune]
      2. S. M. Seitz and C. R. Dyer, "Detecting Irregularities in Cyclic Motion" Proc. Workshop on Motion of Non-Rigid and Articulated Objects, 1994,178-185. (postscript or 910K gzip'ed postscript). [Assigned to: Dinh, Har, Lassige, Magiros, Morris]
      3. S. M. Seitz and C. R. Dyer, "Affine Invariant Detection of Periodic Motion" Proc. Computer Vision and Pattern Recognition Conf., 1994, 970-975. (postscript or 1M gzip'ed postscript) [Assigned to Mossman, Orr, Schoedl, Steedly, Stoychev, Zhang]
      Discussions Led by:  I. Essa 
CheckWednesday 
5/20
  • Open (May have a guest speaker). *CHANGED see 5/27*
  • GUEST Lecture : Aaron Bobick
  • Discuss Final Projects
  • Discuss Sietz and Dyer papers from 5/18/98
  • Weekly Assignnment #5: What is periodic motion, cyclinc motion, instantaneous period and periodic trace? How would these be used to analyze video of a)walking/running person, b) pumping heart, and c) talking person?
9 Monday 
5/25
  • Labor Day (No class)
CheckWednesday 
5/27
  • Physics and Models *MOVED FROM 5/20*
  • Readings (Handed Out 5/18/98):
    • Kass, M., Witkin, A., and Terzopoulos, D., "Snakes: Active Contour Models", International Journal of Computer Vision, 1(4):321--331, 1987.
    • D. Williams and M. Shah, A fast algorithm for active contours and curvature estimation, Computer Vision, Graphics, and Image Processing: Image Understanding 55, 1992, 14-26 
    • Amini, A.A., Tehrani, S., and Weymouth, T.E., Using Dynamic Programming for Minimizing the Energy of Active Contours in the Presence of Hard Constraints, ICCV88(95-99).

      • Discussions Led by:  Tahia Infantes  
    • Essa, Sclaroff, Pentland, "Physics-based Modeling for Vision and Graphics",  (Abstract | PS | PDF) 
    • Terzopolous and Metaxes

      • Discussions Led by:  Alan Daniels 
 Bob Sumner's Notes
Irfan Essa's Notes
 
10
 		 Monday 
6/1 
 
  • Overview
  • Course Evaluations
  • Weekly Assignnment #6: Discuss the importance of models in tracking and recognition of motion.  What is the difference in requirements of models for recognition vs. tracking.  Discuss the levels of details in models needed.  Feel free to define a domain of choice (ie. what are you trying to track/recognize).
    Due: 12noon 6/1/98
  • Weekly Assignment #7: Say someone gave you a video of someone throwing a ball and asked you to track, recognize and synthesize this motion.  How would you do it?
    Due: 12noon 6/1/98
Wednesday 
6/3
  • Final Project Presentations
  • Final Project Report DUE
  • Presentations:
    • 5/27: Dinh, Huong Quynh
    • 4:40 Delaune, Todd Irwin & Morris, Tahia Infantes
    • 4:50 Daniels, Alan Thomas 
    • 5:00 Bayes, Joseph C.
    • 5:10 Orr, Robert Judson 
    • 5:20 Haro, Antonio 
    • 5:30 Chen, Ying & Zhang, Xiaozheng 
    • 5:40 Stoytchev, Alexandre Todorov 
    • 5:50 Brostow, Gabriel Julian
    • 6:00 Lassige, Timothy Aaron 
    • 6:10 Mossman, James Andrew 
    • 6:20 Steedly, Drew Edward 
    • 6:30 Cramer, Michael Jon 
    • 6:40 Magiros, George Peter 
    • 6:50 FOOD

      •  
11 Finals Week 
 

Back to CS7322 Winter 1998 Home