Action Recognition

In Computer Vision Lab, I did research on action recognition in videos. I worked on videos taken from aerial, rooftop and ground cameras, and videos from YouTube. Here is a list of all action recognition projects that I had worked during my Ph.D.

Particle Flow Fields (September 2011 – present)

“Particle Flow Fields” is a new video representation based on optical flow and particle advection. PFF outperforms optical flow and gradients. Particle Flow Fields also showed good performance on Kinect Gesture Recognition dataset in a “One-Shot-Learning” framework.

3D- Spatio Temporal Volumes (May 2011 – August 2011)

Investigated the performance of 3D gradients and PFF for action recognition task in aerial videos taken from an aircraft and performed extensive testing on aerial and rooftop videos in VIRAT dataset. The designed 3D-STHOG descriptor is incorporated into VIRAT DARPA system for testing.

Scene Conext Descriptor (October 2011 – May 2011)

Scene Context descriptor is proposed. Demonstrated improvement in accuracy on different action recognition datasets by using scene context information in conjunction to any motion descriptor. The datasets include UCF11, UCF50, HMDB51 and a sample from TRECVID dataset released as part of ALADDIN project.

KEYS System (March 2009 – September 2009)

KEYS system is developed in C++ based on feature-trees algorithm for real-time action recognition. New action categories can be added to the system on the fly. Demonstrated KEYS action recognition system live at ICCV2009 conference held in Japan.

Feature-tree (January 2009 – June 2009)

Developed an algorithm to perform multiple action recognition, incremental action recognition and action localization using feature-trees

Video Image Retrieval and Analysis Tool (VIRAT) project (Aug 2008 – Feb 2012)

This project is sponsored by DARPA to do action recognition in aerial videos. Action recognition algorithms were tested on APHill dataset. Two action recognition algorithms were implemented in c++ and integrated in into the VIRAT DARPA system developed by Lockheed Martin and Kitware