1 Introduction

  • recognize the temporal relation and deduce what has happened
  • activity, short-term, long-term
  • still frames, optical flow: √
    • other: struggle, limited
  • multiple scales
  • activity recognition, core problem
  • two stream, short-term motions
  • 3D conv
  • CNN+LSTM
  • robot object manipulation, inverse dynamics model

2 Temporal Relation Networks

  • pairwise temporal relation
  • sample pairs, 2-frame
  • 2-frame
  • accumulate, d frames

3 Experiments

  • from ResNet
  • e.g. 174 classes
    image