Directional Pairwise Crossmodal Attention

AbstractHuman language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: …...