Performance of all the tasks on TVQA dataset by question type.

M1-M5 represent Two-stream, PAMN, Multi-task, STAGE, and MAF-HMS, respectively.</p

S1 Dataset -

(ZIP)</p

Faster R-CNN network.

Faster R-CNN network.</p

The hybrid multi-head self-attention mechanism.

The hybrid multi-head self-attention mechanism.</p

Analysis by required modality of MAF-HMS.

Analysis by required modality of MAF-HMS.</p

The network architecture of MAF-HMS.

The network architecture of MAF-HMS.</p

Performance comparison on MSVD-QA and MSRVTT-QA dataset.

M1-M5 represent Two-stream, PAMN, Multi-task, STAGE, and MAF-HMS, respectively.</p

Ablation study on model variants of MAF-HMS on the validation set of TVQA.

Ablation study on model variants of MAF-HMS on the validation set of TVQA.</p

Evaluation results on the TVQA dataset by TV show.

Evaluation results on the TVQA dataset by TV show.</p