Абляция кросс-модальных входов
method
ID: crossmodalinputablation
Related Papers
Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers
AbstractPretrained vision-and-language BERTs aim to learn representations that combine information from both modalities. We propose a diagnostic method based on cross-modal input ablation to assess the extent to which these …...