Representational Similarity Analysis
Related Papers
Higher-order Comparisons of Sentence Encoder Representations
AbstractRepresentational Similarity Analysis (RSA) is a technique developed by neuroscientists for comparing activity patterns of different measurement modalities (e.g., fMRI, electrophysiology, behavior). As a framework, RSA has several advantages over …...
Analyzing analytical methods: The case of phonology in neural models of spoken language
AbstractGiven the fast development of analysis techniques for NLP and speech processing systems, few systematic studies have been conducted to compare the strengths and weaknesses of each method. As a …...
Picking BERT’s Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis
AbstractAs the name implies, contextualized representations of language are typically motivated by their ability to encode context. Which aspects of context are captured by such representations? We introduce an approach …...
Unequal Representations: Analyzing Intersectional Biases in Word Embeddings Using Representational Similarity Analysis
AbstractWe present a new approach for detecting human-like social biases in word embeddings using representational similarity analysis. Specifically, we probe contextualized and non-contextualized embeddings for evidence of intersectional biases against …...
Interpreting Character Embeddings With Perceptual Representations: The Case of Shape, Sound, and Color
AbstractCharacter-level information is included in many NLP models, but evaluating the information encoded in character representations is an open issue. We leverage perceptual representations in the form of shape, sound, …...