Most forms of communication and interaction draw on multiple modes of expression. This phenomenon, which is known as multimodality, is currently studied within several fields of research. Linguistic theories and methods have proven particularly useful for studying multimodality, as the field has a long tradition of describing the structure of natural language on different levels of abstraction.
My research develops linguistically-informed theories of multimodality and computer-assisted methods for its empirical study. I also apply these theories in an ongoing collaboration with geographers, which applies natural language processing, computer vision and machine learning to the automatic content analysis of social media in order to better understand people and places in cities.
Since 2018, I am Assistant Professor of English Language and Digital Humanities in the Department of Languages at the University of Helsinki.
Home page: www.helsinki.fi/~thiippal
Twitter: @tuomo_h