FZG Research: Sign Languages and Gestures – Topics, Projects and Publications

Research at the FZG has addressed a wide range of questions about sign languages and gestures, particularly Swiss German Sign Language (DSGS). Projects have explored how sign languages are structured and used, how they are acquired, and how they can be documented and studied. Other research has compared sign languages with different forms of gesture, including those used by hearing speakers, mime artists and orchestral conductors.

The following overview introduces the main research topics and describes selected projects and publications. It is intended both for researchers and for readers interested in learning more about sign languages and visual communication.

Overview of topics

1. Sign languages

(1.1) Writings on the linguistic structure of sign languages and history of sign language research 

(1.2) Development of a multimedia DSGS-German lexical database 

(1.3) Transforming the DSGS lexical database into a corpus-linked database 

(1.4) Notation and writing systems for sign languages 

(1.5) The use of mouthings in sign languages 

(1.6) Aspects of prosody and discourse styles in sign languages 

(1.7) Comparisons of sign languages 

(1.8) Effects of age of sign language acquisition 

(1.9) Sign language assessment and testing

2. Comparative studies of signs and gestures

(2.1) Historical perspectives on gestures and sign languages 

(2.2) How hearing speakers and deaf signers interpret signs from an unfamiliar language 

(2.3) Comparison of the performances by deaf sign language poets and hearing mime artists 

(2.4) Gestures of orchestral conductors

 

1. Sign Languages

(1.1) Writings on the linguistic structure of sign languages and history of sign language research  

From the earliest years of the FZG, an important goal was to make knowledge from the then-emerging field of sign language research more widely available. Over the following decades, Boyes Braem, sometimes in collaboration with colleagues, published articles on various aspects of sign language structure, use and research, including:

• Studies of Swiss German Sign Language dialects (Boyes Braem 1985b). 

• Reports on international conferences on sign language research (Boyes Braem and Leven 1984). 

• Sign language interpreter training in French-speaking Switzerland (Boyes Braem 1984). 

• Psycholinguistic research on iconicity (how the form of a sign resembles its meaning) and the temporal structure of signing (Boyes Braem 1985a, 1986). 

• The use of signs in schools for deaf children in Zurich and Geneva (Boyes Braem et al. 1987). 

• An introduction to sign language and its linguistic study (Boyes Braem 1990a). 

• A comparison of the situations of sign languages and Romansh in Switzerland (Boyes Braem, Caramore, Herman and Shores Hermann 1997, 2003). 

• The transmission of sign languages in Switzerland (Boyes Braem 2009; Boyes Braem and Rathmann 2010). 

• A retrospective account of 25 years of sign language research and programs in German-speaking Switzerland (Boyes Braem, Haug and Shores 2012). 

• Language research and changes within language communities (Fontana, Corazza, Boyes Braem and Volterra 2015). 

• Sign languages as part of Switzerland's linguistic landscape (Boyes Braem 2014). 

• An overview of research on Swiss sign languages (Boyes Braem 2024a). 

• The beginnings of sign language research in Switzerland (Boyes Braem 2024b). 

• Research on sign languages (Le ricerche sulle lingue dei segni) (Boyes Braem and Volterra 2025).

(1.2) Development of a multimedia DSGS-German lexical database

During the 1980s and early 1990s, dictionaries were not available for Swiss German Sign Language (DSGS), as was also the case for many other sign languages. This presented a major obstacle to linguistic research, which often requires a systematic way of identifying, recording and comparing individual signs. 

The absence of dictionaries as well as established written forms can also affect how a language is perceived by the wider society. Languages without these resources have often been accorded lower status, with consequences for the communities that use them. 

A research project supported by the Swiss National Science Foundation (1996 –2001) established the first research lexicon of DSGS as a multimedia bilingual database linking DSGS with written German. Rather than simply providing German translations, the database documented the forms and meanings of individual signs, including variations across the five regional dialects and between generations. Whenever possible, grammatical and meaning-related modifications of signs were also recorded. 

The original project collected approximately 3,000 conventionalized signs used in everyday communication (Boyes Braem 2001a). 

The database also documented alternative forms used in the five regional dialects of DSGS (Boyes Braem 1985b). A subsequent project expanded the original everyday vocabulary to include technical terms from economics and nutrition. The linguistic aspects of this work are discussed in Boyes Braem Groeber, Stocker and Tissi (2012b). 

 Figure: A database entry for annotations of multiple aspects of a particular sign

Although originally designed as a research resource, the database subsequently became an important basis for developing sign language learning materials. These included videotapes, CD-ROMs and books produced by the nonprofit association GS-MEDIA between 1999 and 2007 (see RESOURCES). 

The production of these materials involved collecting additional vocabulary, including older and newer signs used in specialized fields. These additions were continuously incorporated into the database. 

By 2026, the database contained approximately 9,000 entries, including regional and generational variations of signs.

(1.3) Transforming the DSGS lexical database into a corpus-linked database

The original DSGS lexical database was created using FileMaker software. In 2015, it was converted into a corpus-linked lexicon using iLex software, with the assistance of Sarah Ebling (Institute for Computational Linguistics, University of Zurich) and Thomas Hanke (University of Hamburg).

A lexical database provides information about individual signs, such as their form and meaning. A corpus is a systematically organized collection of recorded language samples. Linking the two makes it possible to study signs not only in isolation but also as they occur in actual communication.

The corpus-linked lexicon provides researchers with standardized glosses (written labels used to identify signs, which usually consist of a word from a spoken language written in capital letters) and detailed information about individual signs. It also links these entries to video recordings showing how the signs are used in different kinds of discourse.

 Researchers can therefore investigate a wide range of questions about sign language structure and use. The collection also serves as a historical archive, preserving video recordings of DSGS from different periods.

Since 2026, the corpus-linked database has been hosted on SWITCH infrastructure (the Swiss foundation for digital services in higher education and research), under the direction of Prof. Sarah Ebling at the University of Zurich. Prof. Ebling has also migrated the database to an ELAN-based system, allowing it to be expanded with annotated video recordings from earlier, current and future research projects.

This arrangement will enable successive generations of researchers to contribute new material while continuing to use and investigate the older recordings. 

 (1.4) Notation and writing systems for sign languages

Film and video recordings have been invaluable for documenting sign languages. However, researchers also need ways to represent signing in written or symbolic form so that they can analyze, compare and search for particular linguistic features. 

Developing such notation systems has been an important concern in sign language research for many decades. 

Unlike the writing of spoken languages, the notation of sign languages must represent multiple aspects of visible bodily activity. These include handshape, hand orientation, location and movement of the arm and hand, as well as linguistically relevant movements or positions of the head, face, eyes and mouth. 

Some notation systems represent these components as long sequences of symbols. Others arrange information on several parallel tiers, somewhat like the different instrumental parts of an orchestral score. 

Detailed annotation of sign language video recordings can be extremely time-consuming. Published estimates range from approximately 60 hours of work to segment one hour of signing into individual signs, to approximately 200 hours for basic annotation identifying these signs. More detailed linguistic annotations may require considerably more time. 

Figure: Annotation of a DSGS signed sentence meaning ‘I said I will not go to the store, me never!’ (from Boyes Braem 1999)  

Although several systems have been developed in different countries (Boyes Braem 2012), no single writing system has become universally established for sign languages. 

Two notation systems used in FZG projects, HamNoSys and SignWriting, are described below.

HamNoSys (Hamburg Notation System) 

The expandable corpus can be ‘mined’ for many different kinds of research questions. Selected parts of the lexicon can be directly uploaded to on-line products. 

HamNoSys (HNS) is a phonetic notation system developed by researchers at the University of Hamburg.

It uses approximately 150 basic symbols to represent important aspects of the form of signs, particularly handshapes, orientations, locations and movements. Its symbols can be entered electronically, allowing sign forms to be recorded, compared and searched in databases. 

HamNoSys can be used to notate both individual signs and sequences of signs occurring in signed discourse. 

The example below shows the HNS notation for three parts of a signed sentence meaning: (1) Goldilocks, (2) is wandering, (3) in a deep forest.

Over the years, the FZG has helped organize and participated in workshops on HamNoSys. 

In a long-term project, Sandra Sidler, a trained HamNoSys notator, provided HNS notations for the DSGS signs recorded in the research database. This work received partial funding from the Verein zur Unterstützung der Gebärdensprache (VUGS). Collaboration with Dolly Blanck, an experienced HamNoSys notator from Hamburg, was particularly helpful for this project.

 SignWriting 

In addition to notation systems designed primarily for linguistic research, there is a need for written representations of sign languages that can be learned and used more easily by non-specialists. 

SignWriting (GebärdenSchrift) was developed to provide a visual way of writing signs and signed texts, including for educational and everyday purposes. 

A project supported by a Swiss National Science Foundation DORE grant (2001–2002), together with contributions from the Hochschule für Heilpädagogik Zürich (HfH), GS-MEDIA and the FZG, produced two sets of books and videotapes presenting biblical stories in sign language. 

The stories of David and Goliath and Noah and the Ark were documented in SignWriting, accompanied by German translations of the text as well as of the glosses of each (see RESOURCES).

Image: Page from the book Noah and the Ark with German translation and SignWriting notation of the signed DSGS passage together with a story illustration.

SignWriting notations were also prepared for the approximately 3,000 vocabulary items used in four CD-ROMs produced by GS-MEDIA for the Swiss Deaf Association's sign language courses, as well in a separate CD-ROM (Vokabeltrainer) containing the same vocabulary together with learning exercises. 

The corresponding videos, annotations and lexical items are archived in the DSGS database and are also available in the RESOURCES section of this website. The SignWriting notations for the vocabulary set are also available on SignWriting's own website.

(1.5) The use of 'mouthings' in sign languages

Movements and positions of the mouth can serve several purposes in signed communication. 

Some mouth movements, as in spoken interaction, express non-linguistic (or 'nonverbal') information, such as surprise (an open mouth). 

Other mouth gestures perform linguistic functions within the sign language itself. For example, certain mouth movements may modify the meaning of manually produced signs, in ways somewhat comparable to the functions of adjectives or adverbs in spoken languages (such as a quick sharp closing of the mouth, adding emphasis to the manual sign for  'defend' to make it 'strongly defend').

A different type of mouth activity consists of silently articulating a word, or a first part of a word from a surrounding spoken language while producing a manual sign or string of signs. These movements are called mouthings. 

Mouthings are particularly common in many European sign languages, where contact with the surrounding spoken languages, including through education, has played an important role. However, their frequency and linguistic functions vary across sign languages. Mouthings may also become integrated into the linguistic structure of the sign language itself. 

 Research on mouthings in different European sign languages is presented in a collection of article edited by Sutton Spence and Boyes Braem (2001). The forms and functions of mouthings in DSGS are discussed in Boyes Braem (2001b, 2006).

(1.6) Prosody and discourse styles

Prosody refers to features such as rhythm, timing and emphasis that help organize language and convey meaning. In spoken languages, prosody is commonly associated with variations in pitch, loudness and rhythm. 

Signed languages also use prosodic features, but these are expressed visually through movements of the hands, head, face and body. 

FZG research has examined aspects of these features and the ways signers organize their communication. 

Rhythmic upper-body movements 

One study examined rhythmic movements of the upper body in the storytelling of deaf people who had learned DSGS either early or later in life. 

The results suggested that early learners, but not late learners, tended to use rhythmic side-to-side body movements to help organize larger passages of signing during storytelling (Boyes Braem 1999). 

Im/politeness 

As in spoken languages, signers can express varying degrees of politeness or impoliteness. 

A study of DSGS found that politeness is conveyed not only through the choice of signs but also through how they are produced. The movements and manner of signing can contribute to whether an expression is perceived as polite or impolite. 

A preliminary comparison of DSGS and German Sign Language also indicated that the ways politeness and impoliteness are expressed may differ between sign languages (Boyes Braem and Tissi 2023). 

Narrative and participatory styles 

When recounting events or representing what others have said or done, signers may use different discourse styles. 

One distinction is between a narrator style, in which the signer describes events from an outside perspective, and a participatory style, in which the signer takes on the perspective or role of someone involved in the events. 

These styles differ in the use of eye gaze, facial expression, head and body orientation, and hand movements. 

They have some similarities to distinctions between direct and indirect representation in spoken languages (Boyes Braem 1992; Boyes Braem et al. 1990).  

 (1.7) Comparisons between sign languages

 Sign languages share many characteristics because they use the same visual and bodily means of communication. Nevertheless, they are distinct languages and can differ considerably in their vocabulary and linguistic structure. 

One obvious difference concerns the forms of individual signs. For example, the sign meaning girl in DSGS differs from the signs used for the same meaning in American Sign Language (ASL) and German Sign Language (DGS). Consequently, people who use different sign languages do not necessarily understand one another. International conferences with participants from several sign language communities may therefore require interpreters for multiple sign languages. 

A collaborative study involving researchers of DSGS and German Sign Language examined methodological factors that need to be considered when comparing the vocabularies of different sign languages (Ebling, Konrad, Boyes Braem and Langer 2015).

 (1.8) Effects of age of sign language acquisition

 One of the first major FZG research projects, supported by the Swiss National Science Foundation (1990–1995), investigated how the age at which deaf individuals learn a sign language may influence their signing. 

The study collected data from three deaf people who had acquired DSGS early in life and three who had learned it later (Boyes Braem 1995). 

The recordings were subsequently used to investigate other differences between the two groups, including their use of mouthings and rhythmic upper-body movements for prosodic purposes.

 (1.9) Sign language assessment and testing

Although the development of sign language assessment methods has not been one of the FZG's principal research areas, the FZG has collaborated with colleagues in Zurich who are developing techniques for assessing sign language abilities (Haug et al. 2022; Ebling et al. 2021).
 
FZG researchers also participated in the European Union project SignMET (2014–2015), which aimed to develop common methodologies and evaluation tools.

 2. Comparative studies of signs and gestures

 Research into sign languages has also contributed to the study of other forms of visible bodily communication. 

Methods and theoretical models developed for analyzing sign languages, sometimes combined with approaches from cognitive linguistics, can be applied to gestures used by hearing speakers and to specialized forms of bodily expression, such as mime and orchestral conducting. 

The following projects investigate historical perspectives on signs and gestures and compare different uses of visible bodily action in communication and performance.

 (2.1) Historical perspectives on gestures and sign languages

Research in this area has examined how scholars' views of gesture, sign languages and bodily communication have developed and changed over the centuries. Two publications address these questions: 

· Tracing the Body: Theories of Gesture and Sign Language through History (Bonsignori, Boyes Braem and Volterra, forthcoming 2028).

 

· Through the Sign Language Glass: Changing and Converging Views in Spoken and Signed Language Research (Boyes Braem and Volterra 2023).

 (2.2) How hearing speakers and deaf signers interpret signs from unfamiliar sign languages

In collaboration with colleagues in Rome, a study investigated how hearing speakers and deaf signers in seven European countries interpreted signs from sign languages they did not know (Boyes Braem, Pizzuto and Volterra 2002). 

The findings were discussed in relation to a model developed by Boyes Braem (1981) in her doctoral dissertation. This model explained how visual resemblances (iconicity) and conceptual associations, including metaphor and metonymy, can underlie the forms of signs.  

 (2.3) Comparison of performances by deaf sign language poets and hearing mime artists

In collaboration with Rachel Sutton-Spence (University of Bristol and Swarthmore College), skilled deaf sign language poets and professional hearing mime artists were asked to represent a selected set of ten inanimate objects, ten animals and ten abstract ideas or qualities, exploring how these could be given human-like characteristics (anthropomorphization). 

The study describes similarities and differences in how the two groups developed and presented their responses to these tasks (Sutton-Spence and Boyes Braem 2013).

 (2.4) Gestures of orchestral conductors

 The gestures of orchestral conductors provide another example of specialized bodily communication.

      Drawing by Katja TissI

 A collaborative study analyzed the handshapes and movements of conductors' non-dominant hands, using concepts and methods originally developed for the linguistic analysis of sign languages (Bräm and Bräm 1998, Boyes Braem and Bräm 2000, 2004).

 

(Return to top)