Corresponding author: Alan Cienki ( a.cienki@vu.nl ) Academic editor: Cornelia Müller
© 2021 Alan Cienki.
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits to copy and distribute the article for non-commercial purposes, provided that the article is not altered or modified and the original author and source are credited.
Citation:
Cienki A (2021) From the finger lift to the palm-up open hand when presenting a point: A methodological exploration of forms and functions. Languages and Modalities 1: 17-30. https://doi.org/10.3897/lamo.1.68914
|
There are many studies on the palm-up open hand (PUOH) as a gesture used when the speaker is presenting a point, but many other gesture forms can also accompany this discursive move. While the forms may appear diverse based on traditional means of gesture analysis, the relations between a number of them can be analyzed in a coherent way using the kinesiological system developed by Boutet (2010; 2018; to appear). This system approaches gestural forms not from external criteria based on the viewer’s perspective (involving hand shapes, locations in gesture space, etc.), but rather from the inside; in the present analysis, the focus is on the directions of movements made at joints in producing them (e.g. whether flexion vs. extension was involved, whether any rotation involved was inward or outward, etc.). Four particular gestures are considered as points along a continuum: from the finger extension, to the forearm and wrist turn-out of the hand, to the supination of the PUOH, to an exaggerated form of the PUOH produced with extension and abduction of the upper arm. A multifunctional model is also proposed to analyze the degree of transparency of the different gestures’ representational, pragmatic, and interactive functions. The functional analysis performed with this model is grounded in form features from a combination of the kinesiological and traditional four-parameter form-based systems. This methodological exploration provides a model which could be applied or adapted for the analysis of other groups of gestures that are related in terms of their physiological means of production.
gesture forms, gesture functions, kinesiological system, methodology, palm-up open hand, pragmatic gestures, Russian
A number of studies have pointed out the role that gesture can play when speakers are presenting a point, introducing a topic in their discourse, or offering an idea for consideration (e.g.,
However, there is actually a range of gestural forms that are used when speakers are presenting a point—from turning the hand outward to varying degrees such that the palm is not even turned up and the fingers of the hand are only half-open, to simply lifting a finger momentarily. What I would like to argue is that among speakers of a number of European languages (and here we will focus mainly on Russian), these ‘presenting’ gestures can be characterized according to a coherent framework, despite the range of variation in their forms and functions. I will argue (a) that the forms can be seen as forming a continuum in terms of the different degrees of exertion involved in their production. (b) The range shown by their forms can be analyzed in a coherent way through the kinesiological system characterized by Boutet (2010 and elsewhere). And (c) the uses of these differing forms can be characterized in terms of several functions they exhibit simultaneously, but to different degrees of transparency with which the use of that function can be interpreted. Proceeding through this analysis will serve as a methodological demonstration of the value of combining two types of gesture form analysis—one kinesiological, and the other based on a set of four descriptive form parameters—along with a novel, graded form of gesture function analysis.
Since it appears that the claims to be made here apply to other cultures beyond Russian, the present study can constitute a starting point which can be tested against gesture use with other languages in the future. In addition, the method of analysis that is presented here offers a combination which could be useful to test on a wider scale in the future to assess the reliability with which it can be used. We will now turn to the specifics of the forms and functions of these gestures.
In past research, the palm-up open hand (PUOH) has been discussed as the prime example of a manual gesture that accompanies a speaker’s presentation of a point.
Even limiting ourselves to this form and function, other studies have considered this type of PUOH as part of a broader category of “pragmatic gestures” (as in
However, other gestures that can serve the function of presenting a point have not even been recognized in the literature. One example of these is what may have been considered as self-adapters. Adapters are commonly known as (usual manual) actions that “fix oneself” in some way. These self-directed, “body-focused movements” (
Yet there can be more transpiring within self-adapter movements than just the functions mentioned above. Some involve additional elements which diverge from self-directed movement and momentarily go outward, and do so in relation to the content and rhythm of the speech. A current study on the gestures made by simultaneous interpreters at work (“Verbal and co-verbal behavior under cognitive pressure”, supported by the Russian Science Foundation) has revealed many instances of self-adapters—which in itself may not be surprising, given the cognitive stress level that can be experienced when conducting this work. But close analysis of these self-adapters, facilitated by video recordings made with a small GoPro camera on the desk facing the interpreter, revealed small movements that also accompany the presentation of points in the discourse. A main category here involves finger movements extending outward and then returning back to their original position. A prime example was when speakers’ hands were folded together on the desk in front of them, and they raised one or both thumbs when making a point, often holding it/them up in raised position while stating the point, and then lowering it or them back down upon completion of the statement (Figure
While the PUOH and the self-adapters with additional movements might be seen as involving quite different behaviors, the relevance of the differences between them may largely be a factor of how they are being analyzed, as the following section will make clear.
What is proposed here is that the forms in question can be seen as part of a continuum. Here we will illustrate four points on the continuum in Figures
The way of describing manual gestures that has become established in gesture studies derives from a system developed for analyzing manual forms used in sign languages (
On the one end of the continuum we can begin with an extreme example of the palm-up open hand as a presentation gesture, shown in Fig.
Next on this continuum of gestures presenting a point is the “classic” palm-up open hand, as found in the examples noted in the previous section, and as illustrated in Fig.
Kendon (2004, p. 265) describes the gesture as involving “a wrist extension, often combined with a slight lowering of the hand, and followed by a hold.” Most prototypically, it is produced in front of the speaker, closer to the body than the “magician’s presentation”, described above. Producing the PUOH further out from the body (and not even as far out as in Figure
The next two categories concern the smaller and less effortful instantiations of presentation gestures. A prime example involves what can be called a turn-out of the hand, as shown in Figure
The last point on the continuum concerns various forms of finger lifts, most often produced when the speaker is seated, with their hands in front of them on a table, palms down or facing the speaker. It can involve the extension of a single finger (such as the index finger) followed by its retraction. If the speaker’s hands are folded, it can consist of lifting one or both thumbs. Fig.
Such gestures have not been taken into consideration in many previous studies in so far as research on manual gestures primarily focusses on free-hand gestures; any movements made while the hands are folded and touching each other might normally be categorized as forms of self-adapters and, therefore, not be taken into consideration in such studies. However, it should be noted that the finger-lift movements here are not ones that fit the usual definitions of self-adapters: they are outward movements, not self-oriented self-touching movements, even if they are possibly embedded in a posture of one hand touching the other.
The continuum as a whole can be represented by these gestures as reference points along it, as in Figure
What we can note is that if the gestures described above were characterized in terms of all four form parameters that are often used in gesture description, that would highlight the differences between the gesture forms described (considering the different orientations, locations, and forms of movement of the hands), rather than any similarity or continuity of form between them. This is because, as Boutet et al (2016) observed, the nature of the four-parameter system is one that inherently employs an external viewpoint on gestural phenomena. It involves describing the gestures’ handshapes, palm orientations, locations, and movements using external frames of reference. These include shapes that we compare the gestures to (involving which fingers are straight or bent as in
This logic of gesture production from the kinesiological point of view comes from the kinesthetic perspective being taken on the gestures. First, from this perspective, it is clear that the four points on the continuum represent different degrees of exertion to produce the gestures. Here we can draw upon Laban’s influential notion of effort, which has also been instrumental in Kendon’s (1980; 2004) and McNeill’s (1992) analyses of gesture. As summarized in Cienki (2013, p. 669), Laban and Lawrence (1974/1947, pp. 11–12) “characterize effort in terms of four factors of exertion: weight (with gesture this usually concerns exertion to overcome the relevant part of one’s own body weight), space (exertion according to the path of motion followed, e.g., flexible or direct), time (speed of motion), and flow (control of the movement, as fluid versus bound).”
This attention to the parts and their movement that produce the gestures takes us to the kinesiological system for gesture description, developed by Boutet (2010; 2018; to appear) and Boutet et al. (2016; 2018), drawing upon
If we consider these movement components and the order in which they are employed for the production of any gesture, we find that they provide a coherent framework for describing the different presentation gestures along a continuum of degrees of exertion required in order to produce them. A key feature of the scale of the continuum is not only that more effort is exerted as we go from the finger lifts all the way to the “ta daa” presentation gesture, but also that the effort is exerted over more articulators (bodily segments), which, consequently, involves the lifting of more weight (of one’s own limbs) and the use of more space.
Starting with the smallest movements, the finger lifts involve extension of some of the smallest segments of the human body—those in the fingers. The essential, minimally necessary extension is at the joint where the finger meets the palm of the hand, with further exertion leading to extension of the other joints, maximally resulting in a fully stretched finger. Note that the extension of any finger could be at issue here—not just thumbs (as in Fig.
The next gestural form in the continuum from smallest to largest involves some degree of finger extension plus partial rotation of the forearm from the elbow and the wrist. The rotation in this case is outward from the sagittal (front-back) plane of the body, thus abduction. This produces what we can call the hand turn-out (Fig.
Continuing the rotation of the lower arm further along, with more effortful extension of the fingers, produces the opening of the hand. Maximal exertion in the lower arm rotation and finger extension results in supination of the hand, yielding the prototype of the palm-up open hand, seen above in Fig.
Finally, the maximal version of presentation involves all of the above types of movement plus extension at the elbow and shoulder (producing a PUOH further out in front of oneself), along with possible abduction from the elbow and shoulder (resulting in a PUOH produced out to one’s side, as in Figure
Applying the kinesiological system here provides insights that reveal the coherence of the different gesture forms along a continuum. In the kinesiological system, the continuum constitutes a gradual adding on of bodily joints, and with them, certain degrees of freedom, and, as a consequence, the following patterns of movement:
However, applying the traditional four-parameter system of gesture description makes the different forms appear to be unrelated to each other, given how the parameters are realized in such different ways.
Analyzing these movements in terms of the kinesiological system provides a view of the gestural movements from the inside, rather than from the outside as the traditional four parameters do. The kinesiological interpretation shows how for the gesturer, each of these types along the continuum could be perceived as some degree of doing some version of the same thing, from a more miniature (finger lift) to a more maximal (“taa-daa” PUOH) form of expression. Using one of the smaller forms in a given moment might be seen (by the producer or by someone paying attention to them) as metonymically producing a miniature version of a fuller performance of one of the larger forms. They all form part of a continuum of degrees of exertion of effort, manifested by use of an increasing number of joints and degrees of freedom of movement.
The discussion of these various forms as different realizations of presentation gestures already indicates a common function that they serve, namely accompanying the presentation of an idea to the listening audience, and even being the observable means that indicates that the spoken utterance is an idea being presented. However, as mentioned briefly above, and as the following section shows in more detail, different scholars have not agreed in their characterization of this function. Is there a way in which their disparate analyses of function can be brought together, in line with the coherence of the analysis of forms, presented above?
Not only do the traditional four parameters of gesture form sometimes hide commonalities between gestures that are related in their means of production, but the traditional methods of characterizing gesture functions also result in a kind of dilemma when we use them to try to capture the similarities and differences between the functions of gestures such as the four points on the continuum described above. This is mainly a consequence of the goal in much gesture research of trying to categorize gestures according to one main function for each gesture phrase (particularly the main gesture stroke plus any subsequent hold of the final position of the stroke).
The kind of presentation gesture that has been analyzed the most frequently is the PUOH, making it the presentation gesture par excellence. However, even this type has been argued to have different functions.
What the gestures involved in presenting a point that are discussed in this article have in common is that they function in the liminal semantic space of what
Some works do explicitly approach manual gestures as being inherently multifunctional (e.g.
In
This multi-vector semiotic model involves a number of parameters of properties of gestures—functions such as semanticity (degree to which the gesture refers to a referent, property, or process), metaphoricity, and indexicality, as well as the degree of the gesture’s conventionality in the given culture, degree to which the speaker indicates awareness of having used a gesture, and the salience of the gesture in context. The particular parameters implemented in the model can be varied as appropriate for the goals of one’s study (see below). Each of them is indicated along a scale which the researcher can use to evaluate the gesture phrase in context from 0 to 3. The scales are displayed with a common starting point for 0, radiating out from there, with the analysis of any given gesture or gestures producing a kind of spider web, as shown in Fig.
Given that this system is rather complex (like gestures themselves), for the present analysis, we can limit ourselves to three of the parameters, as follows:
– <---------------> + Representational Transparency
– <---------------> + Pragmatic Transparency
– <---------------> + Interactive Transparency
Each will be characterized in terms of how easily that function can be recognized by the researcher in the gesture in context, what will be called the transparency of the function. The method of analysis proposed here will thus not depend on claims made about what the producer of the gesture was trying to achieve (since we cannot read that person’s mind to know it), but rather about what the given researcher deduces about the function, based on formal and contextual cues and their perceived salience.
The parameters to be used here are Representational Transparency (which conflates semanticity and iconicity from the multi-vector model), Pragmatic Transparency, and Interactive Transparency (a scale not taken from Iriskhanova and Cienki [2018] but one that has been introduced for this study). Each will be marked on a scale of transparency to the researcher, from less to more, indicated by the minus and plus signs.
What we find, ironically, is that the determination of these functions in fact takes us back to the form parameters seen from an ‘external perspective’, as discussed earlier. In this regard, the four form parameters prove their usefulness for this analysis, providing an entryway to move from form (as perceived from an external perspective) to function. This is actually the basis of the Linguistic System of Gesture Analysis, described in Bressem et al (2013).
The logic for choosing the three parameters described above can be traced back to Bühler’s (1934) Organon model. Bühler argued that linguistic signs involve three functions at once: representation (Darstellung) of the object or states of affairs being mentioned, expression (Ausdruck) on the part of the speaker/‘sender’ of the message, and appeal to the listener/receiver (Appell).
Each parameter can be marked for the degree to which the given function is seen as being saliently transparent (to the researcher) for the given gesture phrase in its context of use. The following are suggestions of how such an analysis would look. The system can be used in at least two ways: one would be to help illustrate a given researcher’s interpretive analysis of a small set of gestures as used in context (as will be done here), and the other would involve empirical testing of the system itself with multiple coders to ascertain the degree to which this system could be used for replicable analyses.
Let us consider first how each function is manifested in each of the four reference points on the scale of presentation gestures in terms of its transparency. We will identify each of them using the kinesiological characteristics, explicated above, namely:
The function of representation in gesture is more transparent when greater effort is being applied to any given articulator(s). Greater effort in the formation of the handshape in the gesture results in a clearer manifestation of representing something. Increased tension in the bending or the straightening out of the fingers produces more clearly articulated forms. This can be opposed to when muscles in the hands are relaxed, which can result in a lack of clarity as to whether a particular form is being represented or not, given that a relaxed hand with fingers slightly bent inward is the default configuration of the hand when not gesturing.
Reference to the physiological property of tension (versus laxness) is quite informative in combination with the modes of representation for determining the degree of transparency of representation in a gesture: greater tension in the handshape can make it clearer that the form of the hand itself is being used to depict features of a referent; greater tension in the arms, resulting in elevation of the hands to a space higher up in front of the speaker, increases the salience of representational qualities that a gesture may have. (See also
Let us consider each of the four gesture forms under study here in terms of their representational transparency. In each case, a vertical bar ‘|’ will be used to propose the relevant point on the –/+ scale for that gesture form in the relevant context of use, introduced earlier.
Extension (Figs
– <-----|----------> + Representational Transparency
In terms of the modes of representation, the raised finger when presenting an idea can be seen as an instance of minimal embodying of the idea. For comparison, see the practice in many cultures of counting on one’s fingers when naming ideas (an instantiation of the metaphor of Ideas as Objects [
Extension and abduction/rotation (Figs
– <--|-------------> + Representational Transparency
This form constitutes a less transparent case of representation. The hand is relatively relaxed in its internal form (not tense) and therefore it is less obvious that it is engaging any one of the four modes of representation. For example, the closest mode that one might attribute to it is the holding mode, but a relaxed hand turning out and going back is not a very transparent rendition of holding something.
Extension and abduction/rotation with supination (Figs
– <-------------|--> + Representational Transparency
By contrast with simple extension and rotation, this gesture places the hand in a palm-up, fairly flat position, requiring more effort for the extension of the fingers. As the analyses of the PUOH mentioned above argue, this bears strong similarity to the hand configuration when one holds something small on one’s hand. The representational transparency of this gesture is therefore fairly high, with the hand as if holding a small object.
Extension and abduction/rotation with supination and extension/abduction (Figs
– <--------------|-> + Representational Transparency
This reinforces the representation of holding something out, discussed above, by placing it in a space more external to the speaker, as one would do when physically presenting something to someone else.
Extension (Figs
– <--|-------------> + Pragmatic Transparency
Of the four gestures on this continuum, the extended finger provides the least expression of any of the pragmatic functions. However, its place on this scale, as with all of these four gestures, would move more to the positive side if produced with a conspicuous beat movement, adding emphasis to its production.
Extension and abduction/rotation (Figs
– <------|---------> + Pragmatic Transparency
This gesture more obviously involves adding emphasis than a smaller movement (the extension alone) just involving one finger would, especially if it is produced with prosodic stress in the speech.
Extension and abduction/rotation with supination (Figs
– <-------------|--> + Pragmatic Transparency
The pragmatic functions of the PUOH are well known from the literature, cited previously. Kendon (2004, p. 159) actually uses the PUOH as the prime example of a gesture fulfilling a pragmatic function by performing a speech act, as it is “used as a way of indicating that what the speaker is saying is being ‘offered’ to the interlocutor” for consideration.
Extension and abduction/rotation with supination and extension/abduction (Figs
– <--------------|-> + Pragmatic Transparency
The external position of this gesture type more conspicuously adds emphasis to what is being talked about and presented, increasing its pragmatic transparency.
Extension (Figs
– <--|-------------> + Interactive Transparency
The extension of one finger constitutes a minimally interactive appeal; in addition, the movement may not necessarily even be visible to an interlocutor. It may seem counterintuitive to talk about a gesture’s function as presenting a point and at the same time describe it as being minimally interactive, but this “points to” the bigger question of why we use gesture. Here it can be not only to present an idea to others, but also to realize for ourselves the presentation of an idea (i.e. to realize that we are presenting an idea): the imagined interactive situation can be internalized. Witness that the speaker in this example is an interpreter with no actual audience being spoken to. The gestures can be for the speaker himself, for an imagined audience, or (as discussed in
Extension and abduction/rotation (Figs
– <---------|------> + Interactive Transparency
This gesture makes a small degree of appeal to the interlocutor through its movement outward, from self to other.
Extension and abduction/rotation with supination (Figs
– <------------|---> + Interactive Transparency
The PUOH is the prototypical example of what Bavelas (1994, p. 212) calls a gesture “marking delivery of new information for the interlocutor”. In the example in Fig.
Extension and abduction/rotation with supination and extension/abduction (Figs
– <---------------|> + Interactive Transparency
This gesture makes a maximal appeal to the interlocutor, directed towards the audience in a peripheral area of the speaker’s gesture space.
This yields the following functional profile for each gesture:
Extension (Figs
– <-----|----------> + Representational Transparency
– <--|-------------> + Pragmatic Transparency
– <--|-------------> + Interactive Transparency
The minimal exertion with the mere extension of a finger in this gesture appears to accomplish a minimal function, expressing what
Extension and abduction/rotation (Figs
– <--|-------------> + Representational Transparency
– <------|---------> + Pragmatic Transparency
– <---------|------> + Interactive Transparency
The representational value of this hand turn-out is less clear than it is in any of the other three gestures, but the rotation outward from the self gives it a modest appearance of making an appeal via a low-effort presentation.
Extension and abduction/rotation with supination (Figs
– <-------------|--> + Representational Transparency
– <-------------|--> + Pragmatic Transparency
– <------------|---> + Interactive Transparency
With the rotation being sufficiently extensive so as to supinate the hand, combined with the extension of the fingers, revealing the palm, this gesture has a clearer representational function of as-if holding something on one’s open hand, realizing the pragmatic (but not verbalized) function of offering, interactively appealing to the interlocutor.
Extension and abduction/rotation with supination and extension/abduction (Figs
– <--------------|-> + Representational Transparency
– <--------------|-> + Pragmatic Transparency
– <---------------|> + Interactive Transparency
Movement of the above gesture via abduction to a more external space, oriented toward the addressee(s), adds to the transparency of all of the gesture’s functions, particularly on the interactive plane.
In sum, the stepwise increase in degrees of freedom of movement that are used, as defined in the kinesiological system, makes for increasingly greater transparency of fulfilling the functions on each of the functional scales as we move along this gestural continuum.
Regarding the continuum of gestures presenting a point, in many respects, it is perhaps the hand turn-out that should be seen as constituting the prototype of the gestures for presenting a point, rather than the PUOH. Physiologically, witness the fundamental role of the rotation in the production of the turn-out and the PUOH, and the fact that many instantiations of the PUOH do not rotate far enough to produce a truly upward facing palm; in many contexts, producing a truly supine hand would involve too much effort, would be uncomfortable (because of the degree of torque required), would not be feasible in the physical context (items worn around the wrist or objects in the environment might inhibit this degree of movement), or might be pragmatically strange (the truly supine hand might seem to be an over-exaggerated gesture). Functionally, the turn-out can often serve the same purpose as the PUOH, but with less effort. It might be seen as a metonymic enactment of a PUOH, a part standing for the fully fledged production, and of course various gradations of the turn-out and of all the four forms presented here occur along the continuum.
We see here the value of combining both internal (kinesiological) and external (four form parameter) perspectives in gesture analysis. The internal point of view revealed how the difference between the four gestures is a matter of adding bodily joints that are moving, with their inherent possible degrees of freedom of movement. The external perspective proved most useful as a basis for grounding the interpretations, about functions in context, on observable phenomena.
The analysis proposed here can help make sense of the experiential basis of these different types of gestures as having connections to each other, as constituting different forms of presenting a point. We see this in the coherent links between the different forms and between the transparency of implementation of the different sets of functions. The kinesiological system helps reveal how the different degrees of intensity in terms of effort required to produce the forms relate to different degrees of strength in terms of the transparency of the gestures’ perceived functions. In addition, the analysis of these forms as points on a continuum has theoretical implications. It demonstrates how what might just seem to be different gestures on the surface actually have a coherence with each other if viewed from a different perspective; that is namely the perspective of the kinesiological system of movement combined with a scalar approach to analyzing the transparency of the gestures’ multiple functions. Taken together, the exemplars analyzed above constitute a category: a continuum of different ways of presenting a point, with each way entailing a different degree of prominence of doing so. This prominence is constituted for the producer in terms of the degree and kind of effort (based on the degrees of freedom) involved in the production of any given instantiation, and for the perceiver in terms of visual salience through the amount of articulators involved and the amount of gesture space used.
The form/function pairings identified can provide reference points on a continuum that can be useful for coding in other studies in the future. Coding gesture functions along continua does present a challenge in terms of assessing the reliability with which this system can be applied. This remains an issue for future research and development. However, what may help in applying the continua proposed is the framing of them in terms of transparency of the given functions to us as researchers, rather than in terms of claims about what speakers were doing with their gestures in the moment. This framing of the functions in this way, and viewing them in terms of degrees of transparency, are steps which can help further develop the Linguistic Annotation System for Gestures (
The research for this study was supported by Russian Science Foundation grant number 19-18-00357, awarded to the PoliMod Lab of Moscow State Linguistic University. Permission to reprint Figures