Research Article |
Corresponding author: Anna Izmalkova ( mayoran@mail.ru ) Academic editor: Maria Kiose
© 2022 Anna Izmalkova, Anastasia Rzheshevskaya.
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits to copy and distribute the article for non-commercial purposes, provided that the article is not altered or modified and the original author and source are credited.
Citation:
Izmalkova A, Rzheshevskaya A (2022) Graphological and semantic foregrounding as affecting gaze and speech of impulsive and reflective readers. Languages and Modalities 2: 19-26. https://doi.org/10.3897/lamo.2.78721
|
The study explores the effects of graphological and semantic foregrounding on speech and gaze behavior in textual information construal of subjects with higher and lower impulsivity. Eye movements of sixteen participants were recorded as they read drama texts with interdiscourse switching (semantic foregrounding), with features of typeface distinct from the surrounding text (graphological foregrounding). Discourse modification patterns were analyzed and processed in several steps: specification of participant/object/action/event/perspective modification, parametric annotation of participants’ discourse responses, contrastive analysis of modification parameter activity and parameter synchronized activity. Significant distinctions were found in eye movement parameters (gaze count and initial fixation duration) in subjects with higher and lower impulsivity when reading parts of text with graphological foregrounding. Impulsive subjects tended to visit the areas more often with longer initial fixations than reflective subjects, which is explained in terms of stimulus-driven attention, associated with bottom-up processes. However, these differences in gaze behavior did not result in pronounced distinctions in discourse responses, which were only slightly mediated by impulsivity/reflectivity.
graphological foregrounding, semantic foregrounding, construal parameters, impulsivity/reflectivity, eye-tracking
Foregrounding is viewed as a construal operation stimulating the process of mental structures activation in discourse interpretation realised through selected semiotic means (
The study exploits two approaches to foregrounding developed in cognitive psychology and cognitive linguistics. The cognitive psychological approach helps identify the nature and types of attentional shifts resultant in gaze behavior contingent with graphological foregrounding. At the same time, the cognitive linguistics approach helps assess the linguistic construal of textual events, their participants and perspective in terms of semantic foregrounding.
In cognitive psychology there seems to be a consensus that eye movements in reading are modulated by both endogenous and exogenous attentional shifts (
In contemporary models of eye-movement control in reading it is assumed that eye movements are pre-programmed by top-down mechanisms, however the features of text induce bottom-up processing (
In cognitive linguistics, there has been a large number of studies on semantic foregrounding (focusing). In line with the distinction of more and less focal elements in different language levels, there are approaches studying foregrounding in participant / object, event and perspective construal. In terms of participant and object foregrounding, their multiple features are explored, among them participant actionality, singularity, animateness, personification (
To create multiple options for graphological and semantic foregrounding and, consequently, to test their significance for impulsive and reflective readers, we have to select the stimuli which demonstrate natural (not artificially created) possibilities for both graphological and semantic foregrounding. To comply with the task, we addressed the drama texts which manifest the patterns of the author’s and characters’ interdiscourse which is graphically marked with fonts, brackets, bold type, italics. At the same time, drama texts manifest regular interdiscourse switchings which serve as borderlines between various events (microevents) and therefore help observe the shifts in participants and perspective construal and foregrounding. Presumably, in their construal, the experiment participants will demonstrate the construal shifts (
To explore the effects of graphological and semantic foregrounding, onto impulsive and reflective readers in terms of their gaze and discourse responses, we assess 1) the eye movement patterns of impulsive and reflective subjects in the Areas of Interest (AoIs) which are the areas of interdiscourse switching (from the characters’ to the author’s interdiscourse); 2) the patterns of discourse modification in the participants’ discourse responses following the oculographic experiment. The oculographic experiment was preceded by a psychological Familiar Figures Test (MFFT) (Kagan et al., 1966) aimed at identifying “reflectivity-impulsivity” cognitive style, also referred to as conceptual tempo (
Visual stimuli consisted of four pdf texts in original text formatting (spaces, bold type, intervals, font), these were the one-page extracts from modern Russian drama plays “Music Classes” by L.S. Petrushevskaya, “Biography” by L.N. Razumovskaya, “Reminiscence” by A.N. Arbuzov, and “Dweller” by A.V. Vampilov. The experiment was organized as a single procedure, the stimuli were incorporated into one sequence, with each stimulus appearing for 60 seconds followed by 30 seconds inter-stimuli periods with blank page pdf-stimulus appearing on the screen. The images were presented on a 21-inch monitor. All images were not photocopies but newly typed texts. There were 24 AoIs for the author’s interdiscourse in four stimuli. All AoIs were visually salient, either given in bold type, in italics or in brackets.
Twenty-five students (14 female, mean age = 23.2, age range = 19–28) participated in the experiment. Participants signed the declaration of consent and were then questioned if they were acquainted with the drama plays which we adopted as stimuli. Six participants admitted they were acquainted with the plays; however three of them added they were unable to recount the narration. Since the experiment conditions required total unanimity, we did not consider the data received from these six participants. The results of two participants had to be further excluded as they failed to complete the oculographic part of the experiment and the results of one participant had to be excluded since he failed to produce relevant responses. The data from sixteen participants were processed. Since the stimuli involved twenty-four AoIs in four visual stimuli, we recorded 408 trials which were subjected to further parametric and statistical analysis.
In the following subsections we will present the procedure and results of the oculographic experiment preceded by the psychological Familiar Figures Test (MFFT) (3.1) and the procedure and results of discourse responses assessment (3.2).
Experiment design
SMI Red-x eye tracker was used for eye movement data collection (binocular system, sample rate = 60 Hz, accuracy = 0.4°, head movement 40×20 cm, operating distance = 60–80 cm). We set the minimum fixation duration at 100 msec, in accordance with previous research (
Eye movement events data were collected for parts of the text, marked as Areas of Interest (AOIs) in BeGaze 3.0 software. We regarded AOIs with graphological foregrounding, following P. Simpson’s notes on graphological foregrounding (
Before the eye tracking experiment, the participants were subjected to psychological Familiar Figures Test (MFFT) (Kagan et al., 1966). The test is aimed at measuring “reflectivity-impulsivity” cognitive style, also referred to as conceptual tempo (
SMI BeGaze 3.0 software was used for raw data processing, and IBM SPSS Statistics 20 was used for data analysis.
Results
We used K-means cluster analysis to define two groups with more “impulsive” and more “reflective” cognitive style, based on two MFFT measures — latency (time taken to respond) and accuracy (number of errors). In line with studies on impulsivity/reflectivity (Kholodnay
Data | Latency (s) | Accuracy (n mistakes) |
---|---|---|
“Impulsive” | 370.33 | 10.67 |
“Reflective” | 756.7 | 4.9 |
Significant distinctions were found in eye movement characteristics of Impulsives and Reflectives when graphological foregrounding was concerned. We marked AOIs with graphological foregrounding, based on features of typeface (bold, italics, caps), following P. Simpson’s notes on graphological foregrounding (
Impulsive subjects tended to visit the highlighted text fragments more often than reflective subjects, as confirmed by Mann–Whitney U test for Glances count (z = -3.95, p < 0.01). Impulsive subjects showed significantly more AOI glances count (Mdn = 1.00), as compared to AOI glances count of reflective subjects (Mdn = 0.00). Impulsive subjects also tended to make longer initial fixations on AOIs (Mdn = 165 ms), than reflective subjects (Mdn = 128 ms), as confirmed by Mann–Whitney U test for AOI first fixation duration on AOIs (z = -2.82, p < 0.01).
This effect was also found in case graphological foregrounding, set with typeface, was accompanied with spatial features of the AOI, if AOIs were situated on a separate line. Impulsive subjects tended to make longer initial fixation duration on the AOIs (Mdn = 178 ms), and visit the AOIs more often (Mdn = 1.00), as compared with reflective subjects (Mdn = 139 ms for fixation duration and Mdn = 0.00 for AOI glances count), as confirmed by Mann–Whitney U test for AOI first fixation duration (z = -2.38, p < 0.05) and Mann–Whitney U test for AOI glances count (z = -3.6, p < 0.01).
Experiment design
The experiment testing modifications in discourse construal within the two participants’ groups, the Impulsives and the Reflectives, was preceded by the elaboration of the system assessing their modifications (of the stimuli) in speech. Since we considered three basic groups of semantic foregrounding parameters, the construal of participants (also objects and actions), event and perspective, the developed parameter system specified these three groups (
The study involved the following steps.
The modification parameter system of participant / object / action construal included 9 parameters for participants, for instance, giving full participant’s name (101), participant’s name (102), modified participant’s name (103), 3 parameters for objects, exact object naming (201), modified object naming (202), lack of object mentioning (203), and 4 parameters for action, exact action mentioning (301), generalized action mentioning (302), lack of action mentioning (303), additional characteristics of action (304). The modification system for event construal included 5 subgroups assessing event mentioning on the whole (401–405), event characteristics mentioning (501–506), event reporting by author and participants (601–604), time construal (701–702), space construal (801–802). The system for perspective construal included subjectivation (901), objectivation (902), and intersubjectivation (903).
The total number of modification parameters applied for discourse modification assessment in the participants’ responses was 38.
Since there were 24 Areas of Interest corresponding to the zones of author’s interdiscourse, there were 24 zones of author’s and characters’ interdiscourse or the units of analysis which manifested the change of participants and objects, change of time and location, change of type of relations among participants (
Stimulus:
Софья Васильевна. Но ведь в шляпе. В шляпе – заметьте! Отец семейства сорока пяти лет!
Sofja Vasiljevna. But in a hat. In a hat – notice! Father of the family of forty-five years old!
Experiment participant:
Другие сочли это смешным нелепым в том смысле, что человеку-то уже сорок…за сорок и это очень странно с его стороны;
Others found it funny ridiculous in a sense that a person is forty…over forty and it’s very odd for him.
We may notice the use of the following modifications: 1) generalization in participant’s construal (104): a person, others; 2) generalization in characteristics (503): a person is forty…over forty; it’s very odd for him. 3) objectivation (802): others found it <…>, a person is <…>, it’s very odd for him.
Experiment participant:
Потом добавляют, что снова, да и заметьте в шляпе отец семейства сорока пяти лет;
Then they add that again and yes notice in a hat head of the family of forty-five years old.
The fragment displays the following modifications: 1) exact characteristics (501): in a hat; 2) objectivation (902): they add; 3) reporting the event in the present (601); 4) indirect event reporting (603): yes notice in a hat head of the family of forty-five years old.
Experiment participant:
Главу семейства там, ему около сорока пяти лет;
Head of the family well… he is around forty-five.
Here the modifications are: 1) modification of characteristics (502): head of the family; around forty-five; 2) objectivation (902); 3) reporting the event in the present (601).
Experiment participant:
Рассказывает за столом об отце семейства.
At the table talks about father of the family.
The modifications include: 1) exact characteristics (501): father of the family; 2) space location (801): at the table; 3) objectivation (902); 4) reporting the event in the present (601).
Experiment participant:
Мужчину сорока пяти лет крайне странного эксцентричного поведения.
A man of forty-five of extremely odd eccentric behaviour.
We may notice here: 1) generalization in participant’s construal (104): a man; 2) exact characteristics (501): forty-five; 3) generalized characteristics (503): extremely eccentric behaviour; 4) objectivation (902).
Experiment participant:
Ему сорок пять лет и для его возраста вообще довольно странное поведение;
He is forty-five and for his age in general this is rather odd behaviour.
The modifications include: 1) exact characteristics (501): forty-five; 2) generalised characteristics (502): for his age in general this is rather odd behaviour; 4) objectivation (902): for his age <…>; 5) reporting the event in the present (601).
The given examples of stimulus modifications manifest common features for the participants, for instance mentioning exact characteristics (father of the family, forty-five years old, in a hat), generalized information about event (others found it funny ridiculous, it’s very odd for him, a man of extremely odd eccentric behavior), and objectivation (he is forty-five and for his age <…>, talks about father of the family, then they add). The differences appear in the use of generalization in participant’s construal (a person, a man), modification of the characteristics (head of the family), not exact characteristics (over forty, around forty-five). Contrastive analysis was then held applying R-Pearson to test the contingency between the relative modification values in two groups. The modifying parameters variance was then tested with One-Sample T-Test.
Results
R-Pearson of relative modification values of the Impulsives’ and the Reflectives’ responses is very high (r (36) = 0.96, p < 0.05), which suffices to claim that in general the modifications are similar.
The analysis of parametric activity has detected that the most active parameters for the impulsive respondents are mentioning of subject’s full name, use of lexeme with wider semantics, stating subject’s role in the play, generalized information about action, subjectivation and objectivation whereas for the reflective respondents the most prominent parameters turned out to be full name of subject, not full name of subject, modified subject’s name, use of lexeme with wider semantics, stating subject’s role in the play, exact action mentioning, generalized information about action. The two groups of respondents – impulsive and reflective – displayed similarity in such parametric activity as lack of subject’s mentioning in the narration, lack of action mentioning, present tense narration. The discourse profiles of relative mean values of modifications of the Impulsives and Reflectives are given in Figure
One Sample T-test has revealed the modifications displaying similarity in both groups (with p < 0.5). Thus, the almost identical data between the two groups of the respondents are found in the following modifications: giving full participant’s name (101) with t (36, 1) = 12.9 at p = 0.049, not mentioning the participant (109) with t (36, 1) = 864.44 at p < 0.001; generalized information of action (302) with t (36, 1) = 25.41 at p = 0.025, not mentioning the action (303) with t (36, 1) = 48.11 at p = 0.013. Several common modifications typical of the Impulsives and Reflectives can be demonstrated in the following example:
Stimulus:
Софья Васильевна. Я обомлела, когда вошла.
Все смеются ещё сильнее.
Sofia Vasilievna. I was dumbfounded when I entered.
Everybody is laughing more gaily.
Experiment participant (impulsive):
Все смеются. Вызывает у них смех.
Everybody is laughing. Causes their laughter.
Experiment participant (reflective):
Все смеются над этой ситуацией. Они обсуждают его странное поведение.
Everybody is laughing at this situation. They are discussing his strange behavior.
Both discourse fragments are similar in manifesting generalized information of action (302), since they both omit its repeated or rather continuous state in еще сильнее.
The following example displays the responses both giving full participant’s name (101) and generalized information of action (302):
Stimulus:
МАТЬ. (задумчиво). Да, пожалела… Его я пожалела. Правда, потом я всю жизнь проклинала себя за тогдашнюю свою жалость.
Пауза.
MOTHER. (thoughtfully). Yes, felt pity…felt pity for him. But afterwards I blamed myself for that pity the rest of my life.
Experiment participant (impulsive):
Мать заканчивает этот диалог говорит, что да раскаивается.
Mother finishes the dialogue, says yes she feels pity.
Experiment participant (reflective):
Мать говорит, что пожалела, да.
Mother says she felt pity, yes.
The variance the participants displayed was not statistically verified, however we may demonstrate some modifications which are more typical of either group. For instance, the differences are observed in the use of generalization in the participant’s construal (104), character specification (107), and generalized characteristics (503), which are both present more frequently in the Reflectives’ speech. These modifications display opposite construal processes, generalization and specification; however, they are manifested towards different event components. We may notice that the Reflectives give more specific characteristics about the participants and events; at the same time they also cope with making conclusions and providing generalizations. As for the Impulsives, they demonstrate more frequent use of lack of event mentioning (405), event construal in the present (601), and objectivation (902). These results suffice to claim that when the Impulsives construe the event they more often do not relate the contingent events following the main event line, make the event more dynamic by recounting it in the present, seldom presenting their personal opinion on the event as a whole.
The following example demonstrates this difference.
Stimulus:
Женский голос. Открой, детка, открой. Это я.
Витя открывает дверь, долго смотрит, затем впускает соседку Анну Степановну.
Анна Степановна (Обращается к Гране.) Девочка-то спит?
Woman’s voice. Open, baby, open. It’s me.
Nina opens the door, looks steadily for some time, then lets the neighbour Anna Stepanovna in.
Anna Stepanovna (addresses Granya). Is the girl sleeping?
Experiment participant (impulsive):
К ним прибегает Анна Степановна.
To them runs to my mind Anna Stepanova.
Experiment participant (impulsive):
Ей открывают. Она Анна Степановна.
The door is opened for her. She is Anna Stepanovna seems to me.
Experiment participant (reflective):
К ним стучится их соседка Анна Степановна э ээ её впускает Нина, э Степановна интересуется, как дела у их ребенка, как я понял.
Their neighbour is knocking the door er er Nina lets her in er Stepanovna asks how is their baby as far as I have understood.
Experiment participant (reflective):
Cоседка, работающая сторожем, пришла в семью Гавриловых, и э стала соответственно обсуждать ребёнка Гавриловых.
The neighbor working as a doorkeeper came to the family of the Gavrolovs, and er started consequently to discuss Gavrilovs’ child.
Experiment participant (reflective):
Здесь происходит встреча. Соседка приходит в гости к Гавриловым, это семья…э… и они, по-моему, разговаривают о детях.
Here there happens a meeting. The neighbour comes to meet the Gavrilovs, it is a family…er… and they it sems to me are talking about children.
The responses of the Impulsives display higher objectivation (902) since they do not involve any indicators of their personal opinion (in the responses of the Reflectives we see the subjectivation как я понял, по-моему). We may also notice that the responses of the Reflectives involve more microevents (это семья, работающая сторожем).
The gaze behavior’s results, and the results received from the participants’ responses suffice to formulate some ideas on the effects of graphological and semantic foregrounding onto the Impulsives and the Reflectives.
In terms of the effects of graphological foregrounding onto the gaze behavior of the Impulsives and the Reflectives, we may claim that our results support the assumption that higher impulsivity leads to higher inclination for exogenous attentional shifts, which is consistent with previous findings of increased distraction in attention deficit (
Higher AOI glances count in reflective subjects seemed unobvious, especially in light of the data, that text skimming (which would be a more natural strategy for impulsive subjects) is associated with AOI skipping (
In terms of the effects of semantic foregrounding onto the discourse responses of the Impulsives and the Reflectives, we can state that the Impulsives and the Reflectives demonstrated multiple similar modifications, especially in terms of giving full participant’s name, not mentioning the participant, generalized information of action, not mentioning the action. This observation confirms the consistency of construal theories in cognitive linguistics (
In this study, we explored the effects of foregrounding on speech and gaze behavior as presumably contingent on the participants’ cognitive styles, Reflexive and Impulsive. We considered two types of foregrounding, graphological (as a subtype of visual construal) and semantic (foregrounding in the construal of event, its participants and perspective) which were observed in drama text construal with multiple interdiscourse fragments (the discourse of author and participants) demonstrating evident typefont specifics.
The obtained data contribute to the research question of both eye movement patterns and speech patterns in different cognitive styles. While different effects were observed in wholistic/analytic cognitive styles (the wholistic group was characterized by fewer fixation and transition count than the analytic group) (
This research was supported by a Russian Foundation for Basic Research, project No. 20-012-00370 “Textual heterogeneity and the factors of its successful reading comprehension” and was carried out at the Centre for SocioCognitive Discourse Studies at Moscow State Linguistic University.