Multi-level processing of emotions in life motion signals 2 revealed through pupil responses

Abstract


Introduction
Perceiving and interpreting emotions from various social signals is critical for human social functioning, which enables us to infer the intentions of our conspecifics and further facilitates interpersonal interactions.Facial expressions present the most common non-verbal social communicative signals regarding others' affective states and intentions (C.Frith, 2009).In addition to faces, the movement of biological organisms serves as another essential type of social signal carrying significant emotional information, and this information remained salient even from a far distance (de Gelder, 2006).The human visual system is highly sensitive to such signals that we can readily decipher emotions from biological motion (BM), even when it was portrayed by several point lights attached to the major joints (Johansson, 1973;Troje, 2008).Moreover, it has been found that happy point-light walkers were recognized faster and more accurately than sad, angry or neutral walkers, demonstrating a happiness superiority (Lee & Kim, 2016;Spencer et al., 2016).While these studies provided some insights into the emotion processing mechanism of BM, they relied mainly on the explicit identification and active evaluation of BM emotions.Importantly, the encoding of emotional information also involves a rather automatic and implicit process that is independent of the participant's explicit identifications (Critchley et al., 2000;Lange et al., 2003;Okon-Singer et al., 2013;Shafer et al., 2012).Notably, this implicit aspect of emotion processing could be even more effective in probing individual differences and social deficits (Kana et al., 2015;Keifer et al., 2020;Kovarski et al., 2018;Wong et al., 2008), as it requires the intuitive processing of emotions that could not be learned (U.Frith, 2004).For example, research has shown that individuals with autistic disorders showed altered neural activities during implicit but not explicit emotion processing of natural scenes (Kana et al., 2015).These observations highlighted the importance of using objective measurements to investigate the implicit and automatic aspect of BM emotion processing.
The pupil response hence serves as a promising approach for reliably unfolding the implicit emotion processing of BM as it adds no extra task requirements to the cognitive process (Burley et al., 2017).In particular, pupil size is related to the activity of the automatic nervous system mediated by the locus coeruleus norepinephrine (LC-NE), which not only responds to physical light, but also reflects the underlying cognitive state (Joshi & Gold, 2019).Moreover, it could spontaneously capture the current subjective state and is thus useful for revealing the time course of the related cognitive processing (de Gee et al., 2014;Graves et al., 2021;Kloosterman et al., 2015;Oliva & Anikin, 2018).Recently, this measurement has been introduced to the field of emotion perception, and emerging evidence has suggested that emotions conveyed by social signals (e.g., faces, voices) could modulate pupil responses.For instance, happy and angry dynamic faces elicited a pupil dilation effect as compared with sad and neutral faces (Burley & Daughters, 2020;Prunty et al., 2021).Noticeably, the pointlight BM, as another critical type of social signal, also conveyed salient affective information.Besides, its emotion processing mechanism is closely connected with that of faces (Alaerts et al., 2011;Becker et al., 2011;Lee & Kim, 2016;Yuan et al., 2024).
However, it remains unequivocal whether the pupil also responds to the emotional information carried by the minimalistic point-light walker display.Such physiological observation can faithfully uncover the implicit emotion processing of BM, and it also expands the existing line of inquiry on the emotion processing of social cues.
To fill this gap, the current study implemented the pupil recording technique together with the passive viewing paradigm to explore the automatic and implicit emotion processing of BM.We first investigated the pupil responses to point-light walkers with different emotions (i.e., happy, sad, and neutral).In addition to intact emotional BM sequences, we also tested scrambled emotional BM sequences, which lack the gestalt of a global figure but preserve the same local motion components as the intact walkers.Recent studies have shown that such local motion signals play an essential role in conveying biologically salient information such as animacy, and walking direction (Chang & Troje, 2008, 2009;Troje & Westhoff, 2006).This study went further to investigate whether this local BM signal could convey emotional information and elicit corresponding pupil responses.Moreover, given that emotion perception from social signals is generally impaired in individuals with autism (Harms et al., 2010;Hubert et al., 2006), we also took the individual autistic traits into consideration by measuring the autistic tendencies in normal populations with the Autistic Quotient (AQ) questionnaire (Baron-Cohen et al., 2001).

Experiment 1a-b: Intact emotional BM
In Experiment 1a, we investigated whether emotional BM could automatically exert influences on pupil responses.Specifically, participants were instructed to passively view the intact happy/sad/neutral BM with their pupil responses being recorded simultaneously (see Fig. 1).A cluster-based permutation analysis was applied to illustrate the time course of emotional modulations on pupil responses.Results showed that the happy BM induced a significant pupil dilation effect than the neutral BM from 1750 ms to 3200 ms (see Fig. 2A).Conversely, the sad BM evoked a significantly smaller pupil response than the neutral BM, which starts from 1850 ms until the end of the stimulus presentation (see Fig. 2A).Moreover, the happy BM evoked a significantly larger pupil response as compared to the sad BM in a longstanding time window, ranging from 1200 ms until the disappearance of the display (see Fig. 2A).
We then computed the mean pupil size by collapsing the pupillometry across all time points, ranging from the onset of the stimuli to the end of the stimuli presentation.
Furthermore, in the second test, we've additionally observed a significant negative correlation between AQ and the happy minus neutral pupil dilation effect (r(23) = -0.44,p = .032,95% CI for the mean difference = [-0.72,-0.04], Fig. 4H), and a significant positive correlation between the sad minus neutral pupil size and AQ (r(23) = 0.50, p = .014,95% CI for the mean difference = [0.12,0.75], Fig. 4I).This indicated that the overall correlation between happy over sad dilation effect and AQ was the aggregate outcome of the diminished pupil modulations by happy and sad BM for high AQ individuals.
Overall, these results demonstrated a robust and replicable modulation of emotions embedded in the minimized point-light walker on pupil sizes: the happy BM evoked a larger pupil response than the neutral BM, while the sad BM evoked a smaller pupil size as compared to the neutral one.Importantly, a significant negative correlation between AQ and happy over sad pupil dilation effect was consistently found, and such effect was caused by a general attenuation in BM emotion perception sensitivity among individuals with high autistic tendencies.

Experiment 2: Inverted emotional BM
To rule out the possibility that the difference in low-level visual features rather than the emotional information per se might account for the obtained emotional modulation effect, we presented observers with the inverted BM stimuli that shared the exact perceptual features with their upright counterparts in Experiment 2. The cluster-based permutation analysis observed no significantly different time points among three emotional conditions (see Fig. 2B).An identical one-way repeated measures ANOVA was conducted, while no significant main effect of emotional condition on pupil responses was observed in inverted BM (F(2, 46) = 0.95, p = .396,ηp 2 = 0.04, Fig. 3D).

Experiment 3: Nonbiological Motion
Given the ample evidence showing that local motion feature is essential for the perception of biologically significant information from BM (Chang & Troje, 2008, 2009;Troje & Westhoff, 2006;L. Wang & Jiang, 2012), we moved forward to explore the role of local motion feature in the emotion processing of BM.In Experiment 3, we presented observers with non-BM stimuli, which were derived from the fragments identical to emotional BM but with critical local characteristics removed (Chang & Troje, 2009).The permutation analysis found no significantly different time points in pupil responses to the happy, sad, and neutral conditions (see Fig. 2D).Results of the one-way repeated ANOVA on the average pupil sizes also showed no significant main effect of emotional condition (F(1.6,35.7) = 0.02, p = .964,ηp 2 = 0.00; Greenhouse-Geisser corrected, see Fig. 3C).Similarly, no pupil modulation effects significantly correlated with AQ (AQ with happy-sad pupil size: r(23) = -0.03,p = .896,95% CI for the mean difference = [-0.43, 0.38]; AQ with happy-neutral pupil size: r(23) = 0.01, p = .956,95% CI for the mean difference = [-0.39,0.41]; AQ with sad-neutral pupil size: r(23) = 0.06, p = .777,95% CI for the mean difference = [-0.35,0.45]).Moreover, combining the results obtained from Experiment 1a and Experiment 3, we found a significant interaction between stimulus type (intact, nonbiological) and emotional condition (happy, sad, neutral) (F(2, 92) = 3.22, p = .045,ηp 2 = 0.07), which was caused by the lack of emotional modulation in nonbiological stimuli.These findings together showed that the removal of local characteristics greatly disrupted the emotional modulations on observers' pupil responses, providing conceivable evidence for the critical contribution of local motion features in emotion perception from the BM signal.

Experiment 4: Local emotional BM
In Experiment 4, we went further to examine whether local BM alone could carry emotional information and exert a similar modulation effect on pupil size.In particular, we adopted the well-established local BM stimuli, the scrambled BM, whose local motion feature was retained while the global configuration information was completely disrupted.Both the explicit and implicit emotion processing of the scrambled BM were investigated to provide a thorough view of emotion perception from local BM.Specifically, a group of observers viewed the scrambled BM and made explicit behavioral judgments on the emotional information contained in the scrambled BM.
The results showed that observers could successfully recognize the emotions contained in scrambled BMs with the average accuracy reaching significantly above 50% (M ± SD = 83% ± 2.8%, p < .001).This indicated that scrambled BM conveyed recognizable emotional information.Furthermore, we investigated the pupil responses to scrambled happy, sad, and neutral BMs to explore the automatic and implicit processing of local emotional BM.
The consecutive cluster-based permutation analysis further showed that both the scrambled happy and sad BM evoked larger pupil sizes than the scrambled neutral BM.
Moreover, no difference in pupil size is observed between the happy and sad conditions (t(23) = -0.07,p = .948,Cohen's d = 0.01, 95% CI for the mean difference = [-0.23,0.24]; Holm-corrected, p = 1.000 after Bonferroni correction, Fig. 3F).The observed effect could not be accounted for by perceptual differences (e.g., speed), as the happy and sad scrambled BM differed the most in low-level features, whereas they induced similar dilation effects on pupil sizes.Again, no significant correlations were observed between AQ and pupil modulation effects (AQ with happy-sad pupil size: r(23) = -0.21,p = .32,95% CI for the mean difference = [-0.57,0.21]; AQ with happy-neutral pupil size: r(23) = -0.13,p = .56,95% CI for the mean difference = [-0.50,0.29]; AQ with sad-neutral pupil size: r(23) = 0.13, p = .56,95% CI for the mean difference = [-0.29,0.50]).Importantly, a mixed 2 (BM type: intact, local) × 3 (emotional condition: happy, sad, neutral) ANOVA on average pupil size was conducted to examine whether or not this emotional modulation effect of local BM varied from that of intact BM reported in Experiment 1a-b.Results revealed a significant interaction between BM type and emotional condition (F(2, 92) = 7.76, p < .001,ηp 2 = 0.14), indicating that emotions in intact and local BM exerted differential modulations on pupil size.This interaction is primarily driven by the vanishment of pupil modulation between happy and sad local BM.Overall, these findings showed that the local BM could convey significant emotional information, which could induce a pupil dilation effect regardless of its exact type.As compared to the intact BM, the emotional modulation observed in local BM is different because it occurs faster and is rather coarse.

Discussion
Life motion signals convey salient emotional information that is crucial for human survival and social interactions (Johansson, 1973;Troje, 2008).Here, we reported that such emotional clues carried by the point-light BM walker could exert a modulation effect on pupil responses.Specifically, the happy BM significantly dilated pupils as compared to the neutral BM, and the sad BM evoked smaller pupil responses than the neutral BM, showing distinct emotional modulations on pupil responses that depend on the emotional contents.Moreover, this emotional modulation of pupil responses could not be explained by the low-level differences, as viewing inverted BMs failed to induce such effects.Importantly, when the emotional BM was deprived of the local motion feature through the removal of accelerations, it failed to induce any modulation on pupil responses.Furthermore, the scrambled emotional BM with only the local motion feature retained could still produce a modulation effect on pupil size.Noticeably, this modulation is rapid but rather coarse: viewing the scrambled happy and sad BM would evoke greater pupil size than the scrambled neutral BM in a relatively early time window, while no significant difference was observed between the scrambled happy and sad BM.Taken together, these findings revealed multi-level processing of emotions in life motion signals: the global emotional BM modulated pupil size in a fine-grained manner that discriminates each type of emotion, and the local emotional BM exerted a coarse but rapid modulation on pupil size.
The emotion processing of BM has been investigated in former studies using explicit behavioral detection and recognition paradigm.It has been reported that happy BM is more rapidly identified and detected as compared to sad and neutral BM (Actis-Grosso et al., 2015; Lee & Kim, 2016;Spencer et al., 2016), while other research observed no such superiority (Chouchourelou et al., 2006).Here, the present study adopted the novel and objective pupillometry index to investigate the emotion processing of BM from a physiological aspect.The pupil index, as a direct reflection of individual arousal level and cognitive state, served as a powerful tool for faithfully and automatically reflecting the implicit processing of emotions in BM.Previous studies have reported larger pupil responses towards emotional images as compared to neutral images, with no significant differences observed between the positive and negative conditions (Bradley & Lang, 2015;Bradley et al., 2008;Snowden et al., 2016).However, these studies mostly adopted complex emotional scene images that conveyed rather general emotional information.When it comes to the specific emotion cues (e.g., happy, sad) delivered by our conspecifics through biologically salient signals (e.g., faces, gestures, voices), the results became intermixed.Some studies reported pupil dilatory effects towards fearful, disgusted, angry, sad faces but not happy faces (Burley et al., 2017).On the contrary, other studies observed larger pupil responses for happy as compared to sad, fearful, and surprised faces (Aktar et al., 2018;Burley & Daughters, 2020;Jessen et al., 2016;Prunty et al., 2021).These conflicting results could be due to the low-level confounds of emotional faces (e.g., eye size) (Carsten et al., 2019;Harrison et al., 2006).Similar to faces, BM also conveyed salient clues concerning the emotional states of our interactive partners.However, they were highly simplified, and deprived of various irrelevant visual confounders (e.g., body shape).Here, we reported that the happy BM induced a stronger pupil response than the neutral and sad BM, lending support to the happy dilation effect observed with faces (Burley & Daughters, 2020;Prunty et al., 2021).Moreover, it helps ameliorate the concern regarding the low-level confounding factors by identifying similar pupil modulations in another type of social signal with distinctive perceptual features.
It has long been documented that pupil size reflects the degree of cognitive effort and attention input (Joshi & Gold, 2019;van der Wel & van Steenbergen, 2018), and indexes the noradrenalin activity in emotion processing structures like amygdala (Dal Monte et al., 2015;Harrison et al., 2006;Liddell et al., 2005).Thus, the happy dilation effect suggests that the happy BM may be more effective in capturing attention and evoking emotional arousal than the neutral and sad BM, which echoes with the happiness superiority reported in the explicit processing of BM (Lee & Kim, 2016;Spencer et al., 2016;Yuan et al., 2023).Instead, the sad constriction effect potentially indicates a disadvantage for sad BM in attracting visual attention and evoking emotional arousal than neutral BM.In line with this, it has been found that infants looked more at the happy BM walker when displayed in pair with the neutral walker, whereas they attended less to the sad walker as compared to the neutral one (Ogren et al., 2019).Besides, it has been revealed by neural studies that, the happy emotion evoked stronger activities in emotionally relevant brain regions including the amygdala, the extrastriate body area (EBA), and the fusiform body area (FBA), while the sad emotion failed to induce such effects (Peelen et al., 2007;Ross et al., 2019).Still, future studies are needed to provide further evidence regarding the happy advantage and the sad disadvantage in attracting visual attention.For example, in addition to pupil size, the microsaccades also provided valuable insights into attention processes (Baumeler et al., 2020;Engbert & Kliegl, 2003;Meyberg et al., 2017), and potentially involved shared neural circuits with pupil responses (Hafed et al., 2009;Hafed & Krauzlis, 2012; C.-A. Wang et al., 2012).Future studies could combine the microsaccade index with pupil size to provide a more thorough understanding of BM emotion processing.
Notably, the happy over sad dilation effect was negatively correlated with autistic traits: individuals with greater autistic tendencies showed decreased sensitivities to emotions in BM.In fact, the perception of biological motion (BM) has long been considered an important hallmark of social cognition, and abundant studies reported that individuals with social cognitive deficits (e.g., ASD) were impaired in BM perception (Blake et al., 2003;Freitag et al., 2008;Klin et al., 2009;Nackaerts et al., 2012).More recently, it has been pointed out that the extraction of more complex social information (e.g., emotions, intentions) from BM, as compared to basic BM recognitions, could be more effective in detecting ASDs (Federici et al., 2020;Koldewyn et al., 2009;Parron et al., 2008;Todorova et al., 2019).Specifically, a metaanalysis found that the effect size expanded nearly twice when the task required emotion recognition as compared to simple perception/detection (Todorova et al., 2019).
However, for the high-functioning ASD individuals, it has been reported that they showed comparable performance with the control group in explicitly labelling BM emotions, while their responses were rather delayed (Mazzoni et al., 2021).This suggests that ASD individuals could adopt compensatory strategies to complete the explicit BM labelling task, while their automatic responses remained impaired.Such an observation highlights the importance of using more objective measures that do not rely on subjective reports to investigate the intrinsic perception of emotions from BM and its relationship with ASD-related social deficits.The current study thus introduced pupil size measurement to this field, and we combined it with the passive viewing task to investigate the more automatic aspect of BM emotion processing.In addition to diagnostic ASDs, the non-clinical general population also manifested autistic tendencies that followed normal distribution and demonstrated substantial heritability (Hoekstra et al., 2007).Here, we focused on the autistic tendencies in the general population, and our results showed that the automatic emotion processing of BM stimuli was impaired in individuals with high autistic tendencies, lending support to previous studies (Hubert et al., 2006;Nackaerts et al., 2012;Parron et al., 2008).The more detailed test-retest examination further confirmed such a correlation and illustrated a general diminishment in BM emotion perception ability (happy and sad) for high AQ individuals.Given that pupil measurement does not require any explicit verbal reports, it is easily attainable in children and even infants.Thus, the pupil modulation effect obtained here may serve as a sensitive and reliable physiological marker for detecting early social cognitive disorders in both clinical and non-clinical populations.
Remarkably, our findings highlighted the central role of local motion feature in modulating pupil responses towards emotional information contained in BM.Previous studies have shown that human visual system is highly sensitive to the local BM stimulus, whose global configural information is completely deprived through spatially scrambling (Troje & Westhoff, 2006).For example, it has been demonstrated that scrambled BM could perform as intact BM in lengthening subjective temporal perception (L.Wang & Jiang, 2012).Besides, such local motion feature also served as a basic pre-attentive feature in visual search (L.Wang et al., 2010) and could further induce a significant reflexive attentional effect (L. Wang et al., 2014;Yu et al., 2020).
Moreover, the deprivation of the local BM feature would greatly disrupt the perception of the contained biologically salient information, such as animacy and walking direction (Chang & Troje, 2008, 2009;Yu et al., 2020).Here, we extended this line of research to the emotional domain by demonstrating that the local BM component is also critical for the processing of emotional information: when the local BM feature is disrupted, the modulation of emotions on pupil size completely disappears.
Furthermore, the emotional BM that retained only local motion features could still exert a salient modulation effect on pupil size.In particular, the happy and sad local BM induced a significant pupil dilation effect as compared to the neutral local BM stimuli.
Intriguingly, this dilation effect is independent of the specific emotion category but reflects a general activation caused by the affective salient information.In addition, this non-selective pupil dilation effect in local BM appeared in a relatively early time window, indicating that the extraction of emotions from local BM is rapid.Taken together, these findings identified a coarse but rapid emotion processing mechanism in local BM that could promptly detect the emotional information therein without the aid of the global shape.Moreover, our findings revealed the existence of distinct emotional modulations in intact and local BM, respectively, as evidenced by variations in pupil responses.In particular, the happy intact BM induced a significant pupil dilation effect as compared to the neutral one, whereas the sad intact BM led to pupil constriction.Interestingly, both the happy and sad local BM resulted in pupil dilation effects relative to the neutral local BM, and such effect occurred at a relatively early time point.This distinctive pupil modulation effects observed in intact and local BM could be elucidated by a multi-level emotion processing mechanism.Specifically, even though both the intact and local BM conveyed important life information, the local BM is deprived of the global configural information (Chang & Troje, 2008, 2009;Simion et al., 2008).Thus, its emotion processing potentially occurred at a more basic and preliminary level, responding to the general affective salient information without engaging in further detailed analysis.
Importantly, similar dissociated emotion processing phenomenon has been observed in another important type of emotional signal with analogous function (i.e., facial expression).For example, happy and fearful faces induced differential amygdala activations when perceived consciously, yet they induced comparable amygdala activations when suppressed (Williams et al., 2004).Moreover, it has been argued that there exist two parallel pathways for facial expression processing: a slow route that conveys fine-grained facial features along cortical areas to the amygdala, and a rapid subcortical pathway that directly transfers emotional information to amygdala without detailed analysis, which is known as the "quick and dirty" route (Garrido et al., 2012;Johnson, 2005;Méndez-Bértolo et al., 2016;Vuilleumier et al., 2003).It is probable that the emotion processing of the local and intact point-light BM potentially functions in a manner similar to that of the faces, with the former serving as a primary detection mechanism that automatically captures emotionally significant information conveyed by animate agents without detailed analysis, and the latter aiding in more specific emotion identification based on fine-grained analyses of their motion pattern and global shape.Compatible with this view, recent studies have reported that the emotion processing of face and BM was very similar.For example, they both showed a happiness superiority in visual detection (Becker et al., 2011;Lee & Kim, 2016;Nackaerts et al., 2012) and guiding social attention (Yuan et al., 2023).Moreover, their emotion processing involved potentially overlapping brain regions (e.g., amygdala, STS) (Alaerts et al., 2014;Engell & Haxby, 2007;Peelen et al., 2007;Pessoa & Adolphs, 2010).Overall, our findings, together with the former evidence, suggest dissociated emotion processing for BM in the human brain akin to the dual-route model reported in faces, and further imply a general "emotional brain" that can be shared by different types of social signals.Still, future studies are needed to implement neuroimaging techniques to directly identify the brain regions involved in the emotion processing of local and global BM signals.
To conclude, the current study clearly demonstrated that the emotional information conveyed by point-light BM modulated pupil responses.The intact BM exerted a finegrained emotional modulation on pupil sizes, while disrupting the contained local motion characteristic would deteriorate the observed modulations.Moreover, BM with only local motion features retained could exert a fast but rather coarse modulation on pupillometry.These findings together highlight the critical role of local motion feature in BM emotion processing, and further reveal the multi-level emotion processing of BM.Notably, the observed emotional modulation in intact BM is associated with individual autistic traits, suggesting the potential of utilizing the emotion-modulated pupil responses to facilitate the diagnosis of social cognitive disorders.

Participants
A total of 144 participants (52 males, 92 females) ranging from 18 to 30 years old (M ± SD = 23.0 ± 2.6) were recruited, with 24 in Experiment 1a, 24 in Experiment 1b, 24 in Experiment 2, 24 in Experiment 3, 24 in the behavioral part of Experiment 4, and 24 in the eye recoding part of Experiment 4. All of the participants had normal or corrected-to-normal vision and gave written informed consent in accordance with the procedure and protocols approved by the institutional review board of the Institute of Psychology, Chinese Academy of Sciences.They were all naïve to the purpose of the experiments.Prior power analyses (F tests, repeated measures, within factors) using G*Power (Version 3.1.9.4; (Faul et al., 2007)) indicated that a sample size of 24 participants would afford 80% power with alpha at .05 to detect a moderate main effect (f = 0.27).This sample size was comparable to previous studies with similar designs (Nakakoga et al., 2020).

Stimuli
Stimuli were displayed using MATLAB (Mathworks, Inc.) together with the Psychtoolbox extensions (Brainard, 1997;Pelli, 1997) on a 23-inch LED monitor (1920 × 1080 at 60 Hz) with gray background (RGB: 100, 100, 100).The biological motion (BM) stimuli were adopted from Troje (Troje, 2008).Each comprised 15 point-light dots depicting the motions of the head, pelvis, thorax and major joints (i.e., shoulders, elbows, wrists, hips, knees, and ankles).Its emotional state was indexed by a normalized Z score on an axis that reflects the differences between happy and sad walkers in terms of a linear classifier.The scores were computed within a 10dimensional sub-space spanned by the first 10 principal components based on a Fourierbased representation of observers' emotional ratings of 80 actual walkers (half male) (Troje, 2008).We adopted the neutral walker that scored 0 on the linear axis, together with the happy walker 6 SDs into the happy part of the axis and the sad walker 6 SDs into the sad part of the axis (see https://www.biomotionlab.ca/html5-bml-walker/ for an interactive animation).Besides, we turned the BM walkers 45 degrees leftwards or rightwards to maximize the visibility of expressive bodily cues (Roether et al., 2009).
In Experiment 1a-1b, the upright emotional (happy, sad, or neutral) BM walkers with two walking directions (45°leftwards or rightwards) were used.The velocity was 5.76 pixels/frame for the happy BM, 4.14 pixels/frame for the neutral BM, and 3.21 pixels/frame for the sad BM.This difference in velocity profile was considered an important signature for conveying emotional information, as the happy walker was characterized by a larger step pace and longer arm swing, and the sad walker would scrambled emotional BM stimuli, and investigated both the explicit and the implicit emotion processing of scrambled BM.Note that a group of participants was recruited to perform emotional judgments on the scrambled BM in order to investigate whether the emotional information carried by local BM signals could be explicitly identified.
Another group of participants was enrolled for the pupil recording experiment, which followed the identical experimental procedure of Experiments 1-3.At the end of all experiments, participants were required to complete the 50-point Autism-spectrum Questionnaire (AQ), which measured the degree of autistic traits in the normal population (Baron-Cohen et al., 2001).

Data Analysis
The raw pupil data for each trial was first screened to remove eye blinks (either replaced by linear interpolation or with this trial discarded).Then, trials with pupil size deviating ±3 SDs from the mean were excluded from further analysis.Finally, the pupil size data were down-sampled to 20 Hz and baseline-corrected for each trial by subtracting the mean pupil size during the 200 ms pre-stimulus period.We computed the average pupil size for each emotional condition (happy, sad, or neutral) obtained by collapsing the pupillometry across all time points.Besides, to depict the time course of pupil responses towards emotional BM, we further conducted a consecutive paired-sample t-test across all time points comparing different emotional conditions.The cluster-based permutation analysis was applied to avoid potential problems brought about by multiple comparisons (Einhauser et al., 2008).In this analysis, the computed t-values neighboring in time that exceeded a threshold (p < 0.05) were defined as clusters, and then summed to produce a cluster mass.The cluster mass was compared with a null distribution, which was generated by 2000 random permutations of the pupil data from different conditions.If the cluster mass fell beyond 95% of the null distribution (α = 0.05), it was deemed to be statistically significantly different (Einhauser et al., 2008).
The pupil size was analyzed and reported in arbitrary units (a.u.) without transforming into the actual unit (mm), as the relative change of the pupil size was of main interest.Yuan, T., Wang, L., & Jiang, Y. (2024).Cross-channel adaptation reveals shared emotion representation from face and biological motion.Emotion, in press.In the second test, the negative correlation between happy over sad pupil dilation effect and AQ was similarly observed and even stronger.(H-I) Moreover, we've additionally observed a significant positive correlation between AQ and the happy minus neutral pupil dilation effect, and a significant negative correlation between AQ and the sad minus neutral pupil constriction effect.

Fig. 1 .
Fig. 1.Schematic representation of the experimental procedure and the stimuli in Experiment 1a.A happy/sad/neutral BM walker turning 45 degrees leftwards or rightwards was presented at the center of the screen for 4000 ms.Participants were instructed to maintain their fixation on the BM stimuli during stimulus presentation and to continue the procedure through key pressing.

Fig. 2 .
Fig. 2. Time course of pupil responses to happy, sad, and neutral BM in Experiments 1-4.Solid lines represent pupil diameter under each emotional condition as a function of time (happy: red; sad: blue; neutral: gray); shaded areas represent the SEM between participants; colored horizontal lines indicate periods during which there are statistically significant differences among conditions at p <0.05; and black horizontal lines indicate significant differences after cluster-based permutation correction.All the pupil data are in arbitrary units (a.u.) (A) In Experiment 1a, the happy BM evoked larger pupil response as compared to the sad and neutral BM, and the sad BM evoked smaller pupil size than the neutral BM. (B) In Experiment 2, the inverted BM failed to produce such emotional modulation effects.(C) In Experiment 3, the emotional BM that is deprived of the local motion feature exerted no emotional modulation on pupil responses.(D) In Experiment 4, both the happy and sad local BM induced a larger pupil response than the neutral local BM, and such dilation effect started from a relatively early time point.

Fig. 3 .
Fig. 3. Normalized mean pupil responses using the neutral condition as baseline, plotted against happy and sad conditions, and the relevant correlation.(A) In Experiment 1a, the group average pupil response to happy intact BM is significantly larger than that to sad and neutral BM, while the pupil size induced by sad BM is significantly smaller than that evoked by neutral BM. (B-C) Moreover, such an emotional modulation on pupil sizes was again identified in the test and retest of the replication experiment (Experiment 1b).(D) In Experiment 2, no significant differences in pupil responses were observed for inverted BM. (E) In Experiment 3, when the biological characteristic was deprived from the emotional BM, it failed to induce any modulations on pupil sizes.(F) In Experiment 4, both the happy and sad local BM induced a significantly larger pupil size than neutral local BM, with no significant difference between the happy and sad condition.All the pupil data are in arbitrary units (a.u.).Each point represents one individual data.Error bars showed standard errors of the mean.* p < .05,** p < .01.

Fig. 4 .
Fig. 4. Correlation results for pupil modulations and AQ scores in Experiment 1a and its replication experiment (Experiment 1b).(A) In Experiment 1a, a significant negative correlation was found between the happy over sad pupil dilation effect and individual autistic quotient (AQ).(B-C) No other significant correlations were found.(D-F) The first test of Experiment 1b replicated the negative correlation between happy over sad pupil dilation effect and AQ.Similarly, no other significant correlations were found.(G)

--
p y -N e u t r a l S a d -N e u t r a l p y -N e u t r a l S a d -N e u t r a l p y -N e u t r a l S a d -N e u t r a