Elsevier

Neural Networks

Volume 11, Issues 7–8, October–November 1998, Pages 1345-1356
Neural Networks

1998 Special Issue
Serial processing in human movement production

https://doi.org/10.1016/S0893-6080(98)00083-5Get rights and content

Abstract

Parallel processing is often considered to be synonymous with biological computation, but a great deal of evidence points to serial computation being used by animals to solve specific types of problems. In particular, the observation of movement intermittency (fluctuations in limb kinematic variables that cannot be explained by low-level dynamics of the system) seems to imply a serial temporal segmentation strategy in the planning of arm movements. This paper discusses prior observations of movement intermittency in different task contexts, possible theoretical and physiological origins of the phenomenon, and implications for human movement strategies.

Introduction

Extensive parallel processing is considered the hallmark of biological computation. Dissection reveals neural elements that are massively interconnected, and it is well known that animals are capable of solving formidable computational problems (in image processing, for example) that are ill-suited to serial computation methods. The computational systems of animals exhibit in many cases `graceful degradation', that is, the removal of a small set of elements has only a minimal impact on computation capability—further evidence of parallel computation.

Biological systems are often simulated using parallel distributed processing (PDP) models. These models feature large numbers of elements that are interconnected in circuits; the effect of one element's activity upon another is a function both of the element's output level as well as the strength of the connection. PDP models (and in particular layered network models) have been successful not because they are likely to be replicas of actual processing in the nervous system, but because they illustrate the types of operations that can be performed by networks of interconnected units. These networks also process data in parallel, have been demonstrated to solve problems of high complexity (Arbib, 1995), and like biological systems also exhibit graceful degradation.

But despite all the evidence for parallel computation in animals, certain behavioural phenomena hint strongly at serial computation being used to solve certain types of problems. Human communication, for example, involves sequentially stringing together groups of phonemes. It is extremely difficult to listen to more than one speaker at a time, even when they all can be heard quite clearly. A similar limitation occurs with visual stimuli. Although visual processing no doubt involves much parallel computation, the mechanism of selective attention forces us to concentrate on only one visual stimulus in the foreground; we are only dimly aware of the background, and so we can only focus on objects in a serial fashion.1 Yet another example is mental rotation. Shepard discovered (Shepard and Cooper, 1982) that the time taken for mental rotation of three-dimensional shapes to perform a matching task was proportional to the amount of rotation. This implies that the mental rotations were probably performed sequentially; several mental rotation angles could not be attempted simultaneously.

This paper will concentrate on one example of serial computation: the apparent `temporal segmentation' of motor behavior, the idea that humans generate long or complex movements by piecing together shorter or simpler movements. Humans appear to have difficulty moving smoothly to an accurately specified target posture; instead they seem to break the task up by sequentially moving to several postures, each successive one being closer to the target posture. In addition, humans appear significantly limited in their ability to move slowly and smoothly, even when no target is specified. This may imply that movement itself is nothing more than sequential transitions between postures. In both of these cases, the behavior demonstrates a time-series of events, implying an event `decision-maker' upstream that computes its results serially.

Section snippets

Background

Our work in this area began with trying to quantitatively measure arm prosthesis performance (Doeringer and Hogan, 1995). In this study, we examined users of the most popular type of above elbow arm prosthesis—the cable operated model, whose basic design has remained unchanged since the second world war. All subjects were impaired only on one side, and so we were able to directly compare performance of the prosthesis and the unimpaired arm in several laboratory tasks.

First we looked at

Origins of temporal segmentation

What could be the origin of temporal segmentation? One important difference between the human limb controller and simple robot controllers is the presence of large feedback delays in the human case. Could feedback delays be responsible for apparent temporal segmentation?

Fig. 4 demonstrates that a feedback-controlled system becomes more oscillatory as the feedback delay is increased. However, the nonsmooth nature of this system is very different from that of the human. First off, the

Implications of temporal segmentation2

The observation of temporal segmentation suggests episodic or intermittent communication from a central movement planner to the periphery, and communication in the opposite direction (from the periphery to the planner) might be episodic as well. In other words, the central planner may only be aware of movement error when it rises above a threshold. The situation is analogous to answering the front door of a house: one can either stare out the window waiting for visitors to appear, or one can

Conclusion

Peripheral musculo-skeletal mechanics and dynamics are clearly important for movement production. The intrinsic behavior of muscles allow them to remain unsupervised for significant periods of time, and the delays implicit in both the efferent and afferent pathways limit the utility of conventional control approaches. The serial computation that seems to be observed in movement production may actually be allowing the system a much higher degree of behavioral performance than would otherwise be

Acknowledgements

This research was performed in the Eric P. and Evelyn E. Newman Laboratory for Biomechanics and Human Rehabilitation at MIT and was supported by National Institute of Health grant No. AR40029.

References (93)

  • W. Abend et al.

    Human arm trajectory formation

    Brain

    (1982)
  • Akazawa, K., & Milner, T. (1981). Modulation of the stretch reflex in human finger muscle. In Proceedings of the...
  • E. Antonsson et al.

    The frequency content of gait

    Journal of Biomechanics

    (1985)
  • Arbib, M. (Ed.). (1995). The handbook of brain theory and neural networks. Cambridge, MA: MIT...
  • G. Bekey

    The human operator as a sampled-data system

    I.R.E. Transactions on Human Factors in Electronics HFE-

    (1962)
  • G. Bekey et al.

    Identification of sampling intervals in sampled-data models of human operators

    IEEE Transactions on Man-Machine Systems

    (1968)
  • N. Berthier et al.

    Distributed representation of limb motor programs in arrays of adjustable pattern generators

    Journal of Cognitive Neuroscience

    (1993)
  • Billian, C., & Zahalak, G. (1983). A programmable limb testing system and some measurements of intrinsic muscular and...
  • E. Bizzi et al.

    Posture control and trajectory formation during arm movement

    Journal of Neuroscience

    (1984)
  • E. Bizzi et al.

    Mechanical properties of muscles: Implications for motor control

    Trends in Neuroscience

    (1982)
  • E. Bizzi et al.

    Effect of load disturbances during centrally initiated movements

    Journal of Neurophysiology

    (1978)
  • E. Bizzi et al.

    Modular organization of motor behavior in the frog's spinal cord

    Trends in Neuroscience

    (1995)
  • T. Brown

    The intrinsic factors in the act of progression in the mammal

    Proceedings of the Royal Society of London (Biology)

    (1911)
  • T. Brown

    On the nature of the fundamental activity of the nervous centres; together with an analysis of the conditioning of rhythmic activity in progression, and a theory of evolution of function in the nervous system

    Journal of Physiology (London)

    (1914)
  • J. Colgate et al.

    Robust control of dynamically interacting systems

    International Journal of Control

    (1988)
  • J. Cooke

    Dependence of human arm movements on limb mechanical properties

    Brain Research

    (1979)
  • P. Crago et al.

    Regulatory actions of the human stretch reflex

    Journal of Neurophysiology

    (1976)
  • J. Doeringer et al.

    Performance of above elbow body-powered prostheses in visually guided unconstrained motion tasks

    IEEE Transactions on Biomedical Engineering

    (1995)
  • J. Dufresne et al.

    Electromyographic response to pseudo-random torque disturbances of human forearm position

    Neuroscience

    (1978)
  • J. Dufresne et al.

    Modulation of the myotatic reflex gain in man during intentional movements

    Brain Research

    (1980)
  • E. Evarts et al.

    Gating of motor cortex reflexes by prior instruction

    Brain Research

    (1974)
  • Fasse, E. (1987). Stability robustness of impedance controlled manipulators coupled to passive environments....
  • A. Feldman

    Functional tuning of the nervous system during control of movement or maintenance of a steady posture. III. Mechanographic analysis of the execution by man of the simplest motor tasks

    Biophysics

    (1966)
  • J. Flanagan et al.

    Trajectory adaptation to a nonlinear visuomotor transformation: Evidence of motion planning in visually perceived space

    Journal of Neurophysiology

    (1995)
  • R. Gellman et al.

    Inferior olivary neurons in the awake cat: Detection of contact and passive body displacement

    Journal of Neurophysiology

    (1985)
  • Ghez, C. (1991). The control of movement. In E. Kandel, J. Schwartz, & T. Jessell (Eds.), Principles of neural science...
  • C. Ghez et al.

    Roles of proprioceptive input in the programming of arm trajectories

    Cold Spring Harbor Symposia on Quantitative Biology

    (1990)
  • P. Gilbert et al.

    Purkinje cell activity during motor learning

    Brain Research

    (1977)
  • Giszter, S. (1994). Reinforcement tuning of action synthesis and selection in a `virtual frog'. In D. Cliff, P....
  • G. Gottlieb et al.

    Dependence of human ankle compliance on joint angle

    Journal of Biomechanics

    (1978)
  • P. Gribble et al.

    Are complex control signals required for human arm movement?

    Journal of Neurophysiology

    (1998)
  • Grillner, S. (1981). Control of locomotion in bipeds, tetrapods, and fish. In V. Brooks (Ed.), Handbook of physiology:...
  • S. Grillner et al.

    The role of muscle stiffness in meeting the changing postural and locomotor requirements for force development by the ankle extensors

    Acta Physiologica Scandinavica

    (1972)
  • S. Grillner et al.

    On the descending control of the lumbosacral spinal cord from the `mesencephalic locomotor region'

    Acta Physiologica Scandinavica

    (1973)
  • P. Hammond

    The influence of prior instruction to the subject on an apparently involuntary neuromuscular response

    Journal of Physiology (London)

    (1956)
  • Henis, E. (1991). Strategies underlying arm trajectory modification during reaching toward visual targets. Unpublished...
  • J. Hoffer et al.

    Regulation of soleus muscle stiffness in premammillary cats: Intrinsic and reflex components

    Journal of Neurophysiology

    (1981)
  • N. Hogan

    Adaptive control of mechanical impedance by coactivation of antagonist muscles

    IEEE Transactions on Automatic Control

    (1984)
  • N. Hogan

    Impedance control: An approach to manipulation. Part I—theory, Part II—implementation, Part III—applications

    Journal of Dynamic Systems, Measurement, and Control

    (1985)
  • Hogan, N. (1987). Stable execution of contact tasks using impedance control. In Proceedings of the IEEE conference on...
  • Hogan, N. (1990). Mechanical impedance of single- and multi-articular systems. In J. Winters, & S. Woo (Eds.), Multiple...
  • Horowitz, P., & Hill, W. (1989). The art of electronics. Cambridge: Cambridge University...
  • J. Houk

    Regulation of stiffness by skeletomotor reflexes

    Annual Review of Physiology

    (1979)
  • Houk, J., & Barto, A. (1992). Distributed sensorimotor learning. In G. Stelmach, & J. Requin (Eds.). Tutorials in motor...
  • D. Humphrey et al.

    Separate cortical systems for the control of joint movement and joint stiffness: Reciprocal activation and coactivation of antagonist muscles

    Advances in Neurology

    (1983)
  • I. Hunter et al.

    Dynamics of human ankle stiffness: Variation with mean ankle torque

    Journal of Biomechanics

    (1982)
  • Cited by (30)

    • Human and robotic movement in the air

      2020, Computers and Electrical Engineering
    • Control of constraint forces and trajectories in a rich sensory and actuation environment

      2010, Mathematical Biosciences
      Citation Excerpt :

      The work here relates to the general area of turning a crank (see [30, Fig. 7.4, p. 175]). Drawing circles by hand is a related topic [31]. The authors also have many perspectives on human movement and its neural implementation.

    • On the role and origin of isochrony in human rhythmic entrainment

      2009, Cortex
      Citation Excerpt :

      Rather, it refers to the segmentation of infant limb and body movements into irregularly timed and directed subtrajectories, graphic examples of which may be found in the work of von Hofsten (von Hofsten, 1979, 1991; von Hofsten and Rönnquist, 1993). The dimensionality of such movements indicates that their irregular statistics are actively generated rather than random fluctuations (Robertson et al., 2001; see also Doeringer and Hogan, 1998). This at first sight counterproductive mode of movement may in fact provide the search space for a developmental mechanism dedicated to learning efficient movement trajectories by a process of selection (see Thelen and Corbetta, 1994; Rohrer et al., 2004).

    View all citing articles on Scopus
    View full text