A study of kinematic cues and anticipatory performance in tennis using computational manipulation and computer graphics Hirofumi Ida & Kazunobu Fukuhara & Seiji Kusubori & Motonobu Ishii Published online: 13 April 2011 # Psychonomic Society, Inc. 2011 Abstract Computer graphics of digital human models can be used to display human motions as visual stimuli. This study presents our technique for manipulating human motion with a forward kinematics calculation without violating anatomical constraints. A motion modulation of the upper extremity was conducted by proportionally modulating the anatomical joint angular velocity calculated by motion analysis. The effect of this manipulation was examined in a tennis situation—that is, the receiver’s performance of predicting ball direction when viewing a digital model of the server’s motion derived by modulating the angular velocities of the forearm or that of the elbow during the forward swing. The results showed that the faster the server’s forearm pronated, the more the receiver’s anticipation of the ball direction tended to the left side of the serve box. In contrast, the faster the server’s elbow extended, the more the receiver’s anticipation of the ball direction tended to the right. This suggests that tennis players are sensitive to the motion modulation of their opponent’s racket-arm. Keywords Motion analysis . Motion modulation . Forward kinematics . CG . Digital human model Humans can recognize various types of human motion instantaneously and accurately, not only when viewing the actions of real-life humans, but also when viewing the movements of artificial human models. For instance, the point-light display (PLD) technique has been one of the best- known approaches and has shown perceptual robustness for biological motions (Johansson, 1973; Neri, Morrone, & Burr, 1998). Previous studies have revealed that human perception is highly sensitive even to the PLD, in that observers were able to distinguish the gender of a walker (Kozlowski & Cutting, 1977; Troje, 2002; Troje, Sadr, Geyer, & Nakayama, 2006), identify friends by their walking pattern (Cutting & Kozlowski, 1977), and recognize the emotions expressed by actors (Dittrich, Troscianko, Lea, & Morgan, 1996; Pollick, Paterson, Bruderlin, & Sanford, 2001). Recently, in association with the development of computer graphics (CG) technology, various digital human models have become available for providing a visual stimulus of human motion. For example, the stickfigure model is regarded as a simplified human model, as is the point-light model, whereas many CG character models constructed from polygons or NURBS (non-uniform rational B-splines) imitate real humans. Motion capture systems and CG animation software facilitate the use of a digital human model in studies of human motion percep- tion. One of the advantages of this approach is that several visual stimuli—for example, the polygon and stickfigure H. Ida (*) : K. Fukuhara : M. Ishii Department of Human System Science, Graduate School of Decision Science and Technology, Tokyo Institute of Technology, Meguro, Tokyo, Japan e-mail: hiroida@me.com S. Kusubori Department of Environmental Sciences, Prefectural University of Hiroshima, Hiroshima, Japan H. Ida Kanagawa Institute of Technology, Human Media Research Center, Atsugi, Kanagawa, Japan Behav Res (2011) 43:781–790 DOI 10.3758/s13428-011-0084-x models—were created on the basis of the same motion data (Dekeyser, Verfaillie, & Vanrie, 2002; Vanrie & Verfaillie, 2004). These models were artificial versions of a real-world human or of one captured on video. They contained extra (pictorial) information in addition to the essential (kinematic) information that a point-light model does. It is necessary to evaluate the perceptual effect of digital human models, particularly in comparison with real-world or video displays. The anticipatory performance and visual search strategy when a tennis serve was viewed in order to predict the ball direction have been compared between a CG display with a polygon model and a video display (Fukuhara, Ida, Kusubori, & Ishii, 2009). It was revealed that the polygon model allowed the observers to perceive anticipatory cues from the serve motion, but the response accuracy was lower than that of the video. Digital human models have been utilized to simulate sports situations and to examine the response of the user in a virtual environment (VE)—for example, a baseball batter hitting a virtual ball (Gray, 2002), playing against a virtual pitcher (Ranganathan & Carlton, 2007), or a handball goalkeeper facing a virtual thrower (Bideau, Multon, Kulpa, Fradet, Arnaldi, & Delamarche, 2004; Vignais, Bideau, Craig, Brault, Multon, & Kulpa, 2009). The aim was to examine the perception–action coupling in the sport- simulating VE, and this approach promises to reveal uncovered features that cannot be assessed in real-world situations or video displays. The use of a digital human model has had another experimental advantage—namely, the arbitrary manipu- lation of displayed human motion. Principal component analysis has been used to identify systematic similarities and/or dissimilarities in the motion patterns across tennis passing shots (Huys, Smeeton, Hodges, Beek, & Williams, 2008). The authors displayed simulated tennis shots in which motion dynamic structures were manipu- lated and revealed that tennis players predicted the shot direction by using the information in multiple low- dimensional dynamic modes. This approach was extended in further studies (Huys, Canal-Bruland, Hagemann, Beek, Smeeton, & Williams, 2009; Williams, Huys, Canal- Bruland, & Hagemann, 2009). In related work, spatially exaggerated tennis serve motions were displayed with a polygon model, and the exaggeration led to accurate categorizations of the types of tennis serves—that is, flat, slice, and topspin (Pollick, Fidopiastis, & Braden, 2001). In other work, the joint motion of a runner was modulated, and the modulated motion was displayed using a polygon model and a stickfigure model (Hodgins, O’Brien, & Tumblin, 1998). The results revealed that the identification of the running motion was more accurate for the polygon model than for the stickfigure model. The findings suggest that the perceptual performance for human motion could be affected by the pictorial (“geometric,” according to the study) information of the human model. Their manipu- lation technique kinematically modified the motion data obtained from a dynamic simulation on the basis of the laws of physics and targeted the “torso rotation” and “dynamic arm motion” of the original running motion pattern. In this study, we used another manipulation technique: The upper extremity motion was computationally manip- ulated by using a forward kinematics (FK) calculation, widely used in CG modeling and robotics, that outputs the position and orientation of the end effector as a function of joint angles (Zatsiorsky, 1998). This manip- ulation technique followed the anatomical constraints of the joint—that is, the degrees of freedom and range of motion—and calculated the motion data of the upper extremity as a function of the joint angular velocity modulated proportionally to that of the original motion. The computationally simulated test motion derived from the kinematic modulation is useful for revealing the quantitative relationship between the motion pattern of the performer and the perceptual performance of the observer. The anatomically validated motion can provide insight into the observer’s perceptual skill for real-world human motion. Furthermore, the manipulation technique also enabled us to create various visual stimuli of CG animations in which the motion was arbitrarily modulated but anatomically feasible for humans. Server motion and receiver cognition in tennis were examined in this study. A real-world tennis serve was analyzed and kinematically modulated at the server’s racket- arm and then was displayed with CG animations as visual stimuli for assessing the receiver’s anticipatory performance. The kinematic modulation was performed by modulating the angular velocity of the forearm and that of the elbow during the forward swing phase of the original serve motion. The purposes of this study were to provide an explanation of the manipulation technique with an FK calculation and to verify whether the kinematic modulation has any effect on the receiver’s anticipatory performance. We hypothesized that the anticipatory performance of the tennis player would be sensitive to the degree of motion modulation. Computation of motion analysis and motion modulation In the manipulation of the upper extremity, the anatomical joint angular velocity along an individual rotational axis— for example, the extension/flexion at the elbow—was selected as the modulating parameter. First, motion analysis was conducted to obtain every anatomical joint angular velocity in the upper extremity, using the three-dimensional coordinate data of the original motion. Second, motion 782 Behav Res (2011) 43:781–790 modulation was performed using an FK calculation in which the obtained anatomical joint angular velocities were proportionally modulated. The computational expressions of the motion analysis and motion modulation will be described in the following sections. Motion analysis For motion analysis, the anatomical joint angular velocities at the wrist, forearm, elbow, and shoulder were calculated. The upper extremity was defined as a link segment model: The body segment of the hand, forearm, upper arm, and upper trunk are connected with the joint of the wrist, forearm, elbow, and shoulder (see Fig. 1). Note that the forearm was regarded as the joint as well as the body segment, because it has the degree of freedom of pronation/ supination. First, the resultant segment angular velocity was calculated from the motion data; then the resultant joint angular velocity at each joint was derived and, finally, separated into each anatomical axis of the joint as the anatomical joint angular velocity (Winter, 2005). An orthogonal reference frame (ijk) was defined for each body segment of the hand, forearm, upper arm, and upper trunk. The resultant segment angular velocity (ωsegment) is de- scribed vectorially using the orthogonal vectors isegment, jsegment, and ksegment, as follows: wsegment ¼ w01isegment þ w02jsegment þ w03ksegment; ð1Þ where ω′1~ω′3 are scalar. Since an arbitrary vector r that rotates around an axis with an angular velocity ω satisfies dr/dt = ω × r, transforming Eq. 1 for r = isegment, jsegment or ksegment, the values of ω′1~ω′3 are obtained as w01 ¼ ksegment � djsegment dt ; w02 ¼ isegment � dksegment dt ; w03 ¼ jsegment � di segment dt ; ð2Þ where the dot operator represents the scalar product. The resultant joint angular velocity (ωjoint) defined for the wrist, forearm, elbow, and shoulder is the relative angular velocity of the distal segment to the proximal segment of the joint: wjoint ¼ wdistal segment � wproximal segment: ð3Þ The joint reference frame was determined by an anatomical definition: palmar/dorsi flexion (plm/drs) and radial/ulnar flexion (rad/uln) at the wrist; pronation/supina- tion (prn/spn) at the forearm; flexion/extension (flx/ext) at the elbow; and horizontal adduction/abduction (had/hab), adduction/abduction (add/abd), and internal/external rota- tion (inr/exr) at the shoulder. The anatomical joint angular velocities (ω′1~ω′3) were defined as the vector projection of the resultant joint angular velocity onto the orthogonal joint reference frame (uvw): w1 ¼ wjoint � ujoint; w2 ¼ wjoint � vjoint; w3 ¼ wjoint � wjoint: ð4Þ Motion modulation For motion modulation, the motion of the upper extremity was manipulated by modulating the anatomical joint angular velocities and then calculating the resulting coordinate data of the joint,using an FK algorithm. The manipulation was defined such that it generated a displace- ment of the distal adjacent segment of the target joint but did not generate a displacement of the proximal adjacent segment. As a result, the modulation at a certain joint generated simultaneous displacements of all distal joints and segments; however, the positions and orientations of all proximal joints and segments remained unchanged. In particular, the position of the target joint was also unchanged. The modulated anatomical joint angular velocity (ωm mod_joint) was obtained by multiplying the original iforearm Hand Upper armForearm kforearm jforearm ihand khand jhand ωforearm Wrist Elbow Shoulder ωhand ωwrist = ωhand - ωforearm uwrist vwrist (wwrist) Fig. 1 Segment reference frame (e.g. ihand, jhand, khand), joint reference frame (e.g. uwrist, vwrist, wwrist), resultant segment angular velocity (e.g. ωhand) and resultant joint angular velocity (e.g. ωwrist) Behav Res (2011) 43:781–790 783 anatomical joint angular velocity for a certain duration (from t0 to t1) by a constant, wmod jointm ¼ wmðt < t0Þ Cwmðt0 � t < t1Þ; wmðt1 � tÞ 8 >>< >>: m ¼ 1; 2; 3 ð5Þ where C is an arbitrary constant associated with the modulation percentage and m represents the nominal number of each anatomical axis. By using the anatomical description of the upper extremity, the modulated joint angular velocities (ωmod_joint) are defined as follows: wmod joint ¼ wmod jointplm=drs u wrist þ wmod jointrad=uln vwrist wmod jointprn=spn w j:forearm wmod joint flx=ext uelbow wmod jointhad=hab u shoulder þ wmod jointadd=abd vshoulder þ w mod joint inr=exr w shoulder; 8 >>>>>>< >>>>>>: ð6Þ where j. forearm represents the forearm joint in distinction from the forearm segment; joint motions with no degrees of freedom were omitted. For general FK calculations, a coefficient matrix—that is, the Jacobian—is used to describe the relationship between the attitude of the end effector and the joint angular velocities of the link–segment system (Zatsiorsky, 1998): dr dt ¼ JðaÞ da dt ; ð7Þ where r consists of the position vector and orientation vector of the end effector, J(α) is the Jacobian, and α is the nth order group vector of the angular velocities of the n-joints. For the reconstruction of the modulated motion in this study, however, the coordinate data of all the upper extremity joints were required. Therefore, a sequential calculation of all the segment longitudinal unit vectors (ksegment) from the proxi- mal joint to the distal joint was more convenient than using Eq. 7. The time derivative of ksegment is associated with ωsegment by the following equation: dksegment dt ¼ wsegment � ksegment; ð8Þ where the cross operator represents the vector product. The vector ωsegment was replaced by the modulated segment angular velocities (ω ), which was calculated from in Eq. 6. This led to the following relationships: wmod upper arm ¼ wtrunk þ wmod shoulder wmod forearm ¼ wmod upper arm þ wmod elbow wmod hand ¼ wmod forearm þ wmod j:forearm þ wmod wrist: ð9Þ We conducted a time progressive calculation to obtain the modulated segment longitudinal unit vectors (kmod_segment) by using the differential transform of Eq. 8: kmod segmentðtÞ ¼ 2Δtðwmod segmentðt�1Þ � kmod segmentðt�1ÞÞ þ kmod segmentðt�2Þ; ð10Þ where Δt is the time interval of the sampling frames and τ, the frame number. Then the three-dimensional coordinate data of the modulated joint position (xmod_joint) were obtained: xmod elbow ¼ xshoulder þ kmod upperarmlupperarm xmod wrist ¼ xmod elbow þ kmod forearmlforearm xmod MP ¼ xmod wrist þ kmod handlhand; ð11Þ where l is a function of τ of the segment length determined by the original motion data and MP represents the third metacarpophalangeal joint. The position and orientation of the racket were assumed to remain unchanged relative to those of the hand segment; therefore, the modulated racket reference frame (Rmod_racket) is described as Rmod racket ¼ TRmod hand; ð12Þ where T is a transformation matrix dependent on τ that is not changed by the motion modulation and Rmod_hand, the modulated hand reference frame. The coordinate data of the racket landmarks were determined by Rmod_racket. Non-modulated motion was derived through all the processes described above; namely, all the modulation constants in Eq. 5 were equal to one (C = 1). Note that the non-modulated motion also had a slight displacement, relative to the original captured motion, due to the reconstruction processing—for example, low-pass filtering and the assumption that the racket was rigid. At racket–ball impact, the increments of the kinematic parameters of the non-modulated motion, relative to the original motion, were (ΔX, ΔY, ΔZ) = (0.003, 0.011, 0.006 m) for the position of the racket face center, ΔVr = 0.1 m/s for the linear velocity of the racket face center, and Δαyaw = 0.5° and Δαpitch = -1.9° for the racket attitude. Experiment with modulated motion Method Participants Eight experienced male tennis players (M ± SD: age = 21.1 ± 2.1 years, experience = 5.3 ± 2.3 years) participated in the experiment. The participants were 784 Behav Res (2011) 43:781–790 ωmod_joint mod_segment college or graduate students who were carrying out daily practice in the collegiate club team, and all of them were unfamiliar with stimulus materials used for the experiment. They gave informed consent before the experiment. Test stimuli A video-based system was used to collect three-dimensional coordinate data of serve motions on an outdoor tennis court. The serve motions performed by a skilled male test player (height = 1.73 m, weight = 73 kg, age = 23 years, experience = 10 years) were videotaped as the original motion at a 250-Hz sampling rate, using two synchronized high-speed cameras (HSV-500C3, Nac Inc., Tokyo). The test player was instructed to hit a flat serve– that is, a serve with less spin—using his best effort, aiming at a target area (1 × 1 m) set at the back center of the court within the right serve box. Outrigger marker devices were attached to the test player’s hand and wrist in order to calculate the anatomical angular velocities of the wrist flexion and forearm rotation separately (see Fig. 2). The most successful trial among the three collected flat serves was selected for analysis. The 21 landmarks of the entire body, 3 outrigger landmarks of the hand, 2 outrigger landmarks of the wrist, and 5 landmarks of the racket were manually digitized frame-by-frame, utilizing motion analy- sis software (Frame-DIAS II, DKH Inc., Tokyo). Then, using the process described in the Motion Analysis section, all the anatomical joint angular velocities of the racket-arm were obtained (see Fig. 3). The modulation duration was set during the forward swing phase (0.132 s), beginning from the initiation of the forward swing (t0 = IFS) and ending at time of the racket– ball impact (t1 = Impact). The IFS was defined as the time at which the racket head was positioned at the lowest point. The forearm pronation/supination and elbow extension/ flexion were selected for modulation separately, because the joint angular velocities of them showed relatively high and consistently positive almost throughout the forward swing phase (Fig. 3b). The consistent positive sign of the joint angular velocity was interpreted as indicating typical unidirectional joint rotation of forearm pronation and elbow extension. The modulation coefficients were set to C = 0.7, 0.85, 1.15, 1.3 (-30%, -15%, +15%, +30%, slow to fast modulation, respectively) for each joint rotation. Non- modulated motion was also constructed through the same modulation procedure, with C = 1 at every anatomical joint angular velocity. Finally, the test stimuli of serve anima- tions consisted of one non-modulated motion (±0%), four forearm pronation/supination modulated motions (-30%, - 15%, +15%, +30%;see Fig. 4), and four elbow extension/ flexion modulated motions (-30%, -15%, +15%, +30%;see Fig. 5). CG animations were created using CG modeling software (Maya 4.5, Alias Inc., Toronto). The template character “Jackie” from the Maya 4.5 Documentation and Lessons was used as the digital human model. The racket model was made of a rigid body polygon. A scripting language (Maya Embedded Language, MEL) was used to convert the motion data to the CG human model (Fukuhara, Ida, Kusubori, & Ishii, 2009). The ball was erased from the animation to eliminate unexpected perceptual effects other than human motion; for example, the racket might miss the ball because the modulation procedure changed the path of the racket. The viewing point was set around the receiver’s view point—that is, 1 m above the cross point of the baseline and sideline of the singles court on the right. The frame rate of the animation was set at 50 Hz. The total duration of the animation was 1.6 s from the ready position to the racket–ball impact. The animation was occluded immediately after the frame of racket–ball impact. Procedure The participants sat 3.5 m away from, and directly in front of, the screen on which the test stimuli were projected. The maximum height of the test serve motion was adjusted to 0.39 m. This provided a visual angle of approximately 6.4°, which is similar to a real game situation. The experiment was conducted on our stand- alone test program built utilizing application development software (REAL Basic, ASCII Solutions Inc., Tokyo). This Body Vertex Tragion Shoulder Elbow Wrist MP 3rd Lowest rib Hip Knee Ankle Heel Toe : digitizing point : calculated point Racket and Ball Racket head Left side Right side Face end Grip end Ball center Outrigger marker Hand 2nd Hand 5th Hand extension Wrist ulnar Wrist radial b) Hand marker Racket markers Wrist marker 2nd 5th Ulnar Radial Extension a)Fig. 2 Attached hand marker and wrist marker (a), and digi- tizing points and calculated points (b) for original serve motion Behav Res (2011) 43:781–790 785 test program runs an experiment flow involving the presentation of a Quicktime movie, an input window for providing the anticipatory estimation score, and an auto-output function of all the response results. The participants first viewed the non-modulated motion at least three times and then viewed one of the modulated test motions, which included the non-modulated motion at a certain trial turn. After viewing, the participants were instructed to give their anticipatory score for the ball direction on a visual analogue scale (VAS) from 0 (left) to 100 (right) in comparison with the non-modulated motion (50 on VAS). The participants performed a total of 27 trials: 4 forearm modulated motion trials with 3 repeats, 4 elbow trials with 3 repeats, and 1 non-modulated trial with 3 repeats. Data analysis The VAS scores were analyzed using statistical software (SPSS 17.0, SPSS Japan Inc., Tokyo). A repeated measure one-way analysis of variance (modu- lation percentage) with a least significant difference post hoc comparison was performed to test the effect of the modulation percentage on the anticipation of ball direction for the forearm modulation and elbow modulation. Mauchly’s test of sphericity was conducted, and when there was a violation of the sphericity assumption, the Greenhouse–Geisser correction was used to adjust the degrees of freedom. Partial eta-squared (ηp 2) was estimated to measure the effect size. The significance level was set at α = .05. Result and discussion For forearm modulation, the anticipatory score of ball direction decreased (shifted to the left) monotonically with the modulation percentage (Fig. 6a). There was a signifi- cant effect on the modulation percentage, F(4, 28) = 12.39, p < .01, ηp 2 = .639. Significant differences between modulation percentages were found in eight pairwise comparisons (p < .05; *s in Fig. 6a). Because the forearm of the test server pronated throughout the forward swing phase (Fig. 3b), applying a positive modulation resulted in a faster pronating motion than non-modulated motion, whereas applying a negative modulation resulted in a slower pronating motion. The results indicate that the faster the server’s forearm pronated, the more the anticipation of the ball direction tended to the left side of the serve box. For elbow modulation, as opposed to forearm modulation, the anticipatory score of ball direction increased(shifted to the right) monotonically with the modulation percentage (Fig. 6b). There was a significant effect on the modulation percentage, F(1.56, 28) = 7.05, p < .01, ηp 2 = .502. Significant differences between modulation percentages were found in five pairwise comparisons (p < .05; *s in Fig. 6b). The server’s elbow extended almost throughout the forward swing phase (Fig. 3b). Using the same consideration as forearm modulation, the result signified that the faster the server’s a) c) b) -20 -10 0 10 20 A ng ul ar v el oc it y (r ad /s ) -1.6 -1.2 -0.8 -0.4 0.0 Time (s) Shoulder hor. flexion (+) / extension (-) abduction (+) / adduction (-) internal (+) / external (-) rot. IFS Impact -2 0 -1 0 0 10 20 A ng ul ar v el oc it y (r ad /s ) -1.6 -1.2 -0.8 -0.4 0.0 Time (s) Wrist palmar (+) / dorsi (-) flx. ulnar (+) / radial (-) dev. IFS Impact -20 -10 0 10 20 A ng ul ar v el oc it y (r ad /s ) -1.6 -1.2 -0.8 -0.4 0.0 Time (s) Elbow and forearm extension (+) / flexion (-) foa. pronation (+) / supination (-) IFS Impact Fig. 3 The anatomical angular velocity of wrist (a), elbow and forearm (b) and shoulder (c). flx: flexion, dev: deviation, foa: forearm, hor: horizontal, and rot: rotation. IFS: Initiation of Forward Swing (-0.132 s), Impact: racket-ball impact 786 Behav Res (2011) 43:781–790 elbow extended, the more the anticipation of ball direction tended to the right. These results suggest that tennis players are sensitive to the motion modulation of their opponent’s racket-arm. In previous work, the adjustment of preimpact racket motion during overhand serve—for example, changing the racket’s vertical and lateral velocity—was carried out by skilled players when going from the first to the second serve (Chow, Carlton, Lim, Chae, Shim, Kuenster, & Kokubun, 2003); therefore, receivers might have changed the antici- patory judgment depending on the opponent’s arm kine- matics. It is highly possible that skilled players may benefit from the visual information found in the racket-arm and racket during the forward swing and use it as an anticipatory cue. The results demonstrated that the manipulation tech- nique worked well for detecting the change in the pattern of the anticipation of ball direction. Interestingly, both forearm modulation and elbow modulation evoked monotonic tendencies in ball direction score depending on modulation percentage. Both of these target motions were almost unidirectional, forearm pronation or elbow Open Occlusion -15% +30% +15% -30% ±0% (non-modulated) -1.6 s 0 s-0.12 s-1.2 s -0.08 s -0.04 s-0.4 s-0.8 s IFS ImpactModulation Modulation 30 20 10 0 -10 A ng ul ar v el oc it y (r ad /s ) -0.30 -0.20 -0.10 0.00 Time (s) Forearm pronation / supination ±0% (non-modulated) -30% -15% +15% +30% IFS Impact Fig. 4 The sequential image of CG animation with the modulation of the forearm angular velocity. Time-course curves show the profile of the modulated forearm pronation (+) / supination (-) angular velocity Behav Res (2011) 43:781–790 787 extension, in the motion analysis; therefore, the result is clear: The anticipation of ball direction shifts monoton- ically depending on joint motion speed. The situation would be more complex if the modulation targeted bidirectional motion—for example, the dorsi flexion followed by the palmar flexion—or multijoint motions. The judgment of ball direction is one of the most popular criteria for assessing the response accuracy in sports situations, and thus, the manipulation technique contrib- utes further to this field. General discussion We proposed a methodological approach that utilized the manipulation technique with the FK calculation to control test motion quasi-arbitrarily and a CG display with a digital human model. This methodology is referred to by Hodgins et al. (1998). However, our approach was intended to be more applicable to ball sport practitioners; therefore, we examined the anticipatory performance of a tennis oppo- nent’s serve motion, which requires great attention and Open Occlusion -15% +30% +15% -30% ±0% (non-modulated) -1.6 s 0 s-0.12 s-1.2 s -0.08 s -0.04 s-0.4 s-0.8 s IFS ImpactModulation Modulation 30 20 10 0 -10 A ng ul ar v el oc it y (r ad /s ) -0.30 -0.20 -0.10 0.00 Time (s) Elbow extension / flexion ±0% (non-modulated) -30% -15% +15% +30% IFS Impact Fig. 5 The sequential image of CG animation with the modulation of the elbow angular velocity. Time-course curves show the profile of the modulated elbow extension (+) / flexion (-) angular velocity 788 Behav Res (2011) 43:781–790 skilled visual search behavior. The motion exaggeration in the spatial location enhances the discrimination accuracy of the type of tennis serves (Pollick, Fidopiastis, & Braden, 2001). This technique has modified the joint positions of the entire body but did not permit precise manipulation of the anatomical joint rotation. The use of anatomically validated motion in our study enables meaningful suggestions for practitioners, because real players may duplicate such motions without violating anatomical constraints. Our manipulation technique is more plausible in an anatomical sense, but this still presents a problem: Can real players hit the ball with the manipulated motion? During the anticipation of the tennis ground stroke, the skilled players spent a significantly shorter time visually searching the racket area than did their less skilled counterparts, whereas no differences were observed between them at the racket-arm and hand area (Williams, Ward, Knowles, & Smeeton, 2002). This suggests that the changes in racket kinematics may have a greater influence on less skilled players than on skilled ones. However, gaze analysis gave no conclusive evidence about whether or not the racket or racket-arm is more informative; to understand this, it will be necessary to clarify the effect of central vision and peripheral vision in tennis perception. In a related study, the isolated motion display of a badmin- ton stroke revealed that the PLD of the racket-arm raised the anticipatory performance of experts above chance level at an earlier phase than that of the racket (Abernethy & Zawi, 2007). The challenge is determining whether or not anticipatory performance based on the racket or racket-arm depends on task or skill level. In addition, the anticipatory accuracy for the PLD of the lower extremity cleared chance level at an even earlier phase than that of the racket-arm. Skilled players appear to benefit from the anticipatory cue located around the proximal body; in contrast, less skilled players preferred to focus on more deterministic cues located around the racket area (Williams et al., 2002). The limitations of this study were as follows: The relationship with real world, film, or PLD was not studied, and the VAS response could not explain the effect of perception–action coupling. Recently, the effect of using a digital human model for studying the anticipatory perfor- mance of a tennis serve was discussed, and a CG display was found to be more similar to a video display rather than to a PLD (Fukuhara et al., 2009). The assessment of a CG display of the manipulated motion in comparison with real world or film remains to be examined. In our study, a video-based system was used to capture the motion of the test player because the field was a wide outdoor environment. Auto-motion analysis systems—for example, MotionAnalysis (MotionAnalysis Corp., Santa Rosa, CA) or VICON (Vicon Inc., Los Angeles, CA)—are also available if the environment is suitable for data collection. These systems simplify the process of creating visual stimuli. Previous studies (Abernethy, 1990; Ward, Williams, & Bennett, 2002; Williams et al., 2002) have suggested that skilled players were able to perceive anticipatory cues from an earlier part of an opponent’s stroke motion and more proximal segments of the opponent’s body than were their unskilled counterparts. Our motion modulation, in contrast, focused on the later part (forward swing phase) and more distal segments (racket and racket-arm), because early and proximal modulation might generate complicated and unexpected motion. If the motion modulation with FK at the early phase and proximal segment generates the visual stimuli of natural and valid modulated motion, the study using this will provide mutually complementary under- standings with those previous studies. The methodology of this study included a distal approach in cognitive psychology, but it allowed informa- tion to be added in parallel to the visual stimulus. A typical distal approach uses natural motion as a visual stimulus and subtracts information (e.g., color, shape) from the motion. Using simplified information from the CG model for a captured natural motion is subtractive, and thus, this b) Elbow modulationa) Forearm modulation * S co re S co re left right left right 0 20 40 60 80 100 -30% -15% ±0% +15% +30% Modulation percentage 0 20 40 60 80 100 -30% -15% ±0% +15% +30% Modulation percentage * Fig. 6 The anticipatory score (M ± SD) of estimated ball direction for forearm modulation (a) and elbow modulation (b) . *: p < .05 Behav Res (2011) 43:781–790 789 approach is categorized as a distal approach. However, the motion modulation is additive, which is a typical concept in the proximal approach, because the parameters of the modulated joint angular velocity are added to control the racket-arm motion. Pollick et al. (2001) referred to this distal but additive approach as unique in the study of biological motion perception. The motion manipulation has a significant effect on biological motion perception, and the motion modulation with FK calculation may have various applications in the study of human motion perception, together with the techniques such as CG animation or motion capture (e.g., in a sport simulation or in nonverbal communication). References Abernethy, B. (1990). Anticipation in squash: Differences in advance cue utilization between expert and novice players. Journal of Sports Sciences, 8, 17–34. Abernethy, B., & Zawi, K. (2007). Pickup of essential kinematics underpins expert perception of movement patterns. Journal of Motor Behavior, 39, 353–367. Bideau, B., Multon, F., Kulpa, R., Fradet, L., Arnaldi, B., & Delamarche, P. (2004). Using virtual reality to analyze links Neuroscience Letters, 372, 119–122. Chow, J., Carlton, L. G., Lim, Y.-T., Chae, W.-S., Shim, J.-H., Kuenster, A., et al. (2003). Comparing the pre- and post-impact ball and preliminary study. Journal of Sports Sciences, 21, 529–537. Cutting, J. E., & Kozlowski, L. T. (1977). Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the Psychonomic Society, 9, 353–356. Dekeyser, M., Verfaillie, K., & Vanrie, J. (2002). Creating stimuli for the study of biological-motion perception. Behavior Research Methods, Instruments, & Computers, 34, 375–382. Dittrich, W. H., Troscianko, T., Lea, S. E., & Morgan, D. (1996). Perception of emotion from dynamic point-light displays repre- sented in dance. Perception, 25, 727–738. Fukuhara, K., Ida, H., Kusubori, S., & Ishii, M. (2009). Anticipatory judgment of tennis serve: A comparison between video images and computer graphics animations. International Journal of Sport and Health Science, 7, 12–22. Gray, R. (2002). Behavior of college baseball players in a virtual batting task. Journal of Experimental Psychology. Human Perception and Performance, 28, 1131–1148. Hodgins, J. K., O’Brien, J. F., & Tumblin, J. (1998). Perception of human motion with different geometric models. IEEE Trans- actions on Visualization and Computer Graphics, 4, 307–316. Huys, R., Canal-Bruland, R., Hagemann, N., Beek, P. J., Smeeton, N. J., & Williams, A. M. (2009). Global information pickup underpins anticipation of tennis shot direction. 158–171. Huys, R., Smeeton, N. J., Hodges, N. J., Beek, P. J., & Williams, A. M. (2008). On the dynamic information underlying visual anticipation skill. Perception & Psychophysics, 70, 1217–1234. Kozlowski, L. T., & Cutting, J. E. (1977). Recognizing the sex of a walker from a dynamic point-light display. Perception &Psychophysics, 21, 575–580. Neri, P., Morrone, M. C., & Burr, D. C. (1998). Seeing biological motion. Nature, 395, 894–896. Pollick, F. E., Fidopiastis, C., & Braden, V. (2001). Recognising the style of spatially exaggerated tennis serves. Perception, 30, 323–338. Pollick, F. E., Paterson, H. M., Bruderlin, A., & Sanford, A. J. (2001). Perceiving affect from arm movement. B51–B61. Ranganathan, R., & Carlton, L. G. (2007). Perception-action coupling and anticipatory performance in baseball batting. Journal of Motor Behavior, 39, 369–380. Troje, N. F. (2002). Decomposing biological motion: A framework for analysis and synthesis of human gait patterns. Journal of Vision, 2(5, Art. 2), 371–387. Troje, N. F., Sadr, J., Geyer, H., & Nakayama, K. (2006). Adaptation aftereffects in the perception of gender from biological motion. Journal of Vision, 6(8, Art. 7), 850–857. Vanrie, J., & Verfaillie, K. (2004). Perception of biological motion: a stimulus set of human point-light actions. Behavior Research Methods, Instruments, & Computers, 36(4), 625–629. Vignais, N., Bideau, B., Craig, C., Brault, S., Multon, F., & Kulpa, R. (2009). Virtual environments for sport analysis: perception-action coupling in handball goalkeeping. International Journal of Virtual Reality, 8(4), 43–48. Ward, P., Williams, A. M., & Bennett, S. J. (2002). Visual search and biological motion perception in tennis. Research Quarterly for Exercise and Sport, 73, 107–112. Williams, A. M., Huys, R., Canal-Bruland, R., & Hagemann, N. (2009). The dynamical information underpinning anticipation skill. Human Movement Science, 28, 362–370. Williams, A. M., Ward, P., Knowles, J. M., & Smeeton, N. J. (2002). Anticipation skill in a real-world task: measurement, training, and transfer in tennis. Journal of Experimental Psychology. Applied, 8, 259–270. Winter, D. A. (2005). Biomechanics and motor control of human movement (3rd ed.). Hoboken: Wiley. Zatsiorsky, V. M. (1998). Differential kinematics of human movement Kinematics of human motion. Champaign: Human Kinetics. 790 Behav Res (2011) 43:781–790 between handball thrower kinematics and goalkeeper's reactions. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception & Psychophysics, 14, 201–211. racquet kinematics of elite tennis players' first and second serves: A Journal of Motor Behavior, 41, Cognition, 82, A study of kinematic cues and anticipatory performance in tennis using computational manipulation and computer graphics Abstract Computation of motion analysis and motion modulation Motion analysis Motion modulation Experiment with modulated motion Method Result and discussion General discussion References