Bianchini Claudia, Savina

Boutet, Dominique

Chèvrefils, Léa

Contesse, Adrien

Danet, Claire

Doan, Patrick

Goguely, Timothée

Rébulard, Morgane

English

Archive Ouverte en Sciences de l'Information et de la Communication

HAL Id: hal-02342840
https://hal.archives-ouvertes.fr/hal-02342840
Submitted on 16 May 2020
HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d’enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.
Structural correlation between location and movement
of signs: lacking motion economy for co-speech gestures.
Claire Danet, Dominique Boutet, Claudia S. Bianchini, Léa Chèvrefils,
Patrick Doan, Morgane Rébulard, Timothée Goguely, Adrien Contesse
To cite this version:
Claire Danet, Dominique Boutet, Claudia S. Bianchini, Léa Chèvrefils, Patrick Doan, et al.. Structural
correlation between location and movement of signs: lacking motion economy for co-speech gestures..
Language as a form of Action, CNR Rome, Jun 2017, Rome, Italy. ￿hal-02342840￿

E – Results
2
1 Distribution of types  
of MOVement
Hyp. 1 is interesting.
Optimal use of 
ressources.
Reduction of the motor 
control > stabilization  
of Signs.
F – Outcomes
Distribution of  the Flow
Hyp. 2 is interesting.
The Distal-Proximal  
is the main flow.
The organization of the 
MOVement is coming 
from the distal segments.
3
LSF LIS BSL
Trackable MOV  
of the Signs
90.22% 95.43% 95.46%
75
50
25
0
Distal/
proximal
Proximal/
distal 
Static Whole One 
DOF/
moves
LSF
LIS
BSL
%
100
75
LSF
LIS
BSL
50
25
0
Static One degree
of freedom
(DOF)
Several DOF
on one
segment
Several
segments
%
1 Proof of concept 
– The motor control  
is reduced for the most 
unstable parameter:  
the MOVement. This 
observation is available 
if and only if we consider 
signs according to intrin-
sic frames of reference 
(one per each segment). 
It is one of the specificity  
of the project Typannot.
– The parameter LOCini 
participates to the condi-
tions of realization for 
the stabilization of signs: 
the set up of the relative 
position of segments  
for a following simple  
MOVement.
2 Assumption 
The MOVement for the pre-
paration phase could be more 
unstable, more complex or more 
proximal-distal.  
It gives some clues for the signs  
segmentation.
Next step
Check these points with a MOCAP 
Corpus.
3
Structural Correlation 
between Location and 
Movement of Signs:  
Lacking Motion  
Economy for Co-speech  
Gestures?
Building a formal transcription 
system for Sign Language  
and gestures: Typannot.
GestualScript 
Claire Danet ¹, Dominique Boutet ², 
Claudia S. Bianchini ³, Léa Chèvrefils ², 
Patrick Doan ¹, Morgane Rébulard ¹, 
Timothée Goguely ¹, Adrien Contesse ¹.
Affiliations 
1. ESAD Amiens, France; 
2. University of Rouen, Dylis, France; 
3. University of Poitiers, FoReLL, France.
A – General Framework
2
3
Lateralization 
󰀀󰀁
Finger selection
Counting
󰀇󰀈󰀉󰀊󰀋
Clustering
󰀂󰀃󰀄󰀅󰀆
Finger designation 
󰀌󰀍󰀎󰀏󰀐
Closeness
󰀑󰀒󰀓󰀔󰀕
Shape
󰀖󰀗󰀘
Angle
󰀙󰀚󰀛󰀜
1TOCscCO 234Fo 
1  Index
TO  Thumb Opposed
Csc  Curved semi-closed
CO  COntact
234Fo  Middle Ring Pinky Flat open
1st step: 
Graphematic formula
2nd step: 
Generic glyphic formula
3rd step: 
Specific glyphic formula
for all the handshapes
Each degree of freedom 
(DOF) must be conside-
red in its own frame  
of reference > Multiple 
intrinsic Frame of  
Reference (Boutet 2015).
Then the LOCalization  
is much more complex 
than the location  
of the hand alone.
Hand Place = 
Arm LOC + Forearm LOC 
+ Hand LOC
How MOVements in SL can  
be stabilized and simple while 
motion is changing?
Motoric schemas (Keele 1967) 
are present before and during 
the Sign.
How to establish the  
MOVement from the preparation 
phase to the MOVement  
involved in a Sign?
1
B – INItial LOCation (LOCini)
1
C – MOVement (MOV)
2 Preparation has a target:
 – find a well balanced
LOCini;
 – stabilized enough 
to be the starting point 
of simple MOVements
LOCini: ArmAddØ FlexØ 
ForFlex2RotInt2 Manu-
Supi1FlexØAdd1
MOV.: Segments affected: 
Forearm to Hand      
Pulse: Supi Exten
LOCini: ArmAddØ FlexØ 
ForFlex2RotIntØ Manu-
Supi1Flex1Add1
MOV.: Segment affected: 
Arm                                  
Pulse: Exten
Hyp. 1: The MOVement  
has a simple motor sche-
ma to minimize the motor 
control during the sign.  
Hyp. 2: The distal-proximal 
flow of the MOVement  
is predominant in SL. 
A simple motoric schema  
stabilizes Signs:
 – because of the simplicity of what 
the motor control has to do after 
the LOCini positions;
– because of the transfer of the 
MOVement on other DOF due  
to inertia and to geometric  
relationships between what the 
joints allow as movements;
– when the transfer of the move-
ments corresponds to the aligne-
ment of other DOF.
3
LOCini
Complex MOVements Simple MOVements
SIGN
1
A virtual keyboard  
to compose graphematic 
formula.
Ex: ArmAbd1 ArmFlexØ 
ForFlexØ ManuSupiØ  
ManuFlexØ ManuAbdØ
2
D – Hypothesis E – Transcription
Transcriptions 
to proof our 
concept:  
FSL: 1 min; 
LIS: 1 min 53 s; 
BSL: 50 s
4
1 1
[THANKS]
[THANKS]
Motoric schemas (Keele 1967) are present before and during the Sign.


Structural Correlation between Location and Movement of Signs: Lacking Motion Economy for cospeech gestures

https://hal.archives-ouvertes.fr/hal-02342840/document

Structural Correlation between Location and Movement of Signs: Lacking Motion Economy for cospeech gestures

Abstract

Similar works

Full text

Available Versions

Archive Ouverte en Sciences de l'Information et de la Communication