Estimating social relation from trajectories

Zeynep Yucel, Francesco Zanlungo, Claudio Feliciani, Adrien Gregorj, Takayuki Kanda


This study focuses on social pedestrian groups in public spaces and makes an effort to identify the social relation between the group members. We particularly consider dyads having coalitional or mating relation. We derive several observables from individual and group trajectories, which are suggested to be distinctive for these two sorts of relations and propose a recognition algorithm taking these observables as features and yielding an estimation of social relation in a probabilistic manner at every sampling step. On the average, we detect coalitional relation with 87% and mating relation with 81% accuracy. To the best of our knowledge, this is the first study to infer social relation from joint (loco)motion patterns and we consider the detection rates to be a satisfactory considering the inherent challenge of the problem.


dyads; interaction; pedestrian groups; recognition; social relation

Full Text:



M. Schultz, L. Rößger, H. Fricke, and B. Schlag, “Group dynamic behavior and psychometric profiles as substantial driver for pedestrian dynamics,” in Pedestrian and Evacuation Dynamics 2012, pp. 1097– 1111, Springer, 2014.

C. von Krüchten, A. Schadschneider, “Empirical study on social groups in pedestrian evacuation dynamics,” Phys A: Stat Mech Appl. 2017;475:129–141.

J. Shao, C Change Loy, X Wang, “Scene-independent group profiling in crowd,” In: CVPR. Columbus, OH; 2014. p. 2219–2226.

F. Zanlungo, Z. Yücel, D. Brscic, T. Kanda, and N. Hagita, “Intrinsic group behaviour: dependence of pedestrian dyad dynamics on principal social and personal features,” arXiv preprint arXiv:1703.02672, 2017.

C. McPhail, R. Wohlstein, “Using film to analyze pedestrian behavior,” Sociological Methods & Research 1982;10:347–375.

A. P. Fiske, “The four elementary forms of sociality: framework for a unified theory of social relations.,” Psychological review , vol. 99, no. 4, p. 689, 1992.

M. S. Clark and J. Mills, “Interpersonal attraction in exchange and communal relationships.,” Journal of personality and social psychology , vol. 37, no. 1, p. 12, 1979.

E. B. Foa and U. G. Foa, “Resource theory,” in Social exchange , pp. 77-94, Springer, 1980.

D. B. Bugental, “Acquisition of the algorithms of social life: A domain-based approach.,” Psychological bulletin , vol. 126, no. 2, p. 187, 2000.

V. Ramanathan, B. Yao, L. Fei-Fei, “Social role discovery in human events,” CVPR 201, pp. 24752482, IEEE.

G. Wang, A. Gallagher, J. Luo, D. Forsyth, D. , “Seeing people in social context: Recognizing people and social relationships,” ECCV 2010, pp. 169-182, Springer.

Z. Yücel, F. Zanlungo, T. Ikeda, et al. “Deciphering the crowd: modeling and identification of pedestrian group motion,” Sensors. 2013;13(1):875– 897.

F. Zanlungo, D. Brščić, and T. Kanda, “Spatial-size scaling of pedestrian groups under growing density conditions,” Physical Review E, vol. 91, no. 6, p. 062810, 2015.

ATR-IRC, “Dataset: Pedestrian tracking with group annotations,” , (accessed January, 2018).

D. Brščić, T. Kanda, T. Ikeda, and T. Miyashita, “Person tracking in large public spaces using 3-d range sensors,” IEEE Transactions on Human-Machine Systems , vol. 43, no. 6, pp. 522-534, 2013.

Cohen, Jacob. “A coefficient of agreement for nominal scales.” Educational and psychological measurement 20.1 (1960): 37-46.

Fleiss, Joseph L. “Measuring nominal scale agreement among many raters.” Psychological bulletin 76.5 (1971): 378.

Krippendorff, Klaus. “Reliability in content analysis.” Human communication research 30.3 (2004): 411-433.

Gustafsson, A and .Lindenfors, P, “Latitudinal patterns in human stature and sexual stature dimorphism”, Annals of Human Biology, 2009; 36(1), 74-87.

Goodman, Steven N., and Jesse A. Berlin. “The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results.” Annals of internal medicine 121.3 (1994): 200-206.

D. Brščić, F. Zanlungo, and Takayuki Kanda. "Modelling of pedestrian groups and application to group recognition." Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2017 40th International Convention on. IEEE, 2017.


Copyright (c) 2020 Zeynep Yucel, Francesco Zanlungo, Claudio Feliciani, Adrien Gregorj, Takayuki Kanda

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.