Skip to Main content Skip to Navigation
Journal articles

Inferring attributes with picture metadata embeddings

Bizhan Alipour Pijani 1 Abdessamad Imine 1 Michaël Rusinowitch 1
1 PESTO - Proof techniques for security protocols
Inria Nancy - Grand Est, LORIA - FM - Department of Formal Methods
Abstract : Users in online social networks are vulnerable to attribute inference attacks due to some published data. Thus, the picture owner's gender has a strong influence on individuals' emotional reactions to the photo. In this work, we present a graph-embedding approach for gender inference attacks based on pictures meta-data such as (i) alt-texts generated by Facebook to describe the content of images, and (ii) Emojis/Emoticons posted by friends, friends of friends or regular users as a reaction to the picture. Specifically, we apply a semi-supervised technique, node2vec, for learning a mapping of pictures meta-data to a low-dimensional vector space. Next, we study in this vector space the gender closeness of users who published similar photos and/or received similar reactions. We leverage this image sharing and reaction mode of Facebook users to derive an efficient and accurate technique for user gender inference. Experimental results show that privacy attack often succeeds even when other information than pictures published by their owners is either hidden or unavailable.
Complete list of metadata

https://hal.inria.fr/hal-02996034
Contributor : Michaël Rusinowitch Connect in order to contact the contributor
Submitted on : Tuesday, January 12, 2021 - 12:14:03 PM
Last modification on : Wednesday, November 3, 2021 - 7:56:50 AM
Long-term archiving on: : Tuesday, April 13, 2021 - 6:27:29 PM

File

attribute.pdf
Files produced by the author(s)

Identifiers

Citation

Bizhan Alipour Pijani, Abdessamad Imine, Michaël Rusinowitch. Inferring attributes with picture metadata embeddings. ACM SIGAPP applied computing review : a publication of the Special Interest Group on Applied Computing, Association for Computing Machinery (ACM), 2020, 20 (2), pp.36-45. ⟨10.1145/3412816.3412819⟩. ⟨hal-02996034⟩

Share

Metrics

Record views

92

Files downloads

257