Fragments that move
Family photos and generative artificial intelligence
DOI:
https://doi.org/10.22456/1984-1191.142898Keywords:
artificial intelligence, photography, death, family memories, genealogyAbstract
The aim of this research is to analyze how the DeepNostalgia technology of the commercial amateur genealogy website MyHeritage, which allows photographs of deceased people to be animated, affects people's interaction with their ancestors, while raising questions related to post-mortem consent and the representativeness of identities through artificial intelligence. To carry out this work, we adopted a qualitative approach inspired by autoethnography, enriched by an analysis of YouTube videos and associated comments. Our observations focused on how DeepNostalgia revives memories, awakens users' affects and generates emotional and social repercussions, oscillating between enchantment and disquiet. The results reveal that this technology, while enabling memories to be reawakened and provoking intense emotions, also arouses a certain unease, notably through the phenomenon of the “uncanny valley” and the technical anomalies (glitches) linked to artificial intelligence. In addition, the study highlights ethical issues related to the commercial exploitation of these tools, the question of consent and privacy, as well as algorithmic biases that influence the way ethnic groups, genders and ages are represented.
Downloads
References
AKRICH, Madeleine. La description des objets techniques. In : CALLON, Michel et LATOUR,
Bruno (éds.). Sociologie de la traduction : Textes fondateurs. Paris : Presses des Mines, 2006. p.
‑178.
ALANAZI, Sami e ASIF, Seemal. Exploring deepfake technology : creation, consequences and
countermeasures. Human-Intelligent Systems Integration, p. 1‑12, 2024.
ANDERSON, Leon. Analytic autoethnography. Journal of Contemporary Ethnography, v. 35, n.
, p. 373‑395, 2006.
BACKES, Michael; BERRANG, Pascal; HUMBERT, Mathias, et al. Simulating the large-scale
erosion of genomic privacy over time. IEEE/ACM Transactions on Computational Biology and
Bioinformatics, vol. 15, n° 5, p. 1405‑1412, 2018.
BAGDASARYAN, Eugene; POURSAEED, Omid; SHMATIKOV, Vitaly. Differential privacy
has disparate impact on model accuracy. Advances in Neural Information Processing Systems, vol.
, 2019.
BARCELLOS, Beatriz de Arruda Campos. Ausência em amarelo: um relato do encontro entre
morte e fotografia em álbuns de família. Ponto Urbe, n.31, dezembro de 2023. Disponível em :
http://journals.openedition.org/pontourbe/15776 . Último acesso em 30 de setembro de 2024.
BARTHES, Roland. La chambre claire : Note sur la photographie. Paris, Gallimard, 1980
BIRHANE, Abeba; PRABHU, Vinay Uday; KAHEMBWE, Emmanuel. Multimodal datasets :
misogyny, pornography, and malignant stereotypes. arXiv preprint, arXiv:2110.01963, 2021.
BOLTER, David e GRUSIN Richard. Remediation: Understanding New Media. Cambridge, MIT
Press, 1999.
BOMMASANI, Rishi; HUDSON, Drew A.; ADELI, Ehsan, et al. On the opportunities and risks
of foundation models. arXiv preprint, arXiv:2108.07258, 2021.
BOSI, Ecléa. Memória e sociedade: lembranças de velhos. São Paulo, Companhia das Letras,
BUOLAMWINI, Joy e GEBRU, Timnit. Gender shades : intersectional accuracy disparities in
commercial gender classification. In : Conference on Fairness, Accountability and Transparency.
PMLR, 2018. p. 77‑91.
CORREIA, Maria da Luz. No negativo: morte e fotografia. In: MARTINS, Moises de Lemos et
al. Figurações da morte nos média e na cultura: entre o estranho e o familiar. Braga, CECS, 2016,
p. 207-226.
D-ID. How MyHeritage brought family pictures to life using D-ID’s live portrait. D-ID, 3 mars
Disponível em : https://www.d-id.com/blog/how-myheritage-brought-family-pictures-tolife-using-d-ids-live-portrait/ . Último acesso em 11 de setembro de 2024.
DE RUITER, Adrienne. The distinct wrong of deepfakes. Philosophy & Technology, vol. 34, n°
, p. 1311‑1332, 2021.
ESTHER. CNN interviews MyHeritage CEO Gilad Japhet on Deep Nostalgia™. MyHeritage
Blog, 9 mars 2021b. Disponível em: https://blog.myheritage.com/2021/03/cnn-interviewsmyheritage-ceo-gilad-japhet-on-deep-nostalgia/ . Último acesso em 10 de setembro de 2024.
ESTHER. New : Introducing Deep Nostalgia™ — Animate the faces in your family photos.
MyHeritage Blog, 25 février 2021a. Disponível em: https://blog.myheritage.com/2021/02/newanimate-the-faces-in-your-family-photos/ . Último acesso em 10 de setembro de 2024.
FREUD, Sigmund. L'inquiétante étrangeté et autres essais. Paris, Gallimard, 1985.
GOMES, Laura Graziela. Avatares: o maravilhoso e o estranho no Second Life. Estudos
Históricos, Rio de Janeiro, vol.33, n.69, p. 173-195, Janeiro-Abril de 2020.
GREENGARD, Samuel. Will deepfakes do deep damage?. Communications of the ACM, vol. 63,
n° 1, p. 17‑19, 2019.
HALBWACHS, Maurice. Les Cadres Sociaux de La Mémoire. Paris, Albin Michel,1994.
HEFFERNAN, James. How artificial intelligence is changing genealogy. American Ancestors
Magazine. Vol. 25, no. 1. p.20-27, 2024.
HINE, Christine. Ethnography for the Internet: Embedded, Embodied and Everyday. Londres,
Bloomsbury, 2015.
HOLLOWAY, Donell e Green, Lelia. Mediated memory making: The virtual family photograph
album. Communications, vol 42, n. 3, p. 351-368, 2017.
HOOKER, Sara. Moving beyond ‘algorithmic bias is a data problem’. Patterns, vol. 2, n° 4, 2021.
HUMBERT, Mathias; AYDAY, Erman; HUBAUX, Jean-Pierre, et al. Addressing the concerns of
the Lacks family : quantification of kin genomic privacy. In : Proceedings of the 2013 ACM
SIGSAC Conference on Computer & Communications Security. 2013. p. 1141‑1152.
JI, Ziwei et al. Survey of Hallucination in Natural Language Generation. ACM Computing Surveys,
vol. 1, n.1, s/p, 2023.
KAR, Arpan Kumar; VARSHA, P. S.; RAJAN, Shivakami. Unravelling the impact of generative
artificial intelligence (GAI) in industrial applications : a review of scientific and grey literature.
Global Journal of Flexible Systems Management, vol. 24, n° 4, p. 659‑689, 2023.
KARNOUSKOS, Stamatis. Artificial intelligence in digital media : the era of deepfakes. IEEE
Transactions on Technology and Society, vol. 1, n° 3, p. 138‑147, 2020.
KIDD, Jenny et NIETO MCAVOY, Eva. Deep nostalgia : remediated memory, algorithmic
nostalgia and technological ambivalence. Convergence, vol. 29, n° 3, p. 620‑640, 2023.
KIETZMANN, Jan; LEE, Linda W.; MCCARTHY, Ian P., et al. Deepfakes : trick or treat?.
Business Horizons, vol. 63, n° 2, p. 135‑146, 2020.
KRISCHKE-LEITAO, Debora et LANDRYS, Daniella. (2024). Na selva de pixels : Formas de
classificação e dinâmicas sociais em torno de imagens geradas por inteligência artificial. Revista
Brasileira de Sociologia - RBS, 12, e-rbs.1015. https://doi.org/10.20336/rbs.1015
LEITE, Miriam Moreira. Retratos de Família. São Paulo, Editora da Universidade, 2000.
LINS DE BARROS, Myriam Moraes. Memória e família. Estudos Históricos, n.3, v.2. Rio de
Janeiro, p. 29-42, 1989.
MCAVOY, Eva Nieto et KIDD, Jenny. Synthetic heritage : online platforms, deceptive genealogy
and the ethics of algorithmically generated memory. Memory, Mind & Media, vol. 3, p. e12, 2024.
MENIEUR, Axel et al. Les glitchs, ces moments où les algorithmes tremblent. Techniques &
Cultures, supplement au n. 72, 2019.
MESKYS, Edvinas; KALPOKIENE, Julija; JURCYS, Paul, et al. Regulating deep fakes : legal
and ethical considerations. Journal of Intellectual Property Law & Practice, vol. 15, n° 1, p. 24‑31,
MIRESHGHALLAH, Niloofar; ANTONIAK, Maria; MORE, Yash, et al. Trust no bot :
discovering personal disclosures in human-LLM conversations in the wild. arXiv preprint,
arXiv:2407.11438, 2024.
MORI, Masahiro. La vallée de l’étrange. Gradhiva, vol. 15, 2012. Disponível em :
http://journals.openedition.org/gradhiva/2311 . Último acesso em 30 de setembro de 2024.
MYHERITAGE. MyHeritage Deep Nostalgia™ : Deep learning technology to animate the faces
in still family photos. MyHeritage, s.d. Disponível em: https://www.myheritage.com/deepnostalgia. Último acesso em 27 de setembro de 2024
NATALE, Simone. Supernatural Entertainments : Victorian Spiritualism and the Rise of Modern
Media Culture. Pennsylvania, The Pennsylvania State University Press, 2016.
NISSENBAUM, Helen. Privacy in context : technology, policy, and the integrity of social life.
Journal of Information Policy, vol. 1, p. 149‑151, 2011.
Revista Iluminuras
NOBLE, Safiya Umoja. Algorithms of oppression : How search engines reinforce racism. New
York : New York University Press, 2018.
NOVAES, Silvia Caiuby. Imagem, magia e imaginação: desafios ao texto antropológico. Mana,
Rio de Janeiro, vol. 14, n.2, p.455–475, 2008.
NTOUTSI, Eirini; FAFALIOS, Pavlos; GADIRAJU, Ujwal, et al. Bias in data‐driven artificial
intelligence systems : an introductory survey. Wiley Interdisciplinary Reviews : Data Mining and
Knowledge Discovery, vol. 10, n° 3, p. e1356, 2020.
PEREZ DASILVA, Jesus; MESO AYERDI, Koldobika; MENDIGUREN GALDOSPIN, Terese.
Deepfakes on Twitter : which actors control their spread ?. Media and Communication, vol. 9, n°
, p. 301‑312, 2021.
PU, Jiameng; MANGAOKAR, Neal; KELLY, Lauren, et al. Deepfake videos in the wild : analysis
and detection. In : Proceedings of the Web Conference 2021. 2021. p. 981‑992.
RINI, Regina. Deepfakes and the epistemic backstop. 2020.
SANTOS, Carolina Junqueira. dos. Amor, morte, fotografia. PÓS: Revista do Programa de Pósgraduação em Artes da EBA/UFMG, Belo Horizonte, p. 188–199, 2016.
SANTOS, Carolina Junqueira. dos. Um lugar para o corpo: fotografias familiares em contexto de
luto. Revista M. Estudos Sobre a Morte, Os Mortos E O Morrer, vol.2, n.3, p.8–29, 2019.
SILVA, Marcelo Almeida de Carvalho et al. A Volkswagen e a ditadura: a colaboração da
montadora alemã com a repressão aos trabalhadores durante o regime civil-militar brasileiro.
Revista Brasileira De História, vol. 42, n. 89, p.141-164, 2022.
SURESH, Harini e GUTTAG, John. A framework for understanding sources of harm throughout
the machine learning life cycle. In : Proceedings of the 1st ACM Conference on Equity and Access
in Algorithms, Mechanisms, and Optimization. 2021. p. 1‑9.
THIES, Justus; ZOLLHOFER, Michael; STAMMINGER, Marc, et al. Face2face : real-time face
capture and reenactment of RGB videos. In : Proceedings of the IEEE Conference on Computer
Vision and Pattern Recognition. 2016. p. 238
VAN DIJCK, José. Mediated Memories in the Digital Age. Redwood City, Stanford University
Press, 2007.
WESTIN, Alan F. Privacy and freedom. New York : Atheneum, 1967.
ZANINI, Maria Catarina Chitolina. Assistir, ouvir, ler e narrar: o papel da mídia nas construções
identitárias étnicas . Revista de Antropologia, São Paulo, v. 48, n. 2, p. 699–736, 2005.
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 ILUMINURAS
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Todo o conteúdo do periódico, exceto onde está identificado, está licenciado sob uma Licença Creative Commons do tipo atribuição BY-NC.
O envio dos trabalhos implica a cessão imediata e sem ônus dos direitos de publicação para a revista, a qual é filiada ao sistema Creative Commons, atribuição CC BY-NC (https://creativecommons.org/licenses/by-nc/4.0/). O autor é integralmente responsável pelo conteúdo do artigo e continua a deter todos os direitos autorais para publicações posteriores do mesmo, devendo, se possível, fazer constar a referência à primeira publicação na revista. Esta não se compromete a devolver as contribuições recebidas.
O(s) autor(es) que submete (m) artigos para publicação na revista Iluminuras são legalmente responsáveis pela garantia de que o trabalho não constitui infração de direitos autorais, isentando a Revista Iluminuras quanto a qualquer falha quanto a essa garantia.
