Human Generated Data

Title

Katyn and Mrs. B.
Date

c. 1973
People

Artist: Gus Kayafas, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.873

Human Generated Data

Title

Katyn and Mrs. B.

People

Artist: Gus Kayafas, American

Date

c. 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.873

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.9
Human 98.9
Person 96.7
Interior Design 96.4
Indoors 96.4
Canvas 86.9
Face 70.6
Art 70.5
Drawing 70.4
Screen 68.8
Electronics 68.8
LCD Screen 68.6
Monitor 68.6
Display 68.6
Advertisement 67.6
Mirror 61.9
Poster 59
Photo Booth 57.9
Collage 57.3
Room 55

Clarifai
created on 2023-10-25

portrait 99.9
people 99.6
monochrome 98.6
collage 96.7
old 95.9
adult 94.8
vintage 94.1
movie 94
art 94
retro 92.4
woman 91.4
picture frame 91.2
sepia 91
man 90.5
baby 90.4
two 89.9
desktop 88.1
smile 88
face 86.5
snapshot 85.9

Imagga
created on 2022-01-09

billboard 64
television 53.9
signboard 51.1
telecommunication system 37.7
structure 33.8
portrait 23.3
car mirror 22.4
person 20.2
happy 19.4
mirror 19.1
attractive 18.2
adult 18.1
pretty 17.5
people 16.7
face 15.6
sexy 15.3
body 15.2
smile 15
smiling 14.5
car 13.8
reflector 13.4
business 12.8
one 12.7
hair 12.7
man 12.1
blond 11.8
black 11.4
human 11.2
money 11.1
love 11
vehicle 10.3
youth 10.2
currency 9.9
fashion 9.8
lady 9.7
erotic 9.7
driver 9.7
driving 9.7
film 9.5
eyes 9.5
lifestyle 9.4
cute 9.3
cash 9.2
close 9.1
fun 9
transportation 9
couple 8.7
happiness 8.6
model 8.6
drive 8.5
male 8.5
looking 8
women 7.9
automobile 7.7
skin 7.6
hand 7.6
lying 7.5
child 7.4
banking 7.4
sensual 7.3

Google
created on 2022-01-09

Smile 92.1
Jaw 88.1
Rectangle 86.4
Gesture 85.3
Chest 79.7
Art 79
Happy 76.9
Monochrome photography 72.7
Monochrome 70.5
Font 69.2
Stock photography 63.5
Visual arts 62.8
Fur 57.3
Picture frame 56.9
Photographic paper 56.8
Flesh 56.4
Photo caption 55.1
Sitting 53.9
Painting 52.6
Portrait 51

Microsoft
created on 2022-01-09

text 98.9
drawing 90.1
human face 90
sketch 87
person 64.1
smile 60.9
gallery 59.1
painting 58.6
woman 57.9
old 56.5
art 54.2
picture frame 43.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 99.9%
Sad 0%
Surprised 0%
Calm 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Categories

Imagga

paintings art 61.1%
pets animals 29.7%
people portraits 8.3%

Captions

Microsoft
created on 2022-01-09

an old photo of a person 83.3%
old photo of a person 81.7%
an old photo of a person 74%

Text analysis

Amazon

B.
Katyu
Katyu f Mr. B.
the
f
the Kayafan
Mr.
Kayafan

Google

+ Mu. B.
+
Mu.
B.