Human Generated Data

Title

Untitled (full-length portrait of mother and child seated in front of painted backdrop depicting beach resort setting)

Date

c. 1856 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.14071

Human Generated Data

Title

Untitled (full-length portrait of mother and child seated in front of painted backdrop depicting beach resort setting)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 100
Clothing 100
Hat 99.9
Bonnet 99.9
Person 97.9
Human 97.9
Person 96.2
Female 86.8
Costume 85.2
Face 78.6
People 72.3
Woman 70.9
Art 70.3
Painting 70.3
Sun Hat 69.2
Portrait 67.2
Photography 67.2
Photo 67.2
Girl 66.9
Kid 61.3
Child 61.3
Baby 60.3
Dress 56.6

Imagga
created on 2022-01-28

kin 44.6
portrait 23.3
man 22.2
brother 21.8
person 19.2
black 18.7
culture 17.9
male 17.3
people 17.3
sibling 17.1
art 15.1
face 14.9
child 14.5
adult 14.2
mother 12.9
sexy 12.8
dress 12.6
fashion 12.1
attractive 11.9
romantic 11.6
family 11.6
couple 11.3
performer 10.9
vintage 10.7
happy 10.6
one 10.4
old 10.4
makeup 10.1
religion 9.9
body 9.6
brunette 9.6
decoration 9.5
golden 9.5
grunge 9.4
model 9.3
head 9.2
holding 9.1
human 9
lady 8.9
posing 8.9
symbol 8.7
parent 8.7
love 8.7
happiness 8.6
party 8.6
old fashioned 8.6
comedian 8.5
traditional 8.3
silhouette 8.3
sport 8.2
hair 7.9
look 7.9
masquerade 7.9
antique 7.8
ancient 7.8
sepia 7.8
card 7.6
style 7.4
closeup 7.4
daughter 7.3
aged 7.2
color 7.2
celebration 7.2
smile 7.1
world 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

clothing 98.8
person 97.8
human face 97.4
smile 97.2
text 96.7
old 96.5
posing 94.5
outdoor 93.4
toddler 77.7
baby 77.7
hat 71.2
woman 69.4
child 64.2
vintage 60.4
girl 56.7
retro 52.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 78.1%
Happy 7.2%
Surprised 5.3%
Sad 2.9%
Fear 1.8%
Disgusted 1.7%
Angry 1.5%
Confused 1.4%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 39%
Sad 38.5%
Surprised 9.9%
Confused 7.1%
Disgusted 1.9%
Angry 1.9%
Fear 1.1%
Happy 0.5%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%
Painting 70.3%

Captions

Microsoft

a vintage photo of a person sitting posing for the camera 93.7%
a vintage photo of a little girl posing for a picture 83.5%
a vintage photo of a girl sitting on a bench posing for the camera 83.4%