Human Generated Data

Title

Untitled (two women in white blouses and long skirts, seated, full-length, parlor setting backdrop)
Date

c.1856 - c.1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3860

Human Generated Data

Title

Untitled (two women in white blouses and long skirts, seated, full-length, parlor setting backdrop)

People

Artist: Unidentified Artist,

Date

c.1856 - c.1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Person 99.5
Human 99.5
Person 99.2
Painting 94.2
Art 94.2
Clothing 89
Apparel 89
Chef 74.8
Crypt 55.2

Clarifai
created on 2021-04-03

people 99.9
portrait 99.4
two 98.9
offspring 98.4
child 98.2
adult 98.2
woman 97.9
wear 97.3
family 97
son 96.9
group 96.6
three 96.5
man 96.4
four 91.1
sibling 91
baby 90.7
music 85.3
theater 84.6
retro 84.5
actor 82.6

Imagga
created on 2021-04-03

kin 23.3
man 22.8
dress 21.7
portrait 18.8
person 18
people 17.8
brother 17.5
male 16
child 15.9
dark 15
couple 13.9
black 13.8
adult 13.6
old 13.2
happy 12.5
family 12.5
love 11.8
religion 11.6
happiness 11
world 10.9
fashion 10.5
ancient 10.4
traditional 10
face 9.9
posing 9.8
room 9.6
hair 9.5
culture 9.4
cell 9.2
vintage 9.1
attractive 9.1
romantic 8.9
sexy 8.8
building 8.8
body 8.8
boy 8.7
wall 8.5
mother 8.4
human 8.2
light 8
interior 8
together 7.9
architecture 7.8
antique 7.8
model 7.8
youth 7.7
costume 7.6
father 7.6
passion 7.5
relationship 7.5
religious 7.5
one 7.5
tradition 7.4
suit 7.3
art 7.2
romance 7.1
smile 7.1

Google
created on 2021-04-03

Chair 82.3
Tints and shades 77.4
Vintage clothing 75.6
Art 69.2
Classic 68
Room 66.2
Sitting 66.2
History 64.7
Stock photography 63.7
Event 63.6
Visual arts 62.5
Retro style 56.1
Rectangle 55.4
Portrait 54.6
Paper product 54
Photographic paper 53.5
Picture frame 52.3
Family 50.3

Microsoft
created on 2021-04-03

clothing 98.8
human face 95.7
text 95.6
person 92.9
black 83.6
woman 81.6
retro 76.9
old 76.9
posing 68
white 67.5
smile 67.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Male, 89.3%
Calm 98.5%
Angry 0.5%
Sad 0.3%
Surprised 0.3%
Fear 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 30-46
Gender Female, 94.8%
Calm 95.6%
Sad 2.2%
Angry 0.8%
Surprised 0.5%
Fear 0.4%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 94.2%

Captions

Microsoft

a group of people posing for a photo in front of a window 78.3%
a group of people posing for a photo 78.2%
a man standing in front of a window posing for the camera 71.4%