Human Generated Data

Title

Untitled (studio portrait of group with six men and five women)
Date

c. 1910, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5961

Human Generated Data

Title

Untitled (studio portrait of group with six men and five women)

People

Artist: Durette Studio, American 20th century

Date

c. 1910, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-30

People 99.3
Human 99.3
Family 99.3
Person 98.9
Person 98.7
Person 98.6
Person 98.6
Person 98.4
Person 98.2
Person 97.1
Person 96.9
Person 96.3
Person 90.4
Person 85.2

Clarifai
created on 2019-05-30

people 100
group 99.5
adult 98.5
portrait 97.9
child 97.1
woman 96.5
wear 95.9
man 95.3
many 95.1
outfit 93.5
leader 93
administration 92.3
music 92.3
group together 91.4
one 90.2
facial expression 89.8
musician 89.5
uniform 88.4
furniture 87
offspring 86.8

Imagga
created on 2019-05-30

kin 42
person 27.2
man 24.8
people 24
male 23.4
uniform 20.6
astronaut 17.6
player 15.8
military uniform 15.6
adult 15
portrait 14.9
clothing 14
athlete 13.1
men 12.9
human 12.7
black 12.4
sport 11.2
ballplayer 11
happy 10
play 9.5
model 9.3
contestant 9.2
world 9
couple 8.7
boy 8.7
lifestyle 8.7
one 8.2
sexy 8
covering 7.9
love 7.9
professional 7.8
smile 7.8
child 7.8
color 7.8
military 7.7
youth 7.7
power 7.5
fun 7.5
style 7.4
art 7.4
group 7.2
ball 7.2
team 7.2
game 7.1
women 7.1
night 7.1
helmet 7.1

Google
created on 2019-05-30

People 95.9
Photograph 94.8
Art 70.9
Picture frame 68.9
Family 65.7
Painting 65.4
Photography 62.4
Black-and-white 56.4
Portrait 51.6

Microsoft
created on 2019-05-30

clothing 98.4
posing 96
human face 93.8
smile 92.1
old 92.1
person 87.2
baby 87
child 81.4
man 80.5
toddler 70.4
boy 70
group 65.4
family 56.4
clothes 15.7
picture frame 9.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 54.9%
Sad 49.1%
Disgusted 45.1%
Angry 45.5%
Happy 45.2%
Surprised 45.4%
Confused 45.5%
Calm 49.1%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Happy 45.1%
Confused 45.1%
Calm 54.5%
Angry 45.1%
Sad 45.1%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 38-57
Gender Male, 54.9%
Disgusted 45.2%
Angry 46.8%
Surprised 45.7%
Confused 46.9%
Happy 45.2%
Sad 46%
Calm 49.2%

AWS Rekognition

Age 12-22
Gender Male, 50.9%
Sad 50.3%
Happy 45.1%
Angry 46%
Confused 45.5%
Surprised 45.3%
Disgusted 45.2%
Calm 47.5%

AWS Rekognition

Age 38-59
Gender Male, 52.2%
Disgusted 47%
Sad 49.1%
Confused 45.3%
Calm 47.2%
Happy 45.1%
Angry 45.9%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Sad 45.5%
Disgusted 45.1%
Surprised 45.3%
Calm 52.7%
Angry 45.8%
Confused 45.5%
Happy 45.1%

AWS Rekognition

Age 23-38
Gender Male, 54.7%
Angry 45.8%
Sad 45.7%
Surprised 45.4%
Confused 45.5%
Happy 45.1%
Calm 52.4%
Disgusted 45.2%

AWS Rekognition

Age 10-15
Gender Female, 54.4%
Sad 47.3%
Happy 45.3%
Angry 46.2%
Confused 45.6%
Surprised 47.3%
Disgusted 45.2%
Calm 48.2%

AWS Rekognition

Age 20-38
Gender Female, 51.2%
Angry 47.9%
Disgusted 47.3%
Happy 45.2%
Sad 47.2%
Calm 46.1%
Surprised 45.9%
Confused 45.4%

AWS Rekognition

Age 27-44
Gender Male, 53.2%
Sad 45%
Happy 45%
Angry 45.1%
Confused 45%
Surprised 45%
Disgusted 45.3%
Calm 54.5%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Happy 45%
Angry 45.2%
Sad 45.3%
Disgusted 45.1%
Calm 54.1%
Confused 45.1%
Surprised 45.1%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.1%
a vintage photo of a group of people posing for a picture 93%
a group of people posing for a photo 92.9%