Human Generated Data

Title

Untitled (studio portrait of family with eight men and six women)
Date

c. 1931-1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5846

Human Generated Data

Title

Untitled (studio portrait of family with eight men and six women)

People

Artist: Durette Studio, American 20th century

Date

c. 1931-1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
People 99.7
Family 99.7
Person 99.4
Person 99.3
Person 98.9
Person 98.5
Person 98.4
Person 98.1
Person 97.6
Person 97.4
Person 96.9
Person 96.2
Person 96.2
Person 95.1
Person 93.3
Overcoat 92.7
Suit 92.7
Coat 92.7
Apparel 92.7
Clothing 92.7
Person 88.1
Suit 72.1
Tie 69.2
Accessory 69.2
Accessories 69.2
Suit 61.8

Clarifai
created on 2019-11-16

people 99.9
group 99.8
group together 99.1
many 98.9
adult 97
woman 96.6
man 94.8
actress 94.2
child 93.8
administration 93.6
wear 93.3
leader 93.3
offspring 92.3
several 92
family 88.2
street 88.1
musician 87.8
music 86.5
outfit 85.8
five 85.4

Imagga
created on 2019-11-16

kin 100
people 31.2
man 28.2
male 24.1
person 23.4
group 21.7
happy 18.8
portrait 18.7
men 18
black 16.2
adult 15
couple 14.8
women 13.4
family 13.3
silhouette 13.2
sport 12.7
child 12.6
team 12.5
smiling 12.3
dress 11.7
together 11.4
fashion 11.3
friendship 11.2
mother 11
happiness 11
world 10.9
smile 10.7
human 10.5
boy 10.4
lifestyle 10.1
body 9.6
grunge 9.4
action 9.3
dark 9.2
girls 9.1
business 9.1
active 9
fun 9
kid 8.9
businessman 8.8
urban 8.7
crowd 8.6
youth 8.5
outdoor 8.4
attractive 8.4
exercise 8.2
looking 8
celebration 8
standing 7.8
daughter 7.8
model 7.8
play 7.7
run 7.7
casual 7.6
legs 7.5
friends 7.5
outdoors 7.5
new 7.3
children 7.3
success 7.2
sexy 7.2
fitness 7.2
nurse 7.2
holiday 7.2
childhood 7.2
hair 7.1
face 7.1
love 7.1

Google
created on 2019-11-16

Photograph 97.1
People 96.9
Social group 91.9
Snapshot 85.4
Standing 79.6
Black-and-white 78.1
Photography 72.5
Family 71
Monochrome 67.6
Child 64.5
Classic 56.7
History 54.1
Vintage clothing 50.7

Microsoft
created on 2019-11-16

person 99.8
clothing 99
smile 98.5
posing 98.5
standing 95.6
group 94.5
text 94.3
woman 93.4
human face 89.6
man 85.6
footwear 72.5
people 68.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 54.9%
Calm 45.5%
Confused 45%
Fear 45%
Sad 45.1%
Angry 45%
Surprised 45%
Disgusted 45%
Happy 54.3%

AWS Rekognition

Age 25-39
Gender Female, 54.2%
Fear 45%
Sad 45%
Disgusted 45%
Happy 54.9%
Angry 45%
Calm 45%
Surprised 45%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 53.9%
Sad 45.1%
Surprised 45%
Confused 45%
Angry 45.1%
Calm 54.6%
Fear 45%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 12-22
Gender Female, 53.7%
Surprised 45.1%
Confused 45.6%
Calm 48.9%
Happy 45%
Sad 47.7%
Angry 47.2%
Disgusted 45.2%
Fear 45.2%

AWS Rekognition

Age 19-31
Gender Female, 53.6%
Surprised 45%
Angry 45%
Sad 45.2%
Fear 45%
Disgusted 45%
Happy 45.1%
Calm 54.6%
Confused 45.1%

AWS Rekognition

Age 20-32
Gender Male, 52.3%
Disgusted 45%
Angry 45.2%
Confused 45.1%
Sad 50.1%
Calm 49.5%
Happy 45.1%
Fear 45%
Surprised 45%

AWS Rekognition

Age 26-42
Gender Male, 52.8%
Disgusted 45%
Confused 45%
Sad 45.1%
Calm 48.3%
Angry 45.1%
Fear 45%
Surprised 45.1%
Happy 51.4%

AWS Rekognition

Age 24-38
Gender Male, 54.6%
Happy 45.8%
Confused 45%
Calm 54%
Fear 45%
Angry 45.1%
Sad 45.1%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 21-33
Gender Male, 54.9%
Confused 45%
Surprised 45%
Calm 54.8%
Fear 45%
Disgusted 45%
Happy 45.2%
Sad 45%
Angry 45%

AWS Rekognition

Age 22-34
Gender Male, 53.5%
Confused 45%
Surprised 45%
Happy 47.9%
Sad 45.1%
Disgusted 45%
Angry 45%
Calm 52%
Fear 45%

AWS Rekognition

Age 23-37
Gender Male, 53.9%
Happy 54.9%
Calm 45.1%
Fear 45%
Confused 45%
Angry 45%
Surprised 45%
Disgusted 45%
Sad 45%

AWS Rekognition

Age 20-32
Gender Male, 54.4%
Disgusted 45.9%
Happy 49.8%
Confused 45.3%
Angry 46%
Fear 45.1%
Sad 45.1%
Calm 47.6%
Surprised 45.1%

AWS Rekognition

Age 21-33
Gender Female, 53.4%
Confused 45%
Fear 45%
Calm 54.9%
Happy 45%
Sad 45%
Angry 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 29-45
Gender Male, 54.4%
Surprised 45.1%
Angry 45.1%
Happy 51.4%
Fear 45%
Calm 48.2%
Disgusted 45.1%
Sad 45.1%
Confused 45.1%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 92.7%
Tie 69.2%

Captions

Microsoft

a group of people posing for a photo 98.8%
a group of people posing for a picture 98.7%
a group of people posing for the camera 98.6%