Human Generated Data

Title

Untitled (bride and groom walking to car)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.429.23

Human Generated Data

Title

Untitled (bride and groom walking to car)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 98.9
Person 98.9
Person 98.8
Person 98.6
Person 97.3
Person 97.3
Person 97
Person 95.8
Apparel 93.3
Clothing 93.3
Crowd 89.6
Person 89.5
Person 89.4
Person 84.3
Coat 71.9
People 71.3
Food 69.8
Meal 69.8
Overcoat 69.6
Person 68
Person 62.3
Audience 60.6
Face 60.2
Suit 51.7

Clarifai
created on 2019-03-25

people 99.9
group 99.6
group together 98.8
adult 97.6
many 97.1
woman 96.9
man 96.2
several 92.5
leader 90.5
five 90.3
facial expression 89.7
administration 89.3
portrait 89.2
four 88
child 82
wear 75.9
actress 75.3
employee 70.1
outfit 69.5
three 69.4

Imagga
created on 2019-03-25

kin 45.9
people 36.8
man 29.5
couple 27.9
male 27.7
adult 24.4
home 23.9
person 23.9
nurse 23
happy 19.4
groom 19.3
happiness 18.8
business 18.2
senior 17.8
two 16.9
love 16.6
men 16.3
portrait 16.2
room 16
family 16
women 15.8
mature 15.8
old 15.3
indoors 14
husband 13.5
bride 13.4
medical 13.2
group 12.9
hospital 12.6
team 12.5
care 12.3
wife 12.3
meeting 12.2
standing 12.2
mother 12.1
wedding 11.9
smiling 11.6
lifestyle 11.6
businessman 11.5
smile 11.4
talking 11.4
office 11.2
dress 10.8
classroom 10.7
cheerful 10.6
married 10.5
new 10.5
health 10.4
bouquet 10.4
businesswoman 10
brunette 9.6
elderly 9.6
clothing 9.6
sitting 9.4
face 9.2
20s 9.2
indoor 9.1
looking 8.8
together 8.8
discussion 8.8
colleagues 8.7
30s 8.6
retirement 8.6
work 8.6
businesspeople 8.5
house 8.4
color 8.3
inside 8.3
aged 8.1
child 8.1
interior 8
to 8
medicine 7.9
newly 7.9
holiday 7.9
world 7.9
discussing 7.9
loving 7.6
casual 7.6
doctor 7.5
human 7.5
patient 7.3
life 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.7
posing 90.2
people 86.7
group 83.7
standing 78.9
old 53.8
black and white 4.7
retro 3.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.6%
Sad 6.4%
Angry 2.4%
Calm 1.7%
Surprised 3.1%
Happy 75.5%
Confused 2.4%
Disgusted 8.4%

AWS Rekognition

Age 26-43
Gender Male, 74.3%
Calm 2.6%
Sad 4%
Surprised 4.1%
Confused 1.7%
Happy 85.3%
Angry 1.4%
Disgusted 1%

AWS Rekognition

Age 26-44
Gender Female, 99.5%
Sad 0.3%
Surprised 0.5%
Disgusted 0.9%
Happy 96.5%
Angry 1.1%
Confused 0.5%
Calm 0.1%

AWS Rekognition

Age 57-77
Gender Male, 96.7%
Confused 8.4%
Angry 2.5%
Surprised 2.6%
Disgusted 5.6%
Calm 8.5%
Happy 71.3%
Sad 1.2%

AWS Rekognition

Age 20-38
Gender Male, 98.2%
Angry 8.2%
Happy 17.6%
Sad 39.5%
Confused 10.9%
Disgusted 5.9%
Calm 14.3%
Surprised 3.5%

AWS Rekognition

Age 35-52
Gender Female, 98.4%
Happy 90%
Calm 0.6%
Angry 1.4%
Disgusted 1%
Confused 0.7%
Surprised 1.7%
Sad 4.8%

AWS Rekognition

Age 26-44
Gender Male, 54.2%
Sad 49.3%
Disgusted 45.8%
Calm 45.6%
Happy 48%
Confused 45.3%
Surprised 45.4%
Angry 45.7%

AWS Rekognition

Age 45-63
Gender Female, 98.2%
Disgusted 0.1%
Surprised 0.3%
Confused 0.1%
Angry 1%
Sad 0.2%
Calm 0.1%
Happy 98.2%

AWS Rekognition

Age 26-43
Gender Female, 98.7%
Calm 51.5%
Disgusted 3.8%
Confused 7%
Happy 20.4%
Surprised 6.3%
Angry 5.1%
Sad 5.9%

AWS Rekognition

Age 38-57
Gender Male, 99.6%
Angry 0.8%
Disgusted 0.4%
Surprised 0.6%
Sad 0.6%
Confused 0.8%
Calm 0.1%
Happy 96.8%

AWS Rekognition

Age 38-59
Gender Female, 54.5%
Sad 53.6%
Surprised 45.1%
Calm 45%
Confused 45.1%
Happy 45.8%
Disgusted 45.1%
Angry 45.2%

AWS Rekognition

Age 49-69
Gender Female, 53.1%
Angry 45.1%
Disgusted 45.1%
Sad 51%
Surprised 45.1%
Happy 48.5%
Calm 45.2%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Female, 51.9%
Happy 50.6%
Sad 48.5%
Surprised 45.2%
Disgusted 45.1%
Angry 45.4%
Calm 45.1%
Confused 45.1%

AWS Rekognition

Age 57-77
Gender Male, 99.2%
Sad 0.6%
Angry 1%
Calm 0.4%
Surprised 0.5%
Happy 94.7%
Confused 2.2%
Disgusted 0.7%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Angry 45.3%
Surprised 45.3%
Sad 45.5%
Calm 53.1%
Confused 45.2%
Happy 45.4%
Disgusted 45.3%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Suit 51.7%

Captions

Microsoft

Alben W. Barkley et al. posing for a photo 99.3%
Alben W. Barkley et al. posing for the camera 99.2%
Alben W. Barkley et al. posing for a picture 99.1%