Human Generated Data

Title

Untitled (family standing in front of large car)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1484

Human Generated Data

Title

Untitled (family standing in front of large car)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.1
Person 99.1
Apparel 96.4
Clothing 96.4
Person 95.8
Person 95.5
Person 95.2
Person 94.7
Person 93.1
Coat 78.5
Footwear 73.8
Shoe 73.8
People 70
Clinic 69.1
Accessory 64.1
Accessories 64.1
Tie 64.1
Photography 57.7
Photo 57.7
Nurse 57.2
Shoe 53.9
Person 53.5

Clarifai
created on 2019-06-01

people 99.2
monochrome 97.3
veil 95.8
adult 93.9
woman 93.4
man 93
group 91.7
wear 90.7
wedding 85.8
vehicle 84.2
illustration 81.2
retro 80.6
bride 78.8
outfit 78.5
desktop 78
child 77.9
portrait 76
indoors 76
family 75.9
vintage 75.8

Imagga
created on 2019-06-01

people 27.3
person 21.3
man 18.1
male 17
professional 15.8
men 15.4
medical 15
glass 14.6
adult 14.5
business 14
brass 13.9
black 13.8
human 12.7
work 12.6
wind instrument 12.4
bride 12
worker 11.9
clothing 11.6
women 11.1
portrait 11
lab 10.7
businessman 10.6
medicine 10.6
office 10.4
doctor 10.3
newspaper 10.2
room 10.2
groom 10.2
wedding 10.1
occupation 10.1
dress 9.9
team 9.8
nurse 9.8
chemistry 9.7
laboratory 9.6
couple 9.6
research 9.5
biology 9.5
instrument 9.4
life 9.4
two 9.3
musical instrument 9.1
modern 9.1
old 9
health 9
patient 8.9
science 8.9
celebration 8.8
planner 8.7
cornet 8.6
happiness 8.6
hand 8.3
drink 8.3
coat 8.2
symbol 8.1
group 8.1
clinic 8
product 8
family 8
water 8
hospital 8
working 7.9
world 7.8
scientist 7.8
color 7.8
bouquet 7.8
scientific 7.7
chemical 7.7
looking 7.2
love 7.1
job 7.1
interior 7.1
day 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wedding dress 98.4
bride 94.9
dress 90.1
clothing 89
black and white 79
person 76.4
wedding 75.7
woman 75.6
appliance 55.4

Face analysis

Amazon

AWS Rekognition

Age 16-27
Gender Female, 53.1%
Happy 46.5%
Confused 45.4%
Angry 46.1%
Disgusted 46.6%
Surprised 45.6%
Sad 45.7%
Calm 49.2%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Happy 45.3%
Disgusted 45.3%
Sad 50.3%
Surprised 45.2%
Angry 45.5%
Calm 48.2%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.8%
Happy 48.9%
Confused 45.3%
Disgusted 45.3%
Sad 48.6%
Calm 46%
Angry 45.4%
Surprised 45.5%

Feature analysis

Amazon

Person 99.1%
Shoe 73.8%
Tie 64.1%

Captions

Microsoft

a group of people standing next to a window 64.5%
a group of people standing in front of a window 62.5%
a group of men standing next to a window 49.8%