Human Generated Data

Title

Untitled (five men standing with hats, coats, and gloves)

Date

c. 1930

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4254

Human Generated Data

Title

Untitled (five men standing with hats, coats, and gloves)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 100
Apparel 100
Coat 98.6
Person 98.3
Human 98.3
Person 97
Person 97
Person 96.1
Lab Coat 95.6
Person 92.9
Overcoat 80.6
Person 76
Accessories 75.4
Accessory 75.4
Tie 75.4
Text 73.6
Suit 71.6
Tie 68.4
Tie 67.7
Shirt 57.6
Tie 56.7

Clarifai
created on 2019-06-01

people 99.8
group 96.4
group together 96
wear 95.4
man 95.2
adult 95
many 91.4
administration 89.2
monochrome 87.5
several 86.7
woman 86.1
military 85.5
vehicle 84.3
war 84
uniform 83.8
outfit 83.5
three 82.8
five 81.7
child 81
veil 77.6

Imagga
created on 2019-06-01

lab coat 80.3
coat 68.7
garment 43
clothing 38.1
laundry 20.1
man 18.8
clothes 17.8
business 17.6
person 13.9
people 13.4
suit 13.3
adult 13
men 12.9
fashion 12.8
male 12.8
black 12
dress 11.7
uniform 11.3
businessman 10.6
shop 10.5
work 10.2
jacket 9.9
travel 9.9
old 9.7
group 9.7
women 9.5
store 8.5
building 8.2
tourism 8.2
room 8
interior 8
wall 8
health 7.6
casual 7.6
happy 7.5
house 7.5
human 7.5
hanger 7.4
color 7.2
team 7.2
history 7.1
day 7.1
happiness 7.1
indoors 7
architecture 7
wardrobe 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

clothing 96.2
person 89.2
man 80.8
posing 77.1
old 70.8
smile 51.7
clothes 20.2

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Happy 45.9%
Angry 45.7%
Surprised 45.7%
Disgusted 45.4%
Sad 47.7%
Calm 49%
Confused 45.5%

AWS Rekognition

Age 20-38
Gender Female, 51.6%
Confused 45.5%
Disgusted 46.2%
Calm 50.1%
Angry 45.8%
Sad 46.6%
Happy 45.3%
Surprised 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 45.2%
Confused 45.2%
Surprised 45.1%
Happy 45.3%
Sad 52.5%
Calm 46.6%
Disgusted 45.1%

Feature analysis

Amazon

Person 98.3%
Tie 75.4%

Captions

Microsoft

a group of people posing for a photo 86.5%
a group of people posing for a photo in front of a window 78.9%
a group of people posing for the camera 78.8%

Text analysis

Amazon

tut