Human Generated Data

Title

Untitled (five men in suits standing on sidewalk next to car)
Date

1937
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3976

Human Generated Data

Title

Untitled (five men in suits standing on sidewalk next to car)

People

Artist: Durette Studio, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Clothing 99.4
Apparel 99.4
Overcoat 98.9
Coat 98.9
Human 96.4
Person 96.4
Person 95.5
Person 95.4
Person 95.2
Person 95.2
Accessories 94.6
Tie 94.6
Accessory 94.6
Tuxedo 84
Sleeve 81.6
Shoe 77.5
Footwear 77.5
Shirt 76.6
Shoe 75.5
Long Sleeve 67.3
Face 63.6
Suit 63.1
Man 63
People 62.6
Transportation 61.9
Vehicle 61.9
Automobile 61.9
Car 61.9
Blazer 61.5
Jacket 61.5
Shorts 57
Crowd 55.2
Suit 53

Clarifai
created on 2019-06-01

people 99.8
group together 99
man 98.3
group 98
adult 96.6
woman 95.7
leader 92.2
wear 89
many 87.5
partnership 84.1
chair 82.6
several 79.2
indoors 78.5
outfit 77.9
administration 73.2
actor 70.9
five 70.9
four 70.3
uniform 70.3
meeting 69.8

Imagga
created on 2019-06-01

man 36.3
professional 35.4
people 34.6
person 32.9
male 32.6
adult 28.4
nurse 28.3
businessman 28.2
business 26.1
team 25.1
brass 24.2
job 23.9
medical 23.8
happy 23.8
doctor 23.5
uniform 22.8
group 21.8
worker 21.1
hospital 20.8
corporate 19.8
men 19.7
smiling 19.5
wind instrument 19.4
portrait 18.8
teamwork 17.6
medicine 17.6
suit 17.5
health 17.4
smile 17.1
stethoscope 16.6
work 16.5
standing 15.6
handsome 15.2
working 15
coat 14.9
mature 14.9
confident 14.6
office 14.5
musical instrument 14
care 14
occupation 13.7
cornet 13.7
colleagues 13.6
clinic 13.4
profession 13.4
clothing 13.1
specialist 12.8
bugle 12.3
adults 12.3
together 12.3
surgeon 12.2
looking 12
businesswoman 11.8
day 11.8
practitioner 11.7
40s 11.7
laboratory 11.6
diversity 11.5
couple 11.3
patient 11.3
success 11.3
company 11.2
women 11.1
golfer 11
black 10.8
doctors 10.8
clinical 10.7
full length 10.7
practice 10.6
building 10.5
successful 10.1
attractive 9.8
family 9.8
player 9.8
angle 9.6
partnership 9.6
career 9.5
healthy 9.4
meeting 9.4
senior 9.4
manager 9.3
employee 9.2
executive 8.7
hands 8.7
corporation 8.7
happiness 8.6
ethnic 8.6
staff 8.5
two 8.5
old 8.4
treatment 8.3
window 8.2
friendly 8.2
wicket 7.9
surgical 7.9
coworkers 7.9
diverse 7.8
assistant 7.8
health care 7.8
workers 7.8
sick 7.7
mid adult 7.7
30s 7.7
contestant 7.7
cricket equipment 7.6
casual 7.6
illness 7.6
hand 7.6
businesspeople 7.6
human 7.5
clothes 7.5
20s 7.3
cheerful 7.3
baron 7.3
outfit 7
indoors 7
modern 7

Google
created on 2019-06-01

Photograph 96.5
Standing 87.9
Snapshot 84.5
Gentleman 76.6
Photography 62.4
Suit 56.8
Team 52.3

Microsoft
created on 2019-06-01

person 98
black and white 93.2
posing 92
standing 89.5
clothing 85.5
man 84.1
group 79.2
old 76.9
player 69.5
ship 62.7
clothes 23

Face analysis

Amazon

AWS Rekognition

Age 38-59
Gender Female, 50.5%
Confused 45.8%
Calm 48.9%
Sad 49.3%
Surprised 45.2%
Angry 45.4%
Disgusted 45.2%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Male, 55.4%
Surprised 6.1%
Sad 12.3%
Angry 4.8%
Disgusted 3.2%
Calm 64.1%
Happy 4.3%
Confused 5.2%

AWS Rekognition

Age 26-43
Gender Female, 50.9%
Sad 51%
Calm 47.5%
Surprised 45.3%
Angry 45.3%
Disgusted 45.3%
Happy 45.5%
Confused 45.2%

Feature analysis

Amazon

Person 96.4%
Tie 94.6%
Shoe 77.5%
Suit 63.1%
Car 61.9%

Captions

Microsoft

a group of people posing for a photo 94.7%
a group of people posing for the camera 94.6%
a group of people posing for a picture 94.5%

Text analysis

Amazon

i