Human Generated Data

Title

Untitled (two men standing holding hats in hand)
Date

c. 1930
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4255

Human Generated Data

Title

Untitled (two men standing holding hats in hand)

People

Artist: Durette Studio, American 20th century

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 99.2
Clothing 99.2
Person 98.1
Human 98.1
Person 97.2
Accessory 95.1
Accessories 95.1
Tie 95.1
Suit 94.5
Overcoat 94.5
Coat 94.5
Shirt 82.8
Lab Coat 74
Tie 72.1
Tuxedo 62.7
Linen 60.6
Home Decor 60.6

Clarifai
created on 2019-06-01

people 99.6
man 97.5
adult 96.2
wear 94.3
woman 93.4
veil 90.7
group 90.1
two 86.7
monochrome 86.7
science 85.7
retro 84.7
scientist 84.3
group together 81.6
one 80.4
portrait 79.6
actor 77.7
business 76.4
three 72.4
desktop 71.5
vehicle 69.9

Imagga
created on 2019-06-01

lab coat 100
coat 99.9
garment 51.4
man 46.4
male 43.3
person 35.6
people 34
doctor 33.8
adult 32.2
professional 32.1
nurse 31.3
clothing 30.6
medical 28.3
businessman 27.4
portrait 25.2
smiling 24.6
job 23.9
looking 23.2
business 23.1
occupation 22.9
work 22.8
happy 21.9
hospital 21.6
senior 21.6
men 21.5
medicine 21.1
health 20.8
office 20.1
worker 19.5
uniform 19
handsome 18.7
mature 18.6
face 18.5
team 17.9
smile 17.8
lab 17.5
laboratory 17.4
stethoscope 17.3
elderly 17.2
bright 17.2
human 15.8
care 15.6
corporate 15.5
clinic 15.3
businesspeople 15.2
confident 14.6
student 14.5
standing 13.9
suit 13.5
attractive 13.3
holding 13.2
women 12.7
science 12.5
indoors 12.3
technology 11.9
scientist 11.8
colleagues 11.7
expertise 11.6
patient 11.6
lifestyle 11.6
serious 11.4
manager 11.2
ruler 11.1
casual 11
two 11
day 11
test 10.6
cheerful 10.6
profession 10.5
modern 10.5
couple 10.5
old 10.5
executive 10.3
necktie 10.2
happiness 10.2
successful 10.1
indoor 10
color 10
older 9.7
one 9.7
chemistry 9.7
success 9.7
education 9.5
research 9.5
light 9.4
teamwork 9.3
glasses 9.3
friendly 9.2
businesswoman 9.1
specialist 9
jacket 8.9
bow tie 8.9
group 8.9
chemical 8.8
look 8.8
mid adult 8.7
30s 8.7
staff 8.6
sitting 8.6
illness 8.6
biology 8.5
hand 8.4
positive 8.3
20s 8.3
working 8
together 7.9
associates 7.9
black 7.8
thoughtful 7.8
assistant 7.8
corporation 7.7
expression 7.7
exam 7.7
confidence 7.7
boss 7.7
tie 7.6
desk 7.6
practitioner 7.6
shirt 7.5
company 7.4
life 7.3
negative 7.2
home 7.2
family 7.1
employee 7.1

Google
created on 2019-06-01

Photograph 97
Gentleman 87.5
Standing 85.3
Snapshot 83.3
Photography 62.4
Stock photography 59.4
Uniform 56.8

Microsoft
created on 2019-06-01

posing 94.5
person 94.1
standing 93.2
clothing 90.4
old 85.5
man 78.4
smile 75.7
human face 71.9
player 69.3
black and white 69.3
black 65.1

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Male, 80.7%
Sad 12.1%
Angry 2.9%
Surprised 3.7%
Calm 74.3%
Disgusted 2.2%
Happy 2.5%
Confused 2.3%

AWS Rekognition

Age 35-52
Gender Male, 93.7%
Angry 2.3%
Happy 3%
Calm 12.3%
Surprised 2.8%
Sad 73.3%
Confused 3.3%
Disgusted 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Tie 95.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 90.4%
a vintage photo of a man and woman posing for a picture 79.7%
a vintage photo of a group of people posing for a picture 79.6%