Human Generated Data

Title

Untitled (double portrait of man in hat and gingham jacket smoking a cigarette)

Date

c. 1956

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11104

Human Generated Data

Title

Untitled (double portrait of man in hat and gingham jacket smoking a cigarette)

People

Artist: Claseman Studio, American 20th century

Date

c. 1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Apparel 100
Clothing 100
Hat 99.5
Human 99.4
Person 99.4
Person 99.4
Hat 99.3
Sun Hat 97.9
Face 79.8
Shirt 74.5
Cowboy Hat 71.6
Suit 69.9
Coat 69.9
Overcoat 69.9
Photography 60.7
Portrait 60.7
Photo 60.7
Finger 56.1

Clarifai
created on 2019-03-26

people 98.7
lid 98.4
man 98
adult 94.4
veil 94.2
group 92.1
woman 90.4
chef 90.1
uniform 86.2
actor 84.8
portrait 81.2
indoors 76.4
group together 75.8
cap 72.8
retro 71.9
desktop 71.5
young 68.6
cooking 68.5
wear 68.3
business 66.5

Imagga
created on 2019-03-26

nurse 66.6
negative 38.7
people 31.2
film 30.8
professional 28.3
man 25.7
medical 24.7
male 24.1
medicine 23.8
laboratory 23.1
photographic paper 23
person 22.9
work 22
worker 21.5
hat 21.4
lab 21.4
doctor 19.7
portrait 19.4
adult 19
research 18.1
test 17.3
biology 17.1
health 16.7
scientist 16.6
scientific 16.5
science 16
occupation 15.6
chemical 15.4
photographic equipment 15.4
job 15
human 15
chemist 14.7
chemistry 14.5
happy 14.4
face 14.2
working 14.1
tube 13.5
happiness 13.3
student 12.7
technology 12.6
holding 12.4
care 12.3
hand 12.1
men 12
biotechnology 11.8
team 11.6
couple 11.3
coat 11.2
business 10.9
equipment 10.7
looking 10.4
industry 10.2
smiling 10.1
smile 10
attractive 9.8
clothing 9.8
experiment 9.7
clinic 9.7
groom 9.6
serious 9.5
development 9.5
uniform 9.5
love 9.5
child 9.4
glass 9.3
two 9.3
teamwork 9.3
bride 9.1
cheerful 8.9
new 8.9
microbiology 8.9
analysis 8.8
life 8.7
women 8.7
instrument 8.7
education 8.7
hospital 8.6
cowboy hat 8.3
year 8.2
dress 8.1
lady 8.1
suit 8.1
handsome 8
celebration 8
lifestyle 7.9
holiday 7.9
biochemistry 7.9
microscope 7.9
sample 7.8
assistant 7.8
expertise 7.8
builder 7.7
gift 7.7
construction 7.7
pretty 7.7
exam 7.7
mask 7.6
wedding 7.4
successful 7.3
group 7.2
success 7.2
office 7.2
family 7.1
kid 7.1
day 7.1
together 7

Google
created on 2019-03-26

Microsoft
created on 2019-03-26

person 96.9
old 92.6
player 71.5
hat 64.9
posing 59.8
people 59.5
older 40.3
vintage 35.8

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Male, 99%
Happy 12.3%
Surprised 8.6%
Angry 6.2%
Disgusted 3.5%
Confused 6.6%
Sad 11.7%
Calm 51.2%

AWS Rekognition

Age 26-43
Gender Male, 96.9%
Angry 5.5%
Calm 56.1%
Sad 6.2%
Surprised 9.5%
Confused 10.1%
Disgusted 4.2%
Happy 8.3%

Feature analysis

Amazon

Hat 99.5%
Person 99.4%
Suit 69.9%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.3%
a vintage photo of a group of people posing for a picture 93.1%
a vintage photo of a man and woman posing for a picture 85.2%

Text analysis

Amazon

oUu