Human Generated Data

Title

Untitled (man looking in mirror and fixing his tie)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14301

Human Generated Data

Title

Untitled (man looking in mirror and fixing his tie)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.4
Person 99.4
Clothing 98.5
Apparel 98.5
Person 95.9
Home Decor 91.6
Coat 86.1
Shirt 81.8
Tie 76.7
Accessories 76.7
Accessory 76.7
Overcoat 75.3
Suit 75.3
Tie 73.4
Finger 66.4
Clinic 64.9
Lab Coat 62.1
Art 59.4
Linen 55.4

Imagga
created on 2022-01-29

man 41.7
person 33.7
male 32.8
people 31.8
shower cap 22.2
couple 20.9
clothing 20.5
happy 20.1
nurse 19.7
adult 19
love 18.9
cap 18.1
coat 17.5
work 17.3
portrait 16.8
home 16.7
worker 16.4
smiling 15.9
professional 15.7
lab coat 15.7
men 15.5
face 14.9
groom 14.9
patient 13.5
husband 13.4
happiness 13.3
headdress 13.3
wife 13.3
medical 13.2
study 13.1
lifestyle 13
lab 12.6
laboratory 12.5
senior 12.2
confident 11.8
scientist 11.8
holding 11.6
smile 11.4
looking 11.2
attractive 11.2
sitting 11.2
hair 11.1
garment 11.1
chemistry 10.6
to 10.6
married 10.5
biology 10.4
women 10.3
casual 10.2
occupation 10.1
student 10
care 9.9
family 9.8
human 9.7
business 9.7
together 9.6
profession 9.6
education 9.5
mature 9.3
bathrobe 9.2
health 9
black 9
color 8.9
office 8.8
businessman 8.8
indoors 8.8
busy 8.7
exam 8.6
elderly 8.6
monk 8.6
serious 8.6
college 8.5
two 8.5
old 8.4
hand 8.4
teenager 8.2
cheerful 8.1
robe 7.8
boy 7.8
pretty 7.7
expression 7.7
bride 7.7
research 7.6
room 7.5
doctor 7.5
enjoyment 7.5
leisure 7.5
wedding 7.4
clinic 7.3
romance 7.1
handsome 7.1
job 7.1
apparatus 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

window 98.8
person 98.2
man 97.7
text 96.4
clothing 96.4
wall 95.1
human face 91.8
shirt 85.8
standing 83
glasses 60.8
appliance 55.4

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 92.1%
Surprised 2.2%
Happy 1.9%
Confused 1.5%
Sad 1.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 76.7%
Suit 75.3%

Captions

Microsoft

a man standing in front of a window 91.1%
a man standing in front of a mirror posing for the camera 81.9%
a man standing next to a window 81.8%

Text analysis

Amazon

5