Human Generated Data

Title

Untitled (two men at party)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20176

Human Generated Data

Title

Untitled (two men at party)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.8
Apparel 99.8
Accessories 97.4
Sunglasses 97.4
Accessory 97.4
Person 96.1
Human 96.1
Person 96
Person 91.1
Person 90.7
Sunglasses 89.2
Shirt 87.3
Person 84.6
Sleeve 84.6
Overcoat 83.2
Coat 83.2
Home Decor 75.3
Robe 73.1
Fashion 73.1
Tie 70.4
Gown 68.7
Officer 63.4
Military Uniform 63.4
Military 63.4
Suit 61.4
Long Sleeve 61.3
Finger 59.7
Evening Dress 59.3
Tuxedo 58.7
Floor 58.4
Female 57.9
Wedding 56.9
Face 56.9
Wedding Gown 56.8

Imagga
created on 2022-03-05

nurse 55.5
man 44.3
person 35.1
male 33.3
people 32.3
worker 26.2
patient 23.9
adult 23.1
men 22.3
work 22
professional 21.3
business 21.2
job 21.2
medical 21.2
doctor 19.7
occupation 16.5
clothing 16.1
surgeon 15.7
helmet 15.7
happy 15.7
team 15.2
businessman 15
case 14.9
equipment 14.3
portrait 14.2
working 14.1
medicine 14.1
coat 14.1
hospital 14
health 13.9
building 13.8
smiling 13.7
industry 13.6
looking 13.6
sick person 13.3
office 13.3
corporate 12.9
standing 12.2
manager 12.1
teamwork 12
women 11.9
clinic 11.8
handsome 11.6
profession 11.5
black 11.4
hat 11.3
safety 11
industrial 10.9
smile 10.7
indoors 10.5
education 10.4
home 10.4
student 10.2
casual 10.2
lifestyle 10.1
uniform 10
mask 9.8
scientist 9.8
science 9.8
surgery 9.8
group 9.7
shower cap 9.6
elderly 9.6
suit 9.5
development 9.5
construction 9.4
senior 9.4
holding 9.1
engineer 9.1
success 8.8
lab 8.7
cap 8.7
chemistry 8.7
architect 8.7
laboratory 8.7
research 8.6
biology 8.5
modern 8.4
mature 8.4
human 8.2
indoor 8.2
confident 8.2
family 8
surgical 7.9
urban 7.9
bright 7.9
couple 7.8
test 7.7
attractive 7.7
executive 7.6
workplace 7.6
foreman 7.6
businesspeople 7.6
career 7.6
meeting 7.5
clothes 7.5
builder 7.5
city 7.5
one 7.5
care 7.4
lab coat 7.3
instrument 7.1
face 7.1
look 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.6
clothing 97.1
standing 92.1
man 90.7
human face 86.9
black and white 84.2
glasses 68.6
smile 63.5
fashion accessory 58

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Happy 54.5%
Calm 44.8%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 64.5%
Calm 70.3%
Happy 19.8%
Surprised 2.7%
Confused 1.8%
Fear 1.6%
Angry 1.4%
Disgusted 1.4%
Sad 1%

AWS Rekognition

Age 34-42
Gender Male, 90.3%
Calm 95.2%
Sad 3%
Surprised 0.8%
Fear 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 48-54
Gender Male, 98.6%
Calm 97.2%
Sad 1.2%
Confused 0.5%
Fear 0.4%
Disgusted 0.3%
Happy 0.2%
Angry 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Sunglasses 97.4%
Person 96.1%
Tie 70.4%
Suit 61.4%

Captions

Microsoft

a person standing in front of a building 93.6%
a man and a woman standing in front of a building 86.1%
a group of men standing in front of a building 86%

Text analysis

Amazon

EAD
YТ3°-