Human Generated Data

Title

Untitled (five men wearing nametags)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20178

Human Generated Data

Title

Untitled (five men wearing nametags)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.4
Person 99.4
Person 99
Clothing 98.8
Apparel 98.8
Person 98.5
Person 98.1
Person 97.3
Person 96.5
Person 93.8
Accessories 93
Tie 93
Accessory 93
Sleeve 86.6
Tie 76
Coat 74.9
Military Uniform 72
Officer 72
Military 72
Overcoat 71.1
Suit 71.1
Sailor Suit 70.1
Handrail 65.1
Banister 65.1
Long Sleeve 62.6
Shirt 62.1
Person 61.1
Clinic 59.4
Female 57.4
Cake 57
Creme 57
Food 57
Dessert 57
Cream 57
Icing 57
Face 55.6

Imagga
created on 2022-03-05

man 43
male 38.3
doctor 35.7
nurse 35.7
person 34.6
professional 32.6
people 31.2
medical 30
businessman 30
business 29.8
team 29.6
hospital 29.5
job 29.2
adult 28.5
group 27.4
happy 25.7
medicine 24.7
smiling 24.6
patient 24.1
occupation 23.8
standing 22.6
health 22.2
mature 21.4
teamwork 21.3
corporate 20.6
care 19.7
portrait 19.4
men 18.9
looking 18.4
work 18
surgeon 18
worker 18
clinic 17.6
stethoscope 17.6
confident 16.4
working 15.9
staff 15.8
30s 15.4
coat 15.3
colleagues 14.6
businesswoman 14.5
office 14.5
suit 14.4
handsome 14.3
smile 14.3
meeting 14.1
uniform 13.7
women 13.4
indoors 13.2
lifestyle 13
clinical 12.7
diversity 12.5
profession 12.4
illness 12.4
businesspeople 12.3
senior 12.2
building 12
20s 11.9
brass 11.9
doctors 11.8
40s 11.7
partnership 11.5
elderly 11.5
confidence 11.5
clothing 11.2
lab coat 11.1
casual 11
successful 11
case 10.8
expertise 10.7
trombone 10.6
mid adult 10.6
cheerful 10.6
human 10.5
success 10.5
executive 10.4
company 10.2
inside 10.1
attractive 9.8
diverse 9.8
wind instrument 9.7
consultant 9.7
specialist 9.7
together 9.6
practitioner 9.6
ethnic 9.5
adults 9.5
happiness 9.4
attendant 9.2
friendly 9.1
life 9
family 8.9
physician 8.8
thirties 8.8
workers 8.7
cooperation 8.7
partner 8.7
architect 8.7
career 8.5
two 8.5
black 8.4
modern 8.4
old 8.4
kin 8.3
engineer 8
musical instrument 7.9
associates 7.9
bright 7.9
discussing 7.9
coworkers 7.9
day 7.8
corporation 7.7
exam 7.7
chart 7.6
camera 7.4
treatment 7.3
indoor 7.3
sick person 7.1
face 7.1
employee 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.1
outdoor 98.5
standing 91.8
clothing 89.4
man 84.4
black and white 67.2

Face analysis

Amazon

Google

AWS Rekognition

Age 57-65
Gender Male, 100%
Happy 76.7%
Calm 17.2%
Disgusted 2.9%
Confused 1.5%
Surprised 0.8%
Angry 0.3%
Fear 0.3%
Sad 0.3%

AWS Rekognition

Age 54-62
Gender Female, 51.2%
Calm 99.7%
Surprised 0.2%
Angry 0%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 94%
Confused 3%
Sad 0.9%
Happy 0.7%
Surprised 0.4%
Angry 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 70.3%
Surprised 19.2%
Happy 4.9%
Sad 3.3%
Confused 1%
Disgusted 0.7%
Angry 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 93%
Suit 71.1%

Captions

Microsoft

a group of people standing around each other 91.2%
a group of people standing next to a person 88.3%
a group of people standing around a plane 68%

Text analysis

Amazon

KODAK-SVEELA
SEX

Google

YT37A2-XAGON
YT37A2-XAGON 435
435