Human Generated Data

Title

Untitled (guests at cocktail party, wearing nametags)

Date

1952

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20118

Human Generated Data

Title

Untitled (guests at cocktail party, wearing nametags)

People

Artist: Peter James Studio, American

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 100
Apparel 100
Person 98.7
Human 98.7
Person 98
Person 97.5
Person 96.1
Person 95.2
Person 94.2
Person 90.8
Sunglasses 90.4
Accessory 90.4
Accessories 90.4
Overcoat 86.6
Suit 86.6
Fashion 76.9
Robe 76.9
Gown 71.9
Shirt 63.7
Sunglasses 60.8
Lab Coat 59.1
Wedding 58.6
Wedding Gown 56.2
Coat 53.5

Imagga
created on 2022-03-05

man 52.4
lab coat 47.3
male 44.7
coat 43
people 37.9
person 37.8
business 35.8
professional 35.6
team 34
businessman 32.7
doctor 29.1
adult 28.5
executive 28.2
nurse 27.4
job 27.4
meeting 27.3
teamwork 26.9
office 26.8
happy 26.3
colleagues 25.3
working 23.9
patient 23.5
medical 23
worker 22.4
corporate 22.3
occupation 22
group 21.8
smiling 21.7
businesspeople 20.9
mature 20.5
men 19.8
hospital 19.7
work 19.6
suit 19.2
clothing 19
portrait 18.8
garment 18.6
smile 18.5
success 18.5
looking 17.6
health 17.4
clinic 17.1
manager 16.8
surgeon 16.8
medicine 16.7
indoors 16.7
businesswoman 16.4
handsome 16
women 15.8
partnership 15.4
successful 14.6
mid adult 14.5
lifestyle 14.5
30s 14.4
senior 14.1
care 14
attractive 14
indoor 13.7
casual 13.6
elderly 13.4
career 13.3
desk 13.2
practitioner 13.2
standing 13
cheerful 13
associates 12.8
building 12.8
confident 12.7
businessmen 12.7
40s 12.7
modern 12.6
partner 12.6
diversity 12.5
case 11.9
coworkers 11.8
consultant 11.7
uniform 11.5
bright 11.4
couple 11.3
sitting 11.2
two 11
staff 10.5
look 10.5
human 10.5
adults 10.4
table 10.4
happiness 10.2
sick person 9.8
assistant 9.7
expertise 9.7
employment 9.7
ethnic 9.5
talking 9.5
color 9.5
employee 9.4
day 9.4
company 9.3
camera 9.2
20s 9.2
friendly 9.1
black 9
technology 8.9
doctors 8.8
stethoscope 8.8
home 8.8
together 8.8
architect 8.7
corporation 8.7
profession 8.6
workplace 8.6
life 8.5
communication 8.4
inside 8.3
business people 7.9
expert 7.9
forties 7.8
50s 7.8
specialist 7.8
clinical 7.8
face 7.8
education 7.8
thirties 7.8
middle aged 7.8
white 7.8
designer 7.7
laboratory 7.7
busy 7.7
leadership 7.7
industry 7.7
formal 7.6
student 7.3
foreman 7.1
to 7.1
engineer 7
groom 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.1
clothing 95.2
man 90.2
standing 89.7
text 89.1
indoor 87.9
clothes 19.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Calm 99%
Happy 0.8%
Surprised 0.1%
Confused 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 90.8%
Calm 99.5%
Sad 0.4%
Disgusted 0%
Happy 0%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 95.7%
Calm 99.3%
Surprised 0.3%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 40-48
Gender Male, 56.2%
Calm 86%
Angry 6.2%
Confused 2.7%
Surprised 2.6%
Disgusted 1%
Sad 0.7%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Calm 94.6%
Surprised 2.5%
Sad 1.1%
Disgusted 0.5%
Happy 0.5%
Confused 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 100%
Surprised 81.9%
Happy 7%
Fear 4.7%
Sad 2.1%
Angry 1.7%
Confused 1%
Disgusted 0.8%
Calm 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Sunglasses 90.4%
Suit 86.6%
Coat 53.5%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 90.7%
a group of people standing in front of a mirror 90.6%
a group of people standing in a room 90.5%

Text analysis

Amazon

EAD
KODAK-S.VEELA

Google

YT37A°2- XAGO
YT37A°2-
XAGO