Human Generated Data

Title

Untitled (four people in ballroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16711

Human Generated Data

Title

Untitled (four people in ballroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 100
Apparel 100
Chair 99.5
Furniture 99.5
Person 99.3
Human 99.3
Person 99.3
Person 99.1
Person 98.7
Fashion 96.6
Robe 96.6
Gown 95.5
Wedding 89
Wedding Gown 83.6
Bride 83.6
Female 79.4
Accessories 76.9
Accessory 76.9
Tie 76.9
Woman 64.9
Evening Dress 63.7
Photo 61.2
Photography 61.2
Bridegroom 57.7
Clinic 55.7

Imagga
created on 2022-02-26

person 37.3
man 36.3
nurse 35.8
professional 35.3
people 35.2
lab coat 35.1
doctor 34.8
adult 34.6
male 32.6
medical 31.8
coat 31.7
hospital 26.7
patient 25.9
groom 25.3
happy 24.5
team 24.2
businessman 23.9
business 23.1
job 23
office 22.5
occupation 22
health 21.5
men 21.5
clinic 21.2
smiling 21
work 20.4
colleagues 20.4
portrait 20.1
medicine 19.4
worker 19.4
businesswoman 19.1
clothing 18.6
women 18.2
care 18.1
teamwork 17.6
corporate 17.2
businesspeople 17.1
group 16.9
working 16.8
indoors 16.7
lifestyle 16.6
couple 16.6
two 16.1
desk 16.1
computer 16
casual 15.3
smile 15
mature 14.9
indoor 14.6
home 14.4
happiness 14.1
attractive 14
room 13.8
doctors 13.8
expertise 13.6
laboratory 13.5
modern 13.3
garment 13.1
bright 12.9
associates 12.8
day 12.6
30s 12.5
elderly 12.5
uniform 12.4
meeting 12.3
senior 12.2
practitioner 12.1
looking 12
profession 11.5
talking 11.4
stethoscope 11.1
treatment 11
coworkers 10.8
clinical 10.7
40s 10.7
lab 10.7
face 10.7
partnership 10.6
human 10.5
standing 10.4
20s 10.1
suit 10
cheerful 9.8
case 9.8
examination 9.7
employee 9.7
assistant 9.7
illness 9.5
life 9.5
sitting 9.5
manager 9.3
laptop 9.1
healing 9
color 8.9
success 8.9
consultant 8.8
together 8.8
look 8.8
corporation 8.7
mid adult 8.7
sick person 8.6
research 8.6
old 8.4
teacher 8.3
friendly 8.2
brass 8.2
light 8
specialist 8
family 8
30 35 years 7.9
executive 7.9
scientist 7.8
physician 7.8
businessmen 7.8
table 7.8
workers 7.8
cooperation 7.7
busy 7.7
adults 7.6
house 7.5
technology 7.4
focus 7.4
camera 7.4
confident 7.3
building 7.1
handsome 7.1
science 7.1
interior 7.1
pretty 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wall 99.5
wedding dress 92.6
wedding 90.8
dress 90.6
standing 90.6
text 88
indoor 87.1
bride 80.4
clothing 77.5
woman 76.8
posing 73.9
person 67.7
room 46.2

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 83.7%
Calm 43.5%
Sad 39.9%
Happy 12.3%
Confused 2.4%
Fear 0.5%
Surprised 0.5%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 53-61
Gender Male, 98.1%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.5%
Person 99.3%
Tie 76.9%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 89.3%
a person standing in front of a mirror posing for the camera 84.2%
a group of men standing in front of a mirror posing for the camera 80.4%

Text analysis

Amazon

24

Google

24 MJI7-- YT37A°2--NAGON
24
MJI7--
YT37A°2--NAGON