Human Generated Data

Title

Untitled (four people standing in ballroom)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16713

Human Generated Data

Title

Untitled (four people standing in ballroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.9
Human 98.9
Person 98.8
Person 98.7
Person 98.5
Clothing 95.7
Apparel 95.7
Clinic 87.7
Furniture 75.2
Indoors 74.9
Room 72
Face 70.4
Photography 68.3
Portrait 68.3
Photo 68.3
People 63.3
Chair 63
Art 62.5
Robe 58.2
Fashion 58.2
Drawing 58.1
Gown 57.5
Female 56.2
Floor 55.8
Sketch 55.6

Imagga
created on 2022-02-26

nurse 49.1
male 36.9
man 35.6
adult 35.4
people 34.6
groom 34.3
person 32.1
happy 26.3
businessman 24.7
doctor 24.4
medical 23.8
men 23.2
patient 22.5
professional 22.5
business 21.9
team 21.5
colleagues 21.4
businesspeople 20.9
hospital 19.8
happiness 19.6
mature 19.5
office 19.4
kin 19.2
portrait 18.8
job 18.6
coat 18.3
businesswoman 18.2
smiling 18.1
health 18.1
clinic 18
senior 17.8
indoors 17.6
couple 17.4
lab coat 17.3
30s 17.3
elderly 17.2
worker 17
two 16.9
camera 16.6
corporate 16.3
home 16
lifestyle 15.9
teamwork 15.8
smile 15.7
occupation 15.6
cheerful 15.4
group 15.3
casual 15.3
together 14.9
40s 14.6
meeting 14.1
care 14
20s 13.7
looking 13.6
women 13.4
clothing 13.3
medicine 13.2
discussing 12.8
old 12.5
family 12.5
working 12.4
talking 12.4
room 12.3
sitting 12
associates 11.8
work 11.8
day 11.8
discussion 11.7
desk 11.3
color 11.1
indoor 11
doctors 10.8
coworkers 10.8
bright 10.7
consultant 10.7
mid adult 10.6
four 10.6
attractive 10.5
illness 10.5
employee 10.1
horizontal 10.1
modern 9.8
forties 9.8
clinical 9.8
human 9.8
cooperation 9.7
standing 9.6
face 9.2
aged 9.1
business people 8.9
building 8.9
good mood 8.8
physician 8.8
expertise 8.7
case 8.6
ethnic 8.6
practitioner 8.3
suit 8.2
stethoscope 8.2
confident 8.2
success 8
bride 8
healing 8
four people 7.9
love 7.9
30 35 years 7.9
life 7.9
businessmen 7.8
table 7.8
thirties 7.8
examination 7.8
two people 7.8
workers 7.8
mother 7.8
corporation 7.7
diversity 7.7
partnership 7.7
expression 7.7
husband 7.6
waiter 7.6
house 7.5
company 7.4
sick person 7.4
inside 7.4
successful 7.3
friendly 7.3
new 7.3
executive 7.3
handsome 7.1
to 7.1

Google
created on 2022-02-26

Picture frame 90.2
Chair 84.8
Style 83.8
Black-and-white 82.4
Classic 75.8
Vintage clothing 74.8
Art 74.6
Monochrome 73.3
Monochrome photography 71.8
Formal wear 71
Event 70.4
Room 68.5
Painting 66.7
Stock photography 65.4
History 64.1
Sitting 62.2
Illustration 57.1
Visual arts 56.8
Fashion design 51.8
Retro style 51

Microsoft
created on 2022-02-26

wedding dress 99
bride 97.1
text 94.9
standing 93.6
person 93.5
dress 93.3
clothing 78.5
wedding 78.1
woman 75.8
ceremony 62.3
old 60.3
celebration 56.1
posing 45.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 98.9%
Happy 93.8%
Sad 2%
Calm 1.4%
Fear 1.1%
Surprised 0.5%
Angry 0.5%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 56-64
Gender Male, 57.7%
Happy 88.3%
Fear 3.6%
Sad 2.3%
Angry 1.3%
Surprised 1.2%
Confused 1.2%
Calm 1.1%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people standing in front of a window 93.9%
a man and a woman standing in front of a window 86.8%
a group of people standing in front of a window posing for the camera 86.7%

Text analysis

Amazon

27

Google

MJI7-- YT37A°2--XAGO
MJI7--
YT37A°2--XAGO