Human Generated Data

Title

Untitled (man and two women on couch drinking coffee)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17428

Human Generated Data

Title

Untitled (man and two women on couch drinking coffee)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 99.7
Furniture 99.7
Clothing 99.7
Apparel 99.7
Person 99
Human 99
Person 98.9
Sitting 95.1
Face 92.2
Couch 89.7
Female 88.9
Sunglasses 80.1
Accessory 80.1
Accessories 80.1
Suit 78.5
Coat 78.5
Overcoat 78.5
Gown 77.9
Fashion 77.9
Woman 76.6
Robe 76.5
Smile 73.7
Portrait 72.8
Photography 72.8
Photo 72.8
People 71.3
Wedding 69
Table 65.6
Wedding Gown 61.7
Bridegroom 58.6
Dining Table 58.1
Evening Dress 57.3

Imagga
created on 2022-02-26

person 43.7
man 40.3
adult 37.5
professional 36.7
people 36.3
male 36.2
patient 29.8
groom 28.4
couple 26.1
teacher 26.1
happy 23.8
men 22.3
women 21.4
medical 21.2
smiling 21
educator 20.6
nurse 20.4
smile 20
coat 18.3
happiness 18
doctor 17.9
senior 17.8
businessman 17.7
indoors 17.6
portrait 17.5
sitting 17.2
health 16.7
lab coat 16.4
hospital 16.2
worker 16.2
office 16.1
lifestyle 15.9
business 15.8
love 15.8
home 15.2
face 14.9
work 14.9
room 14.8
brass 14.4
two 14.4
clothing 14.4
holding 14
together 14
specialist 14
mature 13.9
medicine 13.2
life 13.2
looking 12.8
businesswoman 12.7
team 12.5
working 12.4
corporate 12
computer 12
wind instrument 11.9
occupation 11.9
casual 11.9
sick person 11.8
dress 11.7
case 11.5
care 11.5
job 11.5
businesspeople 11.4
clinic 11.2
day 11
indoor 11
laptop 10.9
uniform 10.7
cheerful 10.6
bride 10.6
modern 10.5
human 10.5
group 10.5
table 10.4
teamwork 10.2
cornet 10.1
wedding 10.1
color 10
executive 9.9
interior 9.7
two people 9.7
lab 9.7
colleagues 9.7
laboratory 9.6
talking 9.5
meeting 9.4
new 8.9
romantic 8.9
retirement 8.6
profession 8.6
illness 8.6
attractive 8.4
hand 8.4
grandma 8.4
musical instrument 8.2
lady 8.1
suit 8.1
handsome 8
bright 7.9
elderly 7.7
instrument 7.7
ethnic 7.6
wife 7.6
relationship 7.5
fun 7.5
study 7.5
manager 7.5
technology 7.4
treatment 7.4
20s 7.3
successful 7.3
stethoscope 7.1
family 7.1
to 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wedding dress 97.7
text 97.4
bride 94.8
person 94.6
dress 91.7
wedding 89.3
window 88.3
clothing 76
woman 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 36.3%
Happy 15.9%
Surprised 12.7%
Angry 11.3%
Confused 11%
Disgusted 8.8%
Sad 2.4%
Fear 1.6%

AWS Rekognition

Age 45-53
Gender Male, 63.7%
Sad 59.1%
Calm 39.7%
Confused 0.4%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 96.6%
Surprised 31.3%
Disgusted 26.8%
Confused 16.8%
Sad 10.4%
Calm 4.6%
Angry 4%
Happy 3.2%
Fear 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Sunglasses 80.1%

Captions

Microsoft

a group of people sitting in front of a window 75.7%
a group of people standing in front of a window 75.6%
a group of people in front of a window 75.5%

Text analysis

Amazon

9
7 9
7