Human Generated Data

Title

Untitled (people in formal attire at party)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17264

Human Generated Data

Title

Untitled (people in formal attire at party)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Chair 99.1
Furniture 99.1
Clothing 99.1
Apparel 99.1
Person 98.9
Human 98.9
Person 98.8
Person 98.3
Person 98.2
Female 85.2
Person 80.8
Woman 75.6
Fashion 70.9
Gown 70.9
Evening Dress 70.9
Robe 70.9
Face 62.8
Portrait 62.8
Photography 62.8
Photo 62.8
Overcoat 61.9
Suit 61.9
Coat 61.9
Elevator 61.5

Imagga
created on 2022-02-26

people 32.9
man 28.2
adult 27.1
person 26.4
groom 25.2
male 24.8
teacher 22.7
couple 22.6
happy 20
professional 19.3
two 16.9
indoors 16.7
women 16.6
room 16.5
happiness 16.5
business 15.8
educator 15.5
home 15.2
love 15
men 14.6
clothing 14.3
office 14.2
meeting 14.1
businessman 14.1
senior 14.1
sitting 13.7
bride 13.6
smiling 13
corporate 12.9
family 12.5
lifestyle 12.3
together 12.3
group 12.1
wedding 12
dress 11.7
portrait 11.6
executive 11.6
husband 11.6
nurse 11.5
old 11.1
indoor 11
team 10.7
job 10.6
businesspeople 10.4
bouquet 10.4
patient 10.3
hospital 10.1
interior 9.7
colleagues 9.7
life 9.6
celebration 9.6
chair 9.6
table 9.5
career 9.5
work 9.4
mature 9.3
worker 9.2
businesswoman 9.1
fashion 9
married 8.6
smile 8.5
wife 8.5
classroom 8.5
adults 8.5
gown 8.5
desk 8.5
pretty 8.4
communication 8.4
attractive 8.4
teamwork 8.3
kin 8.3
window 8
hairdresser 8
to 8
medical 7.9
mother 7.8
hands 7.8
ceremony 7.8
modern 7.7
elderly 7.7
hand 7.6
holding 7.4
20s 7.3
cheerful 7.3
black 7.3
looking 7.2
handsome 7.1
romantic 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wall 98.9
wedding dress 98.1
dress 97.5
bride 95.6
person 91.9
woman 80.9
standing 79.7
clothing 78.5
wedding 73.8

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 98.9%
Calm 79.6%
Happy 16.6%
Sad 1.3%
Disgusted 0.8%
Confused 0.8%
Surprised 0.4%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 56.6%
Calm 97.1%
Sad 2.6%
Happy 0.2%
Angry 0.1%
Surprised 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 26-36
Gender Male, 96.5%
Calm 99.7%
Happy 0.2%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.1%
Person 98.9%

Captions

Microsoft

a man and a woman standing in front of a mirror 75%
a person standing in front of a mirror 74.9%
a person standing in front of a mirror posing for the camera 74.8%

Text analysis

Amazon

NACOX
YE39A2
PTP