Human Generated Data

Title

Untitled (crowd of people in ballroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16705

Human Generated Data

Title

Untitled (crowd of people in ballroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Human 99.4
Person 99.4
Person 99
Person 98.6
Person 98.3
Accessory 94.3
Tie 94.3
Accessories 94.3
Fashion 90.4
Robe 90.4
Gown 89.9
Person 86.4
Wedding 86.2
Clinic 84.7
Person 84.1
Wedding Gown 73.5
People 66.2
Bride 59
Female 56.4
Doctor 56.2
Person 56

Imagga
created on 2022-02-26

shower cap 99.2
cap 77.4
headdress 59.8
clothing 45.9
people 32.9
adult 30.2
groom 29.3
person 26.9
senior 26.2
couple 24.4
man 20.8
elderly 20.1
portrait 20
consumer goods 20
happy 20
old 19.5
male 19.1
covering 19.1
health 18.8
medical 18.5
bride 18.2
love 18.1
women 17.4
home 16.7
mature 16.7
professional 16.6
wedding 16.5
nurse 16.1
smiling 15.9
human 15.7
retirement 15.4
doctor 15
lady 14.6
men 14.6
worker 14.5
happiness 14.1
face 13.5
husband 13.3
smile 12.8
two 12.7
retired 12.6
indoors 12.3
cheerful 12.2
dress 11.7
care 11.5
medicine 11.4
together 11.4
bouquet 11
teacher 10.9
aged 10.9
metropolitan 10.4
wife 10.4
looking 10.4
party 10.3
sitting 10.3
hospital 10.2
work 10.2
day 10.2
camera 10.2
70s 9.8
romantic 9.8
veil 9.8
patient 9.7
laboratory 9.6
married 9.6
illness 9.5
hair 9.5
uniform 9.5
gown 9.4
room 9.2
clinic 9.2
attractive 9.1
fashion 9
romance 8.9
half length 8.8
lab 8.7
ceremony 8.7
flowers 8.7
life 8.4
family 8
working 8
lifestyle 7.9
table 7.8
older 7.8
pretty 7.7
casual 7.6
research 7.6
hand 7.6
marriage 7.6
enjoying 7.6
horizontal 7.5
joy 7.5
one 7.5
coat 7.4
educator 7.3
equipment 7.3
occupation 7.3
pensioner 7.3
indoor 7.3
surgeon 7.3
celebration 7.2
grandma 7.1
interior 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wedding dress 96.1
wedding 94.8
person 94.4
bride 91.2
text 80.1
group 58.7
woman 56.6
clothing 54.4

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 61%
Sad 59.3%
Calm 30.7%
Happy 5.1%
Fear 2%
Confused 1.4%
Angry 0.6%
Disgusted 0.6%
Surprised 0.3%

AWS Rekognition

Age 38-46
Gender Male, 96.8%
Calm 53.4%
Surprised 23.8%
Sad 9.4%
Disgusted 6.6%
Angry 3.6%
Confused 1.7%
Happy 0.8%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Female, 95.5%
Calm 88.3%
Sad 4.5%
Confused 4.3%
Happy 1.4%
Surprised 0.7%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 50-58
Gender Male, 99%
Calm 98.6%
Sad 0.9%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 88.3%
Happy 50.6%
Calm 28.5%
Sad 12.1%
Surprised 4.2%
Confused 1.8%
Angry 1.3%
Disgusted 0.9%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 94.3%

Captions

Microsoft

a group of people standing next to a window 81.9%
a group of people standing in front of a window 79.8%
a group of people standing in a kitchen 79.7%

Text analysis

Amazon

10
NS

Google

MJI7--YT37A°2- - XAGOX
XAGOX
MJI7--YT37A°2-
-