Human Generated Data

Title

Untitled (people laughing, man in sailor hat)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16702

Human Generated Data

Title

Untitled (people laughing, man in sailor hat)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Apparel 100
Clothing 100
Person 99.4
Human 99.4
Person 99.4
Person 99.2
Fashion 93.9
Robe 93.9
Gown 93.7
Person 92
Wedding 87.1
Person 86.7
Person 80.4
Female 79.4
Face 78
Evening Dress 73.2
Bride 71.2
Suit 70.2
Coat 70.2
Overcoat 70.2
Wedding Gown 66.4
Person 66.1
People 65.5
Woman 64.6
Portrait 64.2
Photography 64.2
Photo 64.2
Icing 57.8
Dessert 57.8
Cake 57.8
Food 57.8
Cream 57.8
Creme 57.8

Imagga
created on 2022-02-26

groom 88.6
bride 49.2
wedding 43.2
dress 42.4
couple 38.3
bouquet 34.2
love 31.5
people 30.7
married 26.8
marriage 26.6
happiness 25.1
man 23.5
happy 23.2
person 22.2
celebration 20.7
adult 19.9
gown 19.5
two 18.6
male 18.5
bridal 18.5
flowers 18.2
veil 17.6
romantic 16
ceremony 15.5
men 15.4
wife 15.2
wed 14.7
home 14.4
portrait 14.2
together 14
flower 13.1
party 12.9
women 12.6
day 12.5
husband 12.5
decoration 12.1
fashion 12.1
room 12
life 12
attractive 11.9
romance 11.6
family 11.6
holiday 11.5
event 11.1
smiling 10.8
suit 10.8
smile 10.7
interior 10.6
indoor 10
negative 9.8
lady 9.7
new 9.7
indoors 9.7
engagement 9.6
pair 9.4
rose 9.4
face 9.2
pretty 9.1
matrimony 8.9
nurse 8.6
clothing 8.5
hand 8.4
tradition 8.3
traditional 8.3
pose 8.1
cheerful 8.1
world 8.1
newly 7.9
commitment 7.9
brunette 7.8
kiss 7.8
film 7.7
wall 7.7
old 7.7
human 7.5
clothes 7.5
future 7.4
arrangement 7.4
church 7.4
professional 7.4
art 7.3
costume 7.1
glass 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

wedding dress 95.4
sketch 92.9
dress 91.6
drawing 90
bride 86.4
clothing 77.9
woman 67.8
text 66.4
cartoon 62.3
wedding 60.1
person 58.4
old 40

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 64%
Happy 91.5%
Sad 4.3%
Confused 1.3%
Fear 1.2%
Calm 0.8%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 54-62
Gender Male, 93.7%
Happy 97.2%
Surprised 1.2%
Confused 0.4%
Fear 0.4%
Angry 0.3%
Sad 0.3%
Disgusted 0.1%
Calm 0.1%

AWS Rekognition

Age 48-56
Gender Female, 57.8%
Happy 91.6%
Confused 3.1%
Calm 2.1%
Surprised 0.9%
Sad 0.7%
Disgusted 0.7%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 90.8%
Calm 92.2%
Happy 3.5%
Confused 1.8%
Sad 1.2%
Surprised 0.5%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Wedding Gown 66.4%

Captions

Microsoft

a group of people posing for a photo in front of a window 89.8%
a group of people posing for a photo 89.7%
a group of people standing next to a window 89.6%

Text analysis

Amazon

SN
16

Google

YT3RA°2
-XAGON
MJI7-- YT3RA°2 - -XAGON
MJI7--
-