Human Generated Data

Title

Untitled (students in prom wear seated at edge of room)

Date

c. 1950

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1528

Human Generated Data

Title

Untitled (students in prom wear seated at edge of room)

People

Artist: John Deusing, American active 1940s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 99.9
Clothing 99.9
Person 99.1
Human 99.1
Person 97.3
Person 97.2
Person 97.1
Person 96.7
Person 96.3
Fashion 94.2
Gown 94.2
Person 93.5
Robe 93.2
Wedding 90.9
Female 87
People 84.1
Wedding Gown 79.4
Bride 74.5
Woman 73.5
Coat 73.4
Overcoat 73.4
Suit 73.4
Bridegroom 67.9
Dress 64
Photography 61.2
Photo 61.2
Tie 60.2
Accessories 60.2
Accessory 60.2
Evening Dress 58
Portrait 57.8
Face 57.8
Tie 50.5
Person 46.8

Imagga
created on 2021-12-14

groom 100
bride 53
couple 50.6
wedding 46.9
dress 43.4
love 36.3
people 34
marriage 33.3
happiness 32.9
married 31.7
happy 30.7
bouquet 30.4
man 29.6
adult 28.7
person 24.5
male 24.1
flowers 22.6
gown 22.5
smiling 22.4
wife 21.8
nurse 21.5
veil 20.6
two 19.5
husband 19.5
together 19.3
celebration 18.4
romance 17.9
attractive 17.5
women 16.6
ceremony 16.5
day 16.5
smile 16.4
men 16.3
family 16
kin 15.8
home 15.2
romantic 15.2
fashion 15.1
bridal 14.6
wed 13.8
portrait 13.6
suit 13.5
flower 13.1
pretty 12.6
cheerful 12.2
outdoors 12
engagement 11.6
professional 11.3
human 11.3
event 11.1
elegance 10.9
lifestyle 10.8
kiss 10.7
indoors 10.5
teacher 10.3
clothing 10.2
group 9.7
pair 9.5
clothes 9.4
hand 9.1
business 9.1
lady 8.9
bridegroom 8.9
posing 8.9
tuxedo 8.9
tenderness 8.8
roses 8.7
brunette 8.7
hands 8.7
holiday 8.6
loving 8.6
face 8.5
youth 8.5
educator 8.5
relationship 8.4
church 8.3
holding 8.3
new 8.1
sexy 8
handsome 8
looking 8
businessman 7.9
wedded 7.9
cute 7.9
commitment 7.9
attire 7.9
casual clothing 7.8
embrace 7.8
life 7.8
summer 7.7
wall 7.7
formal 7.6
future 7.5
emotion 7.4
businesswoman 7.3
mother 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

wedding dress 98.6
bride 96.8
text 96.3
dress 94.1
person 93.6
window 88.9
clothing 80.9
woman 79.7
group 79.5
wedding 74.8
posing 64
people 56.3
old 55.6
clothes 15.6

Face analysis

Amazon

Google

AWS Rekognition

Age 43-61
Gender Male, 90.5%
Calm 92.6%
Sad 3.7%
Happy 1.3%
Surprised 1.1%
Confused 0.7%
Angry 0.4%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-32
Gender Male, 72.1%
Calm 44.5%
Happy 33.6%
Surprised 15.3%
Angry 2.5%
Sad 2.1%
Confused 1.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 25-39
Gender Female, 83.7%
Calm 90.8%
Sad 5.2%
Angry 1.9%
Happy 1.2%
Confused 0.7%
Surprised 0.2%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 28-44
Gender Male, 87%
Calm 84.7%
Sad 9.4%
Happy 2%
Angry 1.5%
Surprised 1.3%
Confused 0.8%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 16-28
Gender Female, 88.3%
Calm 47.4%
Happy 24.6%
Sad 21.5%
Angry 3%
Surprised 1.2%
Confused 1%
Fear 0.9%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Female, 87.1%
Calm 72.5%
Happy 13.4%
Sad 8.2%
Surprised 2.1%
Disgusted 1.5%
Confused 1.2%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 41-59
Gender Male, 91.1%
Calm 37.6%
Angry 28.4%
Sad 14.7%
Happy 9.8%
Confused 4.2%
Surprised 2.3%
Fear 1.9%
Disgusted 1%

AWS Rekognition

Age 37-55
Gender Male, 94%
Calm 76.8%
Happy 12.6%
Surprised 4%
Sad 3.2%
Confused 2.2%
Angry 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Male, 58.7%
Calm 65.5%
Happy 31.3%
Sad 2.4%
Angry 0.3%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-35
Gender Female, 55%
Calm 62.8%
Surprised 22%
Sad 10.1%
Happy 2%
Confused 1.2%
Fear 0.9%
Angry 0.7%
Disgusted 0.2%

AWS Rekognition

Age 42-60
Gender Male, 53.2%
Sad 69.4%
Calm 15.9%
Happy 6.4%
Angry 2.6%
Surprised 2.3%
Fear 1.9%
Confused 1.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 60.2%

Captions

Microsoft

a group of people posing for a photo 90%
a group of people posing for a photo in front of a window 85.3%
a group of people standing in front of a window 85.2%

Text analysis

Amazon

HONOR
IN
DARE
WE
IN MARY'S HONOR
TO
1
MARY'S
WE DARE TO BE
DIFFEREVT
BE
150

Google

DARE
B
DIFFEREVT
IN MARYS HONOR WE DARE TO B DIFFEREVT
IN
HONOR
TO
MARYS
WE