Human Generated Data

Title

Untitled (bridesmaids and groomsmen, New York City)

Date

1903, printed later

People

Artist: Percy C. Byron, American 1879 - 1959

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3486

Human Generated Data

Title

Untitled (bridesmaids and groomsmen, New York City)

People

Artist: Percy C. Byron, American 1879 - 1959

Date

1903, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 100
Clothing 100
Person 99.6
Human 99.6
Person 99.4
Person 97.8
Person 97.1
Fashion 97
Robe 97
Person 96.4
Gown 96.1
Person 94.7
Wedding 94.2
Female 91.3
Suit 90.9
Coat 90.9
Overcoat 90.9
Bride 89.3
Dress 86.5
Woman 81.6
Bridegroom 76.8
Evening Dress 74.9
Tuxedo 67.5
Wedding Gown 67.3
Wedding Gown 63.5
People 61.1
Wedding Gown 56.3
Photo 55.7
Photography 55.7
Chair 55.1
Furniture 55.1

Imagga
created on 2022-01-23

groom 100
bride 75.6
wedding 67.2
dress 63.3
love 49.7
marriage 45.6
couple 45.3
married 44.1
bouquet 36.8
happiness 36
people 35.1
veil 33.3
happy 30.1
adult 27.2
fashion 27.1
wife 26.5
celebration 26.3
flowers 25.2
romance 24.1
two 23.7
man 23.5
gown 23.4
ceremony 22.3
bridal 21.4
day 21.2
person 21.2
smile 20.7
wed 20.6
outdoors 20.2
flower 20
romantic 19.6
male 19.2
park 18.9
husband 18.4
portrait 18.1
summer 17.4
outdoor 16.8
cheerful 16.3
family 16
face 15.6
smiling 15.2
elegance 15.1
women 15
together 14.9
event 14.8
engagement 14.5
posing 14.2
attractive 14
lifestyle 13.7
church 13
outside 12.8
matrimony 12.8
commitment 12.8
cute 12.2
lady 12.2
looking 12
model 11.7
fun 11.2
pretty 11.2
joy 10.9
human 10.5
pair 10.4
life 10.2
suit 9.9
kin 9.8
formal 9.6
future 9.3
hand 9.1
holding 9.1
newly 8.9
sexy 8.8
kiss 8.8
hair 8.7
relationship 8.4
one 8.2
pose 8.2
new 8.1
blond 8.1
wedded 7.9
tuxedo 7.9
holiday 7.9
brunette 7.8
marry 7.8
hands 7.8
emotional 7.8
men 7.7
wall 7.7
youth 7.7
clothes 7.5
emotion 7.4
religion 7.2
handsome 7.1
sky 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

wedding dress 99.6
bride 99.2
dress 97.6
person 96.7
wedding 95.9
text 93.7
standing 90.2
outdoor 86.5
woman 84.1
people 81.4
posing 80.9
group 75
clothing 74.4
white 65.8
black and white 62.2
dancer 57.5
gown 53.8
dressed 41.4
clothes 34.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 65.9%
Happy 98.5%
Disgusted 0.7%
Fear 0.2%
Sad 0.2%
Angry 0.2%
Calm 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Female, 98.9%
Happy 99.6%
Calm 0.2%
Surprised 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Happy 98.3%
Calm 0.6%
Disgusted 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Calm 29.9%
Happy 17.6%
Angry 15.9%
Fear 12.1%
Surprised 10.1%
Confused 6%
Sad 4.3%
Disgusted 4%

AWS Rekognition

Age 37-45
Gender Male, 99.5%
Happy 80.3%
Calm 13.8%
Disgusted 2.4%
Sad 1%
Angry 0.7%
Fear 0.6%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 57%
Angry 13.8%
Sad 11.7%
Confused 8.5%
Disgusted 4.2%
Fear 2.1%
Surprised 1.5%
Happy 1.2%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Wedding Gown 67.3%
Chair 55.1%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a group of people posing for a picture 97.6%

Text analysis

Amazon

68%
P39
28
15384
Bajon
Bajon -
-

Google

68%
68%