Human Generated Data

Title

Untitled (Henry Perry and his wife)

Date

1890s

People

Artist: M. Goulart, American active 1880s-1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3273

Human Generated Data

Title

Untitled (Henry Perry and his wife)

People

Artist: M. Goulart, American active 1880s-1900s

Date

1890s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 100
Clothing 100
Human 98
Person 97.4
Person 96.6
Robe 96
Fashion 96
Gown 94.7
Wedding 93.8
Wedding Gown 87.4
Bride 87.4
Plant 85
Overcoat 83.3
Coat 83.3
Flower 77.7
Blossom 77.7
Female 77.6
Flower Arrangement 72.6
Flower Bouquet 72.6
Bridegroom 71.6
Suit 69.3
Veil 68
Tuxedo 61.9
Woman 61.7
Evening Dress 57.7

Imagga
created on 2021-12-14

groom 100
bride 61.8
wedding 54.2
dress 44.2
couple 43.5
bouquet 42.4
love 37.1
marriage 33.2
married 29.7
flowers 28.7
people 27.9
happiness 25.8
wed 24.5
gown 23.4
man 22.8
veil 22.5
adult 22
bridal 21.4
happy 21.3
male 21.3
ceremony 20.4
celebration 19.9
portrait 19.4
attractive 18.9
two 18.6
person 18.6
fashion 18.1
wife 18
romance 17.9
flower 16.9
pretty 16.1
suit 15.7
husband 15.4
elegance 14.3
outdoors 14.2
lady 13.8
sexy 13.6
engagement 12.5
men 12
hair 11.9
matrimony 11.8
summer 11.6
family 11.6
window 11.5
smile 11.4
day 11
smiling 10.8
commitment 10.8
romantic 10.7
interior 10.6
together 10.5
human 10.5
standing 10.4
looking 10.4
rose 10.3
women 10.3
cute 10
newly 9.9
posing 9.8
eyes 9.5
pair 9.4
life 9.4
model 9.3
future 9.3
church 9.2
event 9.2
black 9
cheerful 8.9
bridegroom 8.9
lovely 8.9
look 8.8
hope 8.7
floral 8.5
relationship 8.4
park 8.2
room 8.2
clothing 8.2
lifestyle 7.9
romanticism 7.9
tuxedo 7.9
engaged 7.9
honeymoon 7.8
wall 7.7
tender 7.7
newlywed 7.7
loving 7.6
skin 7.6
tie 7.6
nice 7.3
indoor 7.3
sensuality 7.3
pose 7.2
gorgeous 7.2
home 7.2
holiday 7.2

Google
created on 2021-12-14

Coat 95.3
Hairstyle 95.1
Picture frame 93.4
Wedding dress 93.4
Bride 92.4
Dress 90.7
Standing 86.4
Suit 86.1
Sleeve 83.6
Bridal veil 81.8
Formal wear 79.2
Bridal clothing 77.8
Vintage clothing 76.6
Gown 76.5
Rectangle 75.8
Event 72.4
Blazer 71.2
Bridal accessory 71.1
Classic 70.9
Happy 68.7

Microsoft
created on 2021-12-14

wedding dress 99.2
bride 98.6
text 96.9
monitor 93.9
wedding 93.7
dress 92.2
suit 87.3
gallery 78
posing 74.9
clothing 73.2
flower 65.2
woman 62.2
person 58.9
groom 51.9
room 47.9
picture frame 22.5

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 95.5%
Calm 76.6%
Surprised 19.1%
Happy 2.2%
Fear 0.6%
Angry 0.6%
Sad 0.5%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 12-22
Gender Male, 75%
Calm 89.6%
Happy 5.6%
Sad 1.8%
Disgusted 0.8%
Angry 0.8%
Fear 0.6%
Surprised 0.4%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Suit 69.3%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 71.6%
a group of people standing in front of a mirror posing for the camera 62.1%
a man that is standing in front of a mirror posing for the camera 61.3%

Text analysis

Amazon

20
135%
P30

Google

135%
20 135% P30
20
P30