Human Generated Data

Title

Untitled (man and woman in birthday hats next to cake)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1114

Human Generated Data

Title

Untitled (man and woman in birthday hats next to cake)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Person 99.4
Person 99.1
Cake 98.9
Dessert 98.9
Food 98.9
Person 98.7
Person 97.8
Clothing 96.1
Apparel 96.1
Person 95.8
Person 90.4
Tie 88.8
Accessories 88.8
Accessory 88.8
Person 84.5
Tablecloth 83.9
Wedding Cake 76.1
Suit 75.4
Coat 75.4
Overcoat 75.4
Plant 75
Glasses 74.4
Creme 71.9
Icing 71.9
Cream 71.9
Blossom 71.5
Flower 71.5
People 67.1
Person 66.5
Meal 55.1

Imagga
created on 2022-01-23

groom 85
ruler 43.7
old 26.5
bride 24.4
couple 23.5
statue 22.1
man 21.5
people 21.2
wedding 21.2
person 18.9
sculpture 18.8
religion 17.9
love 17.4
monument 16.8
dress 16.3
history 16.1
bouquet 15.7
two 15.2
male 14.9
happiness 14.9
marriage 14.2
portrait 14.2
celebration 13.6
married 13.4
flowers 13
antique 13
ancient 13
culture 12.8
ceremony 12.6
art 12.6
husband 12.5
god 12.4
architecture 11.7
marble 11.6
romance 11.6
family 11.6
wife 11.4
happy 11.3
religious 11.2
men 11.2
adult 11.2
church 11.1
vintage 10.8
tourism 10.7
romantic 10.7
human 10.5
decoration 10.4
historical 10.4
catholic 10.3
senior 10.3
wed 9.8
women 9.5
rose 9.4
stone 9.4
retro 9
detail 8.8
bridal 8.8
sepia 8.7
pray 8.7
kin 8.6
face 8.5
city 8.3
fashion 8.3
park 8.2
lady 8.1
archive 8
home 8
together 7.9
hands 7.8
spiritual 7.7
elegance 7.6
column 7.5
traditional 7.5
mature 7.4
tradition 7.4
figure 7.4
historic 7.3
tourist 7.3
lifestyle 7.2
hair 7.1
day 7.1
travel 7
gown 7
look 7

Google
created on 2022-01-23

Coat 91.7
Table 90.9
Plant 85.3
Suit 82.4
Picture frame 82.2
Tie 79.2
Chair 79.2
Vintage clothing 76.4
Curtain 75.8
Monochrome 74
Event 73.7
Classic 72.5
Formal wear 70.9
Monochrome photography 70.8
Hat 68.5
Room 67.5
Tablecloth 67.2
History 66.5
Window 64.5
Stock photography 63.5

Microsoft
created on 2022-01-23

old 96.7
indoor 89
person 87.3
clothing 78.2
posing 76.5
birthday cake 75.9
text 74.9
white 73.3
black 69.1
wedding cake 65
man 50.6
suit 50.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 79-89
Gender Female, 56.3%
Calm 93.5%
Surprised 2%
Happy 1.9%
Sad 1.3%
Fear 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 64-74
Gender Female, 97.5%
Calm 95.2%
Happy 2.7%
Surprised 0.8%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%

AWS Rekognition

Age 65-75
Gender Male, 100%
Calm 92%
Surprised 2.2%
Angry 1.7%
Confused 1.3%
Happy 1%
Sad 0.9%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 57-65
Gender Female, 93.8%
Happy 98.8%
Surprised 0.3%
Fear 0.2%
Angry 0.2%
Calm 0.2%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 54-62
Gender Male, 95.8%
Happy 99.6%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Angry 0%
Sad 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 60-70
Gender Female, 54%
Calm 97.8%
Fear 0.9%
Angry 0.4%
Sad 0.3%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 54-64
Gender Female, 98.6%
Calm 49.8%
Sad 24.8%
Angry 8.1%
Confused 6.3%
Surprised 3.7%
Fear 3.4%
Disgusted 2.8%
Happy 1.1%

Microsoft Cognitive Services

Age 66
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 88.8%
Wedding Cake 76.1%
Suit 75.4%
Glasses 74.4%

Captions

Microsoft

a group of people posing for a photo in front of a wedding cake 94.3%
a vintage photo of a group of people standing in front of a cake 94.2%
a group of people posing for a photo in front of a cake 94.1%

Text analysis

Amazon

PROOF

Google

PROOF
ap
ap PROOF