Human Generated Data

Title

Untitled (bride and bridesmaids by cake and punch table)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6998

Human Generated Data

Title

Untitled (bride and bridesmaids by cake and punch table)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99
Person 98.9
Person 98.7
People 98.2
Person 98.1
Person 95.2
Person 94.6
Person 94
Person 93.8
Person 92.8
Person 88.2
Family 86
Person 85.9
Person 80.5
Meal 79.5
Food 79.5
Plant 77.2
Blossom 66.4
Flower 66.4
Flower Arrangement 66.4
Clothing 62.7
Apparel 62.7

Imagga
created on 2022-01-23

people 29.5
teacher 28.6
table 26.6
person 25.3
couple 25.2
adult 24.6
room 24.6
interior 23.9
man 23.6
educator 21.9
home 19.9
women 19.8
happy 19.4
wedding 19.3
dress 19
professional 18.3
bride 18.2
love 16.6
male 16.3
luxury 16.3
bouquet 15.7
party 15.5
kin 15.4
two 15.2
smiling 15.2
romantic 15.1
happiness 14.9
celebration 14.3
glass 14.3
marriage 14.2
sitting 13.7
groom 13.6
romance 13.4
elegant 12.8
indoor 12.8
elegance 12.6
holding 12.4
restaurant 12.4
chair 12.3
indoors 12.3
lifestyle 12.3
fashion 12
cheerful 11.4
flowers 11.3
modern 11.2
men 11.2
decoration 11.1
wine 11.1
portrait 11
holiday 10.7
smile 10.7
pretty 10.5
life 10.4
shop 10.3
rose 10.3
dinner 10.1
drink 10
bakery 9.8
reception 9.8
attractive 9.8
family 9.8
old 9.7
lady 9.7
ceremony 9.7
together 9.6
style 8.9
meal 8.8
decor 8.8
bridal 8.7
standing 8.7
nurse 8.6
banquet 8.6
married 8.6
clothing 8.5
inside 8.3
food 8.1
new 8.1
suit 8.1
business 7.9
day 7.8
flower 7.7
furniture 7.6
wife 7.6
desk 7.5
house 7.5
human 7.5
20s 7.3
kitchen 7.3
color 7.2
sexy 7.2
work 7.2
breakfast 7.2
arrangement 7.1
outfit 7

Google
created on 2022-01-23

Table 96.6
Furniture 93.5
Dress 89.5
Tablecloth 74.6
Event 74.1
Room 73.9
Suit 73.4
Vintage clothing 72.7
Art 71.3
Painting 68.4
History 64.5
Stock photography 63.2
Rectangle 61.2
Ceremony 60.7
Child 60.1
Formal wear 59.5
Monochrome 58.7
Illustration 58.2
Family 54.6
Party 53.6

Microsoft
created on 2022-01-23

wall 98.3
woman 92.4
person 89
table 88.1
indoor 87.7
clothing 84.1
posing 70.3
wedding 69.5
group 62.6
tableware 57.9
human face 57.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 34.5%
Angry 33.4%
Surprised 18.7%
Calm 6.5%
Disgusted 3.8%
Fear 1.3%
Confused 1.1%
Sad 0.7%

AWS Rekognition

Age 29-39
Gender Female, 99.8%
Happy 53.9%
Angry 20.4%
Calm 7.6%
Surprised 7.2%
Disgusted 4.9%
Confused 2.6%
Fear 2.1%
Sad 1.3%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 72.3%
Surprised 7.7%
Calm 5.4%
Fear 3.6%
Angry 3.4%
Confused 2.7%
Sad 2.5%
Disgusted 2.5%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Happy 99.7%
Sad 0.1%
Angry 0.1%
Fear 0%
Surprised 0%
Disgusted 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 96.8%
Surprised 1.5%
Calm 0.6%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 2-10
Gender Female, 100%
Calm 98.5%
Sad 0.6%
Confused 0.5%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Happy 96.5%
Surprised 2.3%
Fear 0.4%
Angry 0.3%
Sad 0.2%
Disgusted 0.2%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 31-41
Gender Female, 100%
Calm 47.4%
Surprised 37%
Happy 10.4%
Angry 2%
Disgusted 0.9%
Fear 0.9%
Sad 0.7%
Confused 0.7%

AWS Rekognition

Age 6-14
Gender Male, 97.6%
Happy 86%
Calm 7.2%
Angry 1.9%
Confused 1.7%
Surprised 1.6%
Disgusted 0.9%
Sad 0.5%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Female, 100%
Happy 35.6%
Angry 33.6%
Surprised 26.5%
Confused 2%
Fear 0.7%
Disgusted 0.6%
Calm 0.6%
Sad 0.5%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 99.5%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Sad 0%
Disgusted 0%
Calm 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 93.5%
a group of people posing for a picture 93.4%
a group of people posing for the camera 93.3%

Text analysis

Amazon

b