Human Generated Data

Title

Untitled (guests gathered at table for older woman's birthday party)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10372

Human Generated Data

Title

Untitled (guests gathered at table for older woman's birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.5
Person 99.2
Person 99.1
Person 99
Person 97.7
Person 97.5
Clothing 97.2
Apparel 97.2
Person 96.5
Plant 95.8
Person 94.3
Person 94.1
Blossom 91.8
Flower 91.8
Wedding Cake 90
Cake 90
Dessert 90
Food 90
Flower Arrangement 88.5
Flower Bouquet 88.2
Accessories 82.1
Accessory 82.1
Tie 82.1
Tie 73
Wedding 72.3
People 71.9
Robe 70.3
Fashion 70.3
Gown 67.1
Wedding Gown 58

Imagga
created on 2022-01-23

groom 100
kin 89.7
couple 61
bride 53.1
wedding 48.7
dress 43.4
love 40.2
happiness 35.3
marriage 34.2
man 33.6
people 32.9
happy 32
married 28.8
bouquet 28.4
male 28.4
two 25.4
wife 24.6
adult 24.6
family 24
husband 23.4
person 22.8
together 21
portrait 20.1
flowers 20
gown 19.5
celebration 19.1
smiling 18.8
ceremony 18.4
romance 17.9
wed 17.7
attractive 17.5
veil 16.7
outdoors 16.4
romantic 16
smile 15.7
bridal 15.6
fashion 15.1
day 14.9
suit 14.4
home 13.6
pair 13.2
senior 13.1
flower 13.1
cheerful 13
men 12.9
engagement 12.5
new 12.1
women 11.9
handsome 11.6
elegance 10.9
mother 10.8
face 10.7
loving 10.5
brunette 10.5
sexy 10.4
future 10.2
event 10.2
joy 10
park 9.9
bridegroom 9.9
tuxedo 9.9
matrimony 9.8
commitment 9.8
summer 9.6
standing 9.6
relationship 9.4
outdoor 9.2
holding 9.1
child 9.1
newly 8.9
kiss 8.8
hands 8.7
passion 8.5
pretty 8.4
old 8.4
hand 8.4
church 8.3
traditional 8.3
lifestyle 7.9
wedded 7.9
holiday 7.9
marry 7.8
boy 7.8
roses 7.8
party 7.7
outside 7.7
formal 7.6
friends 7.5
human 7.5
rose 7.5
fun 7.5
joyful 7.3
lady 7.3
group 7.3
gorgeous 7.3
hair 7.1
father 7.1
indoors 7
look 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.3
wall 98.7
posing 92.5
clothing 90.8
group 85.3
man 83
people 81
black 76.7
white 74.1
flower 67.5
woman 65.6
old 63.6
candle 58.3
wedding dress 58.3
wedding cake 56.5
table 30.8
dining table 7.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Female, 100%
Calm 94.9%
Surprised 1.9%
Sad 1%
Happy 0.9%
Angry 0.5%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 53-61
Gender Female, 100%
Calm 76.3%
Happy 8.7%
Surprised 4.1%
Angry 3.2%
Sad 2.4%
Fear 2.3%
Disgusted 1.8%
Confused 1.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Happy 98.1%
Surprised 1.2%
Angry 0.3%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 49-57
Gender Female, 100%
Happy 53.7%
Calm 26.3%
Surprised 5.7%
Angry 3.9%
Sad 3.6%
Fear 2.7%
Confused 2.1%
Disgusted 2%

AWS Rekognition

Age 41-49
Gender Female, 100%
Happy 39.5%
Calm 35.6%
Surprised 11%
Angry 4.2%
Confused 2.8%
Sad 2.4%
Fear 2.4%
Disgusted 2.2%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Happy 98.4%
Angry 0.4%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.6%
Calm 98.9%
Happy 0.4%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 64-74
Gender Female, 100%
Calm 48.2%
Confused 19.1%
Fear 14.4%
Happy 7.6%
Surprised 4%
Angry 2.6%
Sad 2.4%
Disgusted 1.6%

AWS Rekognition

Age 37-45
Gender Female, 100%
Happy 82.3%
Surprised 7.3%
Calm 4.2%
Confused 2.9%
Fear 1.5%
Angry 1%
Sad 0.4%
Disgusted 0.4%

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 71
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Tie 82.1%

Captions

Microsoft

a group of people posing for a photo 98.8%
a group of people posing for a photo in front of a wedding cake 94.9%
a group of people posing for a photo in front of a cake 94.8%

Text analysis

Amazon

DA

Google

OA
OA