Human Generated Data

Title

Untitled (older woman with birthday cake)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2271

Human Generated Data

Title

Untitled (older woman with birthday cake)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Cake 98.6
Food 98.6
Dessert 98.6
Human 98.5
Person 98.5
Person 98.4
Person 98.2
Cream 96.2
Creme 96.2
Icing 96.2
Person 95.2
Person 93.3
Person 89.3
People 85.4
Person 74.7
Torte 68
Meal 67.8
Person 62.8
Crowd 59.4
Dish 56.8
Birthday Cake 55.8

Imagga
created on 2022-01-30

man 42.3
groom 40.8
couple 36.6
people 31.8
male 31.2
adult 29.9
person 28.5
smiling 27.5
home 27.1
together 26.3
sitting 25.8
happy 25.7
women 23.7
table 22.2
men 21.5
smile 21.4
happiness 19.6
love 18.1
lifestyle 18.1
cheerful 17.9
family 17.8
business 17.6
indoors 17.6
meeting 17
40s 16.5
room 16.1
portrait 15.5
two 15.2
day 14.9
office 14.6
group 14.5
30s 14.4
senior 14.1
casual clothing 13.7
team 13.4
married 13.4
businessman 13.2
laptop 12.9
computer 12.9
businesswoman 12.7
work 12.7
husband 12.7
colleagues 12.6
mid adult 12.5
professional 12.5
interior 12.4
talking 12.4
teamwork 12.1
dress 11.7
sofa 11.6
holding 11.6
executive 11.5
loving 11.4
businesspeople 11.4
wife 11.4
outdoors 11.4
togetherness 11.3
casual 11
worker 10.9
grandfather 10.7
two people 10.7
kin 10.7
life 10.6
working 10.6
color 10.6
modern 10.5
enjoyment 10.3
mature 10.2
wedding 10.1
20s 10.1
communication 10.1
bride 10
face 9.9
suit 9.9
romantic 9.8
looking 9.6
elderly 9.6
teacher 9.5
corporate 9.4
attractive 9.1
romance 8.9
living room 8.8
comfortable 8.6
marriage 8.5
bed 8.5
desk 8.5
mother 8.5
manager 8.4
house 8.4
drink 8.4
fun 8.2
indoor 8.2
relaxing 8.2
father 8.1
handsome 8
celebration 8
leisure activity 7.8
gown 7.8
affectionate 7.7
boyfriend 7.7
girlfriend 7.7
four 7.7
old 7.7
enjoying 7.6
adults 7.6
relaxation 7.5
relationship 7.5
bright 7.1
bedroom 7.1
glass 7

Google
created on 2022-01-30

Microsoft
created on 2022-01-30

window 94.6
text 94.3
person 92.5
table 84.4
funeral 83.3
clothing 80.6
candle 73.1
flower 72.6
wedding cake 72.2
birthday cake 71.5
old 58.9
wedding dress 58.7
people 58.5
black and white 53.8
man 52.2

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 97.8%
Calm 79.4%
Happy 6.8%
Sad 4.5%
Confused 3.7%
Surprised 1.8%
Angry 1.4%
Fear 1.3%
Disgusted 1.1%

AWS Rekognition

Age 56-64
Gender Male, 98.7%
Happy 86.6%
Calm 8.6%
Angry 1.1%
Confused 0.9%
Surprised 0.8%
Disgusted 0.8%
Sad 0.7%
Fear 0.6%

AWS Rekognition

Age 37-45
Gender Female, 98.5%
Calm 52.4%
Sad 15.5%
Confused 11.7%
Fear 6%
Surprised 5.5%
Angry 5%
Disgusted 2.5%
Happy 1.3%

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Calm 91.7%
Happy 2.8%
Sad 2.6%
Fear 0.9%
Disgusted 0.7%
Angry 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 54-64
Gender Female, 66%
Calm 96.4%
Sad 1%
Confused 0.8%
Fear 0.7%
Disgusted 0.5%
Happy 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 36-44
Gender Male, 78.5%
Confused 67.1%
Sad 13.9%
Calm 13.8%
Fear 1.9%
Happy 1.3%
Angry 0.9%
Disgusted 0.8%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a group of people sitting at a table 94.9%
a group of people sitting at a table in front of a window 90.8%
an old photo of a group of people sitting at a table 90.7%

Text analysis

Amazon

Birthday
ideup
ONLINE

Google

VEET
KODVK-
VEET KODVK-