Human Generated Data

Title

Untitled (boy with birthday cake)
Date

c. 1910
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.722

Human Generated Data

Title

Untitled (boy with birthday cake)

People

Artist: Martin Schweig, American 20th century

Date

c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97.5
Person 97.5
Sailor Suit 93.9
Cake 92.1
Food 92.1
Dessert 92.1
Candle 78.5
Birthday Cake 66.7

Imagga
created on 2022-01-08

child 57.2
home 35.1
person 33.1
toilet 28.3
happy 28.2
people 27.9
kid 26.6
smiling 26.1
childhood 24.2
family 22.2
little 22.1
indoors 22
smile 21.4
happiness 21.2
boy 20.9
kitchen 20.6
cute 20.1
fun 19.5
male 19.5
portrait 19.4
cheerful 17.9
adult 17
indoor 15.5
man 15.5
blond 15.5
lifestyle 15.2
interior 15
face 14.9
standing 13.9
sitting 13.7
looking 13.6
room 13.4
joy 13.4
cooking 13.1
baby 13.1
children 12.8
food 12.7
son 12.5
juvenile 12.1
mother 11.9
girls 11.9
stethoscope 11.6
toddler 11.5
table 11.3
senior 11.3
hair 11.1
drink 10.9
daughter 10.7
pretty 10.5
play 10.3
two 10.2
clothing 10.2
holding 9.9
enjoying 9.5
enjoy 9.4
casual 9.3
mature 9.3
domestic 9.3
cook 9.2
leisure 9.1
playing 9.1
attractive 9.1
parent 9.1
human 9
medical 8.8
school 8.8
couple 8.7
women 8.7
mid adult 8.7
education 8.7
age 8.6
expression 8.5
togetherness 8.5
one person 8.5
washbasin 8.5
old 8.4
nurse 8.3
hat 8.2
one 8.2
meal 8.2
uniform 8
color 7.8
preschool 7.8
instrument 7.8
drinking 7.7
husband 7.6
wife 7.6
kids 7.5
care 7.4
vessel 7.1
love 7.1
together 7

Google
created on 2022-01-08

Food 89.3
Cake decorating 85.8
Cake 82.3
Art 80.5
Birthday cake 74.2
Hat 72.6
Sugar cake 72.4
Toddler 71.3
Baby 70.9
Dessert 70.5
Vintage clothing 70.4
Room 67.5
Candle 67
Sweetness 63.9
Sitting 63.4
Illustration 61.2
Suit 60.6
Birthday 60.2
Baked goods 59.9
Buttercream 58.9

Microsoft
created on 2022-01-08

person 98.5
wall 96.2
birthday cake 95.9
text 94.3
candle 88.8
indoor 87.1
toddler 78.6
child 78.6
boy 76.9
clothing 69.3
baby 62.8
cake 56.2
human face 52.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 93.8%
Calm 72.8%
Sad 16.2%
Surprised 4.1%
Angry 1.9%
Fear 1.5%
Disgusted 1.4%
Confused 1.2%
Happy 0.8%

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Candle 78.5%
Birthday Cake 66.7%

Captions

Microsoft

a little boy that is standing in front of a window 62.8%
a little boy standing in front of a window 62.7%
a young boy standing in front of a window 62.3%

Text analysis

Amazon

Sr.
SCHWEIG
Sr. LAULS
LAULS

Google

Sr. auls
Sr.
auls