Human Generated Data

Title

"Sunrise Breakfast," Sturgeon Bay
Date

August 1993
People

Artist: William Tolan, American born 1963
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2000.63

Human Generated Data

Title

"Sunrise Breakfast," Sturgeon Bay

People

Artist: William Tolan, American born 1963

Date

August 1993

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the artist, P2000.63

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.8
Human 99.8
Person 99.7
Person 99.7
Food 90.6
Dessert 77.3
Wood 72.1
Shelf 69.5
Furniture 58.7
Sweets 58.5
Confectionery 58.5

Clarifai
created on 2023-10-28

child 99.9
family 99.5
girl 99.2
son 99.2
people 99.1
woman 97.7
offspring 97.2
four 96.7
man 96.4
group 96.2
room 95.9
table 95.7
fun 95.5
boy 95.5
furniture 94.9
love 94
sibling 93.5
daddy 93.4
meal 93.4
togetherness 93.2

Imagga
created on 2022-02-26

man 38.3
male 38
home 36.7
couple 36.6
happy 35.1
family 33.8
together 33.3
smiling 32.6
child 31.1
people 30.7
lifestyle 28.2
senior 28.1
mother 25
indoors 24.6
togetherness 23.6
sitting 23.2
kin 22.4
adult 22.4
happiness 21.9
grandfather 21.8
smile 21.4
love 20.5
husband 20
boy 20
meal 20
parent 19.6
mature 19.5
table 19.2
father 19.1
wife 19
cheerful 18.7
elderly 18.2
person 18.2
kitchen 17.9
women 17.4
30s 17.3
son 16.9
children 16.4
food 16.1
eating 15.1
childhood 14.3
enjoying 14.2
kid 14.2
dad 13.8
enjoyment 13.1
grandma 13.1
portrait 12.9
daughter 12.8
fun 12.7
holding 12.4
friends 12.2
group 12.1
two people 11.7
breakfast 11.3
old 11.2
dinner 11
their 10.8
classroom 10.7
care 10.7
mom 10.7
domestic 10.7
interior 10.6
mid adult 10.6
retirement 10.6
married 10.5
attractive 10.5
room 10.5
sibling 10.2
casual 10.2
cute 10
grandmother 9.8
little 9.7
hug 9.7
baby 9.6
loving 9.5
education 9.5
color 9.5
laughing 9.5
day 9.4
tea 9.4
relaxed 9.4
three 9.3
horizontal 9.2
relaxing 9.1
restaurant 8.9
cup 8.9
looking 8.8
thirties 8.8
retired 8.7
toddler 8.6
men 8.6
oriental 8.6
learning 8.5
house 8.4
drink 8.4
vacation 8.2
school 8.2
blond 8.1
cooking 7.9
60s 7.8
40s 7.8
affection 7.7
youth 7.7
sofa 7.7
two 7.6
reading 7.6
lunch 7.5
friendship 7.5
leisure 7.5
outdoors 7.5
coffee 7.4
teacher 7.2
to 7.1

Google
created on 2022-02-26

Photograph 94.1
Food 93.7
Table 89.1
Sharing 87.8
Tableware 87.5
Shorts 83.2
Plate 83.2
People 80.2
Toddler 76.3
T-shirt 75.4
Happy 74.8
Event 72
Rectangle 71.6
Tree 71.6
Leisure 71
Art 67.9
Sitting 67.4
Room 67.4
Child 67.1
Fun 67

Microsoft
created on 2022-02-26

person 99.6
food 97.2
birthday cake 96.6
window 83.2
human face 79.7
tableware 78.9
text 72.2
cake 72.1
dessert 67
clothing 65.4
birthday 58.6
baked goods 50
table 28.5
meal 22.5
family 19.1
dining table 16.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 99.8%
Happy 98.3%
Calm 0.7%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Sad 0.1%
Confused 0.1%

Feature analysis

Amazon

Person
Person 99.8%

Categories

Imagga

people portraits 98.8%

Text analysis

Amazon

Crispix
Kel
RICE
KRISPIES
FROOT
LOOPS
NHO
Just
031 NHO
Right
R
11
031
OID
EIIO OID
EIIO
NOT
that

Google

Gispb RICE KRISPIES hust Rie
Gispb
RICE
KRISPIES
hust
Rie