Human Generated Data

Title

Untitled (young boy cutting cake with assistance of mother at children's birthday party table)
Date

1942
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10179

Human Generated Data

Title

Untitled (young boy cutting cake with assistance of mother at children's birthday party table)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99
Human 99
Person 97.9
Person 96.9
Person 95.8
Person 90.1
Furniture 89.9
Room 87.9
Indoors 87.9
Table 84.8
Dining Table 84.4
Wedding Cake 82.2
Dessert 82.2
Food 82.2
Cake 82.2
People 82.1
Face 69.8
Dining Room 62.1
Photo 61.6
Photography 61.6
Portrait 61.6
Meal 57.7

Imagga
created on 2022-01-22

newspaper 38.9
home 31.1
product 29.2
people 27.9
child 27.8
adult 26.8
indoors 26.4
creation 23.6
man 22.2
happy 21.3
male 20.9
family 20.5
person 20.1
sitting 19.8
smiling 18.8
mother 17.1
kid 16.8
room 16.8
children 16.4
smile 14.3
happiness 14.1
parent 13.7
lifestyle 13
education 13
indoor 12.8
daughter 12.7
love 12.6
bed 12.3
together 12.3
cute 12.2
couple 12.2
cheerful 12.2
boy 12.2
two 11.9
father 11.8
desk 11.8
blond 11.7
portrait 11.7
couch 11.6
reading 11.4
adults 11.4
office 11.3
dad 11.1
sketch 10.8
childhood 10.8
computer 10.5
females 10.4
student 10.3
women 10.3
mature 10.2
book 10.2
casual 10.2
salon 10.2
baby 10.1
nurse 10.1
house 10
care 9.9
life 9.8
homework 9.7
interior 9.7
group 9.7
brunette 9.6
drawing 9.5
men 9.4
work 9.4
study 9.3
20s 9.2
girls 9.1
business 9.1
relaxing 9.1
attractive 9.1
cup 9
fun 9
chair 8.8
working 8.8
patient 8.7
day 8.6
kin 8.6
expression 8.5
youth 8.5
togetherness 8.5
learning 8.5
senior 8.4
school 8.4
one 8.2
dress 8.1
paper 8.1
hospital 8
30s 7.7
studying 7.7
old 7.7
exam 7.7
break 7.6
sit 7.6
horizontal 7.5
leisure 7.5
holding 7.4
table 7.4
looking 7.2
team 7.2
appliance 7.2
bright 7.2
bedroom 7.1
face 7.1
to 7.1
device 7

Google
created on 2022-01-22

Photograph 94.1
Table 89
Sharing 84.3
Art 81.5
Adaptation 79.3
Snapshot 74.3
Chair 72.6
Vintage clothing 72.4
Toddler 72.4
Event 72.3
Child 68
Room 67
Stock photography 63.3
Monochrome 62.6
Photo caption 62.3
Sitting 61.4
Illustration 61.2
Cooking 59.9
History 59.8
Visual arts 57.1

Microsoft
created on 2022-01-22

person 99.5
wall 98.2
indoor 97.8
human face 94.9
child 90.2
clothing 89.3
text 89.1
baby 85.3
toddler 79.6
people 64.9
group 64.9
old 57.2
table 57.2
family 23.6
meal 17.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Female, 99.7%
Happy 99.4%
Surprised 0.2%
Calm 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 23-31
Gender Female, 99.2%
Calm 74.6%
Sad 18.5%
Happy 2.8%
Fear 1%
Surprised 0.9%
Angry 0.8%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 0-4
Gender Female, 90.9%
Angry 76.2%
Calm 14.3%
Sad 3.4%
Disgusted 1.6%
Happy 1.5%
Fear 1.3%
Surprised 0.9%
Confused 0.7%

AWS Rekognition

Age 2-8
Gender Female, 81.8%
Calm 82%
Sad 16.7%
Confused 0.6%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 4
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Wedding Cake 82.2%

Captions

Microsoft

a group of people sitting at a table 95.8%
a group of people sitting around a table 95.7%
a group of people sitting at a table in front of a window 91.4%

Text analysis

Amazon

Shadow
lighten
lighten Shadow tix
tix

Google

lightin
lightin Bhado
Bhado