Human Generated Data

Title

Untitled (children eating birthday cake)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16945

Human Generated Data

Title

Untitled (children eating birthday cake)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16945

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Person 98.7
Person 97
Person 96.4
Person 96.1
Interior Design 95.7
Indoors 95.7
Person 95.5
Room 94.8
Furniture 93.5
Person 92.5
Suit 84.1
Coat 84.1
Clothing 84.1
Overcoat 84.1
Apparel 84.1
Person 83.8
Living Room 81.8
People 80.1
Crowd 69.7
Table 68.7
Dining Table 67.9
Person 66.8
Couch 66.7
Baby 62.8
Person 61.2
Kid 60.5
Child 60.5
Face 60.1
Dining Room 59.4
Plant 57.3
Chair 53.9
Person 47.8

Clarifai
created on 2023-10-29

people 100
group 99.2
group together 99.1
monochrome 99
child 97.7
adult 97.5
man 97.4
woman 97
many 95.8
leader 93.1
music 92.1
boy 91.7
recreation 91.5
chair 90.4
several 89.1
sit 88.2
sitting 85.8
administration 85.6
furniture 84.7
war 84.3

Imagga
created on 2022-02-26

people 34
man 28.9
person 27.6
hospital 25.1
room 22.9
restaurant 21.4
home 20.7
male 20.2
indoors 19.3
women 19
adult 18.8
work 18.7
medical 16.8
men 16.3
patient 15.6
glass 14.5
happy 14.4
interior 14.1
working 14.1
nurse 13.7
sitting 13.7
equipment 13.3
doctor 13.1
smiling 13
occupation 12.8
cheerful 12.2
chair 12.1
table 11.9
lifestyle 11.6
care 11.5
medicine 11.4
worker 11
dishwasher 11
business 10.9
holding 10.7
smile 10.7
professional 10.7
dinner 10.5
group 10.5
couple 10.4
education 10.4
senior 10.3
casual 10.2
indoor 10
classroom 9.8
health 9.7
standing 9.5
shop 9.4
service 9.2
house 9.2
drink 9.2
furniture 9.1
modern 9.1
kitchen 9.1
food 9
clinic 8.9
job 8.8
case 8.8
together 8.8
salon 8.7
illness 8.6
office 8.5
inside 8.3
human 8.2
child 8.2
technology 8.2
family 8
science 8
happiness 7.8
meal 7.8
two people 7.8
desk 7.7
party 7.7
laboratory 7.7
surgeon 7.6
drinking 7.6
counter 7.6
customer 7.6
dining 7.6
appliance 7.6
communication 7.5
meeting 7.5
teamwork 7.4
wine 7.4
20s 7.3
computer 7.2
black 7.2
looking 7.2
celebration 7.2
team 7.2
portrait 7.1
to 7.1
building 7.1

Google
created on 2022-02-26

Black 89.8
Chair 89.1
Table 87.9
Black-and-white 87
Style 84.1
Monochrome 78.5
Monochrome photography 77.6
Serveware 72.5
Room 72
Classic 71.8
Event 70.8
Motor vehicle 66.6
Plate 66.1
Drinkware 65
Sitting 64.4
Stock photography 63.7
Team 60.9
History 60.4
Tableware 60.1
Font 56

Microsoft
created on 2022-02-26

person 99.3
text 97.4
clothing 92.5
group 74.9
people 67.3
black and white 65.2
man 63.2
human face 55.7
old 46.5
family 17.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 99.6%
Happy 59.1%
Sad 22.1%
Calm 13.9%
Angry 1.5%
Surprised 1.1%
Confused 1%
Disgusted 0.6%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Female, 72.7%
Fear 77.5%
Calm 8.6%
Surprised 6.1%
Sad 3.5%
Happy 1.7%
Disgusted 0.9%
Angry 0.9%
Confused 0.7%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 65%
Sad 12.3%
Surprised 8.8%
Angry 5.5%
Confused 3.7%
Disgusted 2.4%
Fear 1.3%
Happy 1.1%

AWS Rekognition

Age 33-41
Gender Male, 92.3%
Calm 65.9%
Disgusted 9.7%
Surprised 6.6%
Sad 4.9%
Confused 4.8%
Fear 4.4%
Angry 2.6%
Happy 1%

AWS Rekognition

Age 10-18
Gender Female, 72.2%
Sad 39.7%
Calm 36.8%
Happy 14%
Surprised 4.7%
Angry 1.9%
Disgusted 1.5%
Fear 0.8%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.4%
Person 98.7%
Person 97%
Person 96.4%
Person 96.1%
Person 95.5%
Person 92.5%
Person 83.8%
Person 66.8%
Person 61.2%
Person 47.8%
Chair 53.9%

Categories