Human Generated Data

Title

Untitled (boy playing with model house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17372

Human Generated Data

Title

Untitled (boy playing with model house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.5
Human 99.3
Person 99.3
Chair 95.4
Tabletop 94.9
Home Decor 91.5
Table 89.1
Face 88.4
Meal 80.6
Food 80.6
Female 76.4
Sitting 69.8
Indoors 69.3
Dining Table 67.5
Clothing 67.5
Apparel 67.5
Person 65.3
Photo 64.4
Photography 64.4
Portrait 64.4
Girl 63
Linen 62.2
Sleeve 62.1
Room 59.3
Brick 57.1
Long Sleeve 56.4
Kid 55.7
Child 55.7

Imagga
created on 2022-02-26

newspaper 75.6
product 58.2
creation 45
laptop 37.4
computer 30
sitting 26.6
people 26.2
person 25.9
man 24.9
adult 24.4
business 21.9
work 21.4
lifestyle 21
technology 20.8
smiling 20.3
room 20.1
happy 20.1
table 19.3
male 19.2
businesswoman 19.1
cheerful 18.7
working 18.6
chair 18.3
portrait 17.5
office 16.6
communication 16
home 15.2
women 15
indoors 14.9
happiness 14.9
classroom 14.4
casual 14.4
education 13.9
corporate 13.7
musical instrument 13.5
attractive 13.3
job 13.3
holding 13.2
professional 12.8
senior 12.2
smile 12.1
modern 11.9
pretty 11.9
child 11.8
relaxation 11.7
wireless 11.4
reading 11.4
together 11.4
notebook 11.3
boy 11.3
executive 11.1
one person 10.4
desk 10.3
coffee 10.2
worker 10.1
student 10.1
keyboard 9.8
old 9.8
businessman 9.7
success 9.7
using 9.6
couple 9.6
elderly 9.6
businesspeople 9.5
men 9.4
furniture 9.4
day 9.4
house 9.2
suit 9
outdoors 9
family 8.9
seat 8.7
device 8.7
retirement 8.6
studying 8.6
sofa 8.6
youth 8.5
floor 8.4
mature 8.4
book 8.3
glasses 8.3
successful 8.2
cup 8.1
lady 8.1
looking 8
holiday 7.9
face 7.8
while 7.8
typing 7.8
color 7.8
full length 7.8
content 7.7
couch 7.7
school 7.6
learning 7.5
enjoyment 7.5
screen 7.5
one 7.5
indoor 7.3
cute 7.2
love 7.1
kid 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.6
sitting 94.6
table 87.4
outdoor 85.9
furniture 78.3
black and white 74.2
person 70.6
black 66.8
old 64.8

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 97.3%
Happy 88.9%
Surprised 5.7%
Calm 3.1%
Sad 0.9%
Fear 0.5%
Disgusted 0.3%
Angry 0.3%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person sitting on a bench 76.9%
a person sitting on a bench in front of a table 76.8%
a person sitting on a bench 76.7%

Text analysis

Amazon

22