Human Generated Data

Title

Untitled (smiling boy standing in playroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16309

Human Generated Data

Title

Untitled (smiling boy standing in playroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Furniture 99.9
Apparel 99.5
Clothing 99.5
Person 99.4
Human 99.4
Face 93.7
Door 93.4
Floor 89
Chair 88.5
Baby 86
Indoors 82.8
Kid 82.4
Child 82.4
Room 79
Table 78.7
Pants 73.4
Cabinet 72.6
Costume 71.8
Flooring 70.8
Photography 70.6
Photo 70.6
Portrait 70.6
Dining Table 69.2
Dress 68.2
Girl 66.5
Female 66.5
Screen 66.2
Electronics 66.2
Hat 62.7
Home Decor 62.2
Display 60
Monitor 60
Cupboard 58.5
Closet 58.5
Boy 58.4
Street 56.5
Town 56.5
Building 56.5
Urban 56.5
Road 56.5
City 56.5

Imagga
created on 2022-02-11

door 31.4
building 26.5
sliding door 23.5
house 23.4
interior 23
architecture 22.2
room 20.6
home 20
window 19.2
chair 18.2
man 18.1
people 16.2
crutch 16.1
wall 15.5
movable barrier 14.6
male 14.3
city 14.1
old 13.9
furniture 13.8
design 13.5
structure 12.9
business 12.8
staff 12.4
indoors 12.3
women 11.9
lifestyle 11.6
office 11.5
apartment 11.5
light 11.4
fashion 11.3
modern 11.2
barrier 10.8
adult 10.6
urban 10.5
stone 10.4
seat 10.1
wood 10
person 9.9
portrait 9.7
style 9.6
windows 9.6
living 9.5
men 9.4
luxury 9.4
stick 9.3
newspaper 9.3
inside 9.2
historic 9.2
family 8.9
decoration 8.7
residential 8.6
estate 8.5
pretty 8.4
elegance 8.4
floor 8.4
product 8.3
life 8.3
street 8.3
indoor 8.2
happy 8.1
school 8
shop 8
space 7.8
sofa 7.7
two 7.6
real 7.6
brick 7.5
library 7.4
town 7.4
hall 7.4
column 7.4
new 7.3
black 7.2
work 7.2
history 7.2
smile 7.1
face 7.1
decor 7.1
businessman 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 97.6
toddler 97.5
baby 85.6
clothing 84.2
boy 78.7
child 74.6
person 73.3
furniture 72.7
black and white 66
chair 56.7
window 21.7

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Calm 36.5%
Happy 26.3%
Surprised 24.1%
Sad 6.5%
Fear 2.4%
Confused 2.1%
Angry 1.2%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 88.5%

Captions

Microsoft

a person standing in front of a door 86.1%
a person standing in front of a window 82%
a person standing in front of a door 78.2%

Text analysis

Amazon

4
PURSKOOL
POSTAL
age
KODOK--

Google

YT3RA2
YT3RA2