Human Generated Data

Title

Untitled (girl with alphabet blocks on table)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16384

Human Generated Data

Title

Untitled (girl with alphabet blocks on table)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Wood 98.1
Human 97.2
Person 95.6
Furniture 93.6
Chair 93.6
Floor 93.2
Flooring 92.6
Baby 90.6
Face 90.4
Clothing 88.2
Apparel 88.2
Door 82.5
Pants 79.3
Photography 72.6
Photo 72.6
Portrait 72.6
Plywood 71.4
Kid 67
Child 67
Hardwood 61
Shelf 58.7
Table 58.4
Denim 56.4
Jeans 56.4

Imagga
created on 2022-02-11

interior 38.9
home 37.5
house 34.2
room 27.4
indoors 26.3
modern 25.2
furniture 25.1
kitchen 23.9
blackboard 19.9
window 19.7
luxury 17.1
decor 16.8
people 16.7
apartment 16.3
domestic 15.9
floor 15.8
design 15.7
person 15.6
architecture 14.8
adult 14.3
clean 14.2
man 14.1
residential 13.4
table 13.2
chair 12.9
lifestyle 12.3
male 12
happy 11.9
portrait 11.6
decoration 11.6
light 11.4
pretty 11.2
women 11.1
glass 11
smiling 10.8
faucet 10.8
luxurious 10.7
hotel 10.5
casual 10.2
inside 10.1
wood 10
fashion 9.8
cabinet 9.7
mirror 9.5
contemporary 9.4
sink 9.3
relaxation 9.2
appliance 9.2
holding 9.1
bathroom 9
new 8.9
style 8.9
sexy 8.8
oven 8.8
medical 8.8
work 8.6
comfortable 8.6
estate 8.5
bath 8.5
elegance 8.4
wall 8.3
device 8.3
indoor 8.2
one 8.2
stylish 8.1
stove 8
cute 7.9
cooking 7.9
smile 7.8
happiness 7.8
life 7.8
education 7.8
elegant 7.7
attractive 7.7
health 7.6
cleaner 7.4
counter 7.3
dress 7.2
hospital 7.2
worker 7.2
science 7.1
lamp 7.1
face 7.1
door 7.1
steel 7.1
working 7.1
day 7.1

Google
created on 2022-02-11

Table 88.1
Chair 86.4
Black-and-white 86.1
Style 83.9
Line 81.8
Desk 79.3
Monochrome 77
Monochrome photography 76.7
Art 76.3
Window 74.8
Room 70.5
Rectangle 67.9
Sitting 66.6
Visual arts 64
Stock photography 63
Still life photography 61.8
Font 61.2
Photographic paper 58.3
Glass 56.7
Vintage clothing 52.6

Microsoft
created on 2022-02-11

text 94.2
person 92.8
statue 84.9
black and white 77.3

Face analysis

Amazon

AWS Rekognition

Age 13-21
Gender Male, 90.8%
Happy 49.3%
Calm 27.9%
Surprised 8.8%
Sad 4.4%
Angry 2.9%
Disgusted 2.8%
Confused 2.7%
Fear 1.1%

Feature analysis

Amazon

Person 95.6%
Chair 93.6%

Captions

Microsoft

a person standing in front of a window 71.1%
a person sitting in front of a window 47.5%
a person sitting in front of a window 47.4%

Text analysis

Amazon

12
D
F
D o F
x
8
BEL
o
SK OFSTYEPM
УПРАА-ЖАСОХ
amen
FB

Google

12
SKOK 12
SKOK