Human Generated Data

Title

Untitled (man with moustache)

Date

1970s

People

Artist: Susan Meiselas, American born 1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1850

Copyright

© Susan Meiselas / Magnum

Human Generated Data

Title

Untitled (man with moustache)

People

Artist: Susan Meiselas, American born 1948

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Furniture 100
Person 99
Human 99
Desk 97
Table 97
Indoors 96.8
Room 93
Bookcase 92.3
Shelf 91.8
Bedroom 90.8
Interior Design 73.9
Living Room 71.9
Shoe 69.9
Clothing 69.9
Footwear 69.9
Apparel 69.9
Electronics 69.5
Computer 65.2
Monitor 64.7
Display 64.7
Screen 64.7
Shoe 62.5
Bed 60.6
LCD Screen 58.5

Imagga
created on 2022-01-22

library 100
building 80.7
structure 58.5
furniture 42.2
file 42
office furniture 32.1
interior 29.2
city 23.3
indoors 21.1
house 20.9
modern 20.3
book 20.3
books 20.3
architecture 20.3
education 19.9
bookcase 19.1
room 18.4
office 17.2
learning 16.9
home 16.7
shop 16.7
row 14.9
bookshelf 14.8
bookshop 14.6
apartment 14.4
research 14.3
university 14.2
urban 14
table 13.5
inside 12.9
shelf 12.6
school 12.6
old 12.5
floor 12.1
window 11.9
chair 11.6
business 11.5
reading 11.4
store 11.3
work 11
glass 10.9
horizontal 10.9
furnishing 10.8
read 10.6
storage 10.5
luxury 10.3
wall 10.3
industry 10.2
design 10.1
literature 9.8
decor 9.7
equipment 9.6
knowledge 9.6
color 9.5
street 9.2
wood 9.2
indoor 9.1
history 8.9
shelves 8.9
center 8.8
mercantile establishment 8.8
studying 8.6
study 8.4
computer 8.2
student 8.1
microfilm 8.1
reflection 8.1
working 8
lifestyle 7.9
rack 7.8
paper 7.8
people 7.8
male 7.8
adult 7.8
residential 7.7
estate 7.6
college 7.6
technology 7.4
style 7.4
archive 7.3
information 7.1

Google
created on 2022-01-22

Bookcase 94.5
Cabinetry 93.6
Furniture 93.5
Shelf 93.5
Building 93.4
Table 91.6
Book 87.3
Shelving 86.4
Standing 86.4
Chair 86.1
Publication 85.4
Black-and-white 85.4
Interior design 85.3
Desk 84
Style 83.8
Drawer 82.8
Chest of drawers 81.1
Monochrome 74.7
Lamp 73.2
Monochrome photography 73.1

Microsoft
created on 2022-01-22

indoor 99.8
text 99.6
book 99.6
shelf 99.3
library 93.2
room 92.7
living 91
black and white 89.2
bookcase 87.9
desk 84
computer 82
ceiling 75.4
black 75.3
scene 70.9
person 55.3
bedroom 52.8
furniture 45.1
cluttered 27.4
messy 26.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 43.6%
Fear 26.5%
Surprised 13.1%
Confused 5%
Angry 4.4%
Disgusted 3.1%
Sad 2.8%
Happy 1.4%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Shoe 69.9%
Bed 60.6%

Captions

Microsoft

a living room filled with furniture and a book shelf 86.5%
a room filled with furniture and a book shelf 86.4%
a living room filled with furniture next to a book shelf 78.1%

Text analysis

Amazon

CHOMSKY
/
CHOMSKY II
II
EMPIRES /
EMPIRES

Google

25E
25E