Human Generated Data

Title

Administrative Assistant, Pittsburgh

Date

1990, printed 2015

People

Artist: Nathan Benn, American born 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nathan Benn, 2018.182

Copyright

© Nathan Benn

Human Generated Data

Title

Administrative Assistant, Pittsburgh

People

Artist: Nathan Benn, American born 1950

Date

1990, printed 2015

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Human 98.1
Person 98.1
Wood 96
Plywood 93.5
Cardboard 91.1
Box 89.9
Shelf 88.6
Furniture 82.8
Carton 77.8
Clothing 72.1
Apparel 72.1
Indoors 69.8
Desk 62.2
Table 62.2
Worker 59.9
Computer 59.3
Electronics 59.3
Pc 59.3
Bookcase 58.4
Brick 56.8
Package Delivery 55.7

Clarifai
created on 2019-07-20

furniture 99.4
indoors 99
education 98.5
room 98.1
adult 98.1
woman 97.8
people 96.9
facial expression 96.6
shelf 96
employee 95.6
desk 95.2
library 95
school 94.6
sit 94.5
seat 94.1
one 93.4
chair 93.2
knowledge 92.9
university 91.1
technology 90.9

Imagga
created on 2019-07-20

library 99.7
building 51.7
laptop 43.6
structure 42.2
education 39
book 38.2
computer 37.5
people 35.2
office 34.1
student 31.4
learning 31
business 31
books 31
man 29.6
table 29.2
working 28.3
desk 26.4
studying 25.9
university 25.8
sitting 24.9
male 24.9
person 24.7
school 24.3
notebook 24.2
smiling 23.9
work 23.8
indoors 22.9
college 22.8
happy 22.6
adult 22.1
reading 20.9
businesswoman 20.9
classroom 19.8
smile 18.5
professional 18.5
bookcase 17.9
businessman 17.7
attractive 17.5
workplace 17.2
furniture 16.9
home 16.8
indoor 16.4
corporate 16.3
looking 16
job 15.9
study 15.9
archive 15.9
room 15.6
casual 15.3
meeting 15.1
women 15
paper 14.9
teamwork 14.8
occupation 14.7
teenager 14.6
knowledge 14.5
exam 14.4
team 14.3
technology 14.1
group 13.7
businesspeople 13.3
writing 13.2
lifestyle 13
portrait 13
men 12.9
product 12.9
academic 12.8
pen 12.6
happiness 12.5
learn 12.3
together 12.3
color 12.2
stack 12
homework 11.7
talking 11.4
boy 11.3
document 11.1
executive 11.1
teacher 11.1
20s 11
communication 10.9
suit 10.8
handsome 10.7
interior 10.6
modern 10.5
wireless 10.5
furnishing 10.4
smart 10.4
expression 10.3
horizontal 10.1
creation 9.9
bookshelf 9.9
pretty 9.8
textbook 9.8
cheerful 9.8
success 9.7
shop 9.7
sit 9.5
two 9.3
face 9.2
teen 9.2
studies 8.9
pupil 8.8
teaching 8.8
wisdom 8.8
employee 8.7
females 8.5
bookshop 8.5
pile 8.5
manager 8.4
presentation 8.4
alone 8.2
girls 8.2
assignment 7.9
brunette 7.8
students 7.8
partners 7.8
test 7.7
using 7.7
youth 7.7
child 7.6
friends 7.5
glasses 7.4
camera 7.4
alcove 7.4
lady 7.3
confident 7.3
worker 7.2
clothing 7.2

Google
created on 2019-07-20

Job 57
Furniture 53.3
Employment 51.7
Building 50.8

Microsoft
created on 2019-07-20

book 98.7
person 97.3
indoor 91
bookcase 83
furniture 79.8
library 77.9
shelf 63.8
desk 60.1
clothing 58.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 93.8%
Surprised 0.6%
Happy 0.2%
Angry 2.6%
Confused 1.4%
Calm 23.3%
Disgusted 0.4%
Sad 71.4%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Box 89.9%

Captions

Microsoft

a person sitting at a table in front of a book 53.7%
a person sitting at a table 53.6%
a person sitting on a table 53.5%