Human Generated Data

Title

Men Standing on the Street with me on Sunday, July 1, 1979, . . .
Date

1981
People

Artist: Stanley Stellar, American 1945 -

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Deknatel Purchase Fund and through the generosity of Robert D. Watson in memory of Mary Watson, M20516

Human Generated Data

Title

Men Standing on the Street with me on Sunday, July 1, 1979, . . .

People

Artist: Stanley Stellar, American 1945 -

Date

1981

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-05-28

Person 99.6
Human 99.6
Clothing 98.7
Apparel 98.7
Art 95.1
Person 94.8
Sleeve 78.5
Person 74.7
T-Shirt 69.1
Poster 68.1
Advertisement 68.1
Painting 64.7
Person 62.9
Art Gallery 56.8

Clarifai
created on 2019-05-28

people 98.7
museum 98.7
painting 96.3
picture frame 95.1
art 95
adult 94.8
portrait 94.3
illustration 93.7
group 93.3
image 93.1
blank 92.4
exhibition 92
man 91.9
album 91.8
woman 91.7
symbol 89.9
moment 89.6
wear 89.5
business 87.8
desktop 86.8

Imagga
created on 2019-05-28

blackboard 100
chalkboard 46.1
jersey 41.1
chalk 40
board 36.9
shirt 31.1
message 29.2
school 27.9
black 26
note 25.7
blank 25.7
education 25.1
garment 24.7
paper 22
empty 21.5
frame 21.1
business 18.8
texture 18.8
classroom 18.5
envelope 18.2
billboard 17.6
teach 16.6
reminder 16.5
notice 16.5
learn 16.1
clothing 15.2
symbol 14.8
covering 14.7
write 14.1
vintage 14.1
study 14
space 14
sticky 13.6
copy 13.3
old 13.2
nobody 13.2
sign 12.8
communication 12.6
class 12.5
wood 12.5
text 12.2
container 12
lesson 11.7
retro 11.5
wooden 11.4
icon 11.1
grunge 11.1
horizontal 10.9
border 10.9
copy space 10.8
design 10.7
announcement 10.7
university 10.5
college 10.4
drawing 10.4
writing 10.4
card 10.2
written 9.8
elementary 9.8
info 9.7
wall 9.5
word 9.4
letter 9.2
idea 8.9
remember 8.8
mind 8.8
object 8.8
teacher 8.7
post 8.6
money 8.5
consumer goods 8.4
global 8.2
passport 7.9
remind 7.9
world 7.6
finance 7.6
pattern 7.5
learning 7.5
success 7.2
office 7.2
holiday 7.2
information 7.1
travel 7

Google
created on 2019-05-28

Photograph 94.8
Red 94.4
Picture frame 86.3
T-shirt 83.3
Art 67.7
Outerwear 65.8
Room 65.7
Sleeve 61.3
Illustration 60.2
Rectangle 59.4
Square 58.7
Visual arts 55

Microsoft
created on 2019-05-28

wall 99.2
gallery 97.9
indoor 97.1
clothing 95.7
scene 95.3
drawing 94.9
person 94.2
room 93.2
poster 85.2
man 84.8
cartoon 80.8
art 78
painting 68
mounted 66.5
design 53.3
smile 53.3
human face 50
picture frame 10.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98%
Happy 0.2%
Disgusted 0.7%
Confused 2.8%
Calm 17.6%
Angry 3%
Sad 75.2%
Surprised 0.7%

AWS Rekognition

Age 29-45
Gender Female, 65.4%
Angry 37.8%
Happy 5.3%
Surprised 13.8%
Disgusted 7.5%
Sad 22.3%
Confused 8.5%
Calm 4.8%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Poster 68.1%

Captions

Microsoft

a painting of a video game 44.4%
a painting in a frame hanging on a wall 44.3%
a painting hanging on a wall 44.2%

Text analysis

Amazon

ANRO
OAR