Human Generated Data

Title

Ben Barney, Tsalie, AZ

Date

2002

People

Artist: Andrea Modica, American born 1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sidney and Shirley Singer, 2013.178.22

Copyright

© Andrea Modica

Human Generated Data

Title

Ben Barney, Tsalie, AZ

People

Artist: Andrea Modica, American born 1961

Date

2002

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.7
Person 98.7
Painting 84.5
Art 84.5
Wall 77.3
Face 67.2
Window 63.6
Photography 59
Photo 59
Pot 58.5
Sitting 57.2

Clarifai
created on 2018-02-09

people 100
child 99.1
room 97.7
one 97.7
adult 97.5
portrait 97.3
furniture 94.1
man 94
boy 92.8
two 92.7
monochrome 91.9
documentary 91.5
indoors 90
family 89.4
military 88.9
woman 88.8
art 88.5
group 87.3
home 85.9
facial expression 85

Imagga
created on 2018-02-09

old 38.3
vessel 36.6
wall 31.9
container 31.7
washbasin 27.2
texture 24.3
bucket 24.2
grunge 23.8
ancient 23.3
vintage 23.1
basin 21.7
stone 19.9
architecture 19.5
aged 19
antique 17.3
building 16.8
paper 15.1
toilet 14.9
textured 14.9
retro 13.9
structure 13.7
dirty 13.5
rusty 13.3
historic 12.8
room 12.1
detail 12.1
house 11.7
door 11.4
historical 11.3
design 11.2
window 11
close 10.8
frame 10
city 10
travel 9.9
material 9.8
device 9.7
brown 9.6
grungy 9.5
wallpaper 9.2
brick 9.1
history 8.9
doormat 8.9
decoration 8.9
damaged 8.6
cell 8.4
wood 8.3
memorial 8.3
sign 8.3
rough 8.2
closeup 8.1
metal 8
mat 8
urban 7.9
sand 7.9
empty 7.7
rust 7.7
culture 7.7
money 7.7
pattern 7.5
backdrop 7.4
box 7.3
border 7.2
home 7.2
holiday 7.2
surface 7.1

Google
created on 2018-02-09

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 93%
Disgusted 12%
Calm 68%
Happy 1.4%
Angry 6.2%
Sad 8.1%
Confused 2.8%
Surprised 1.5%

Microsoft Cognitive Services

Age 46
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 84.5%

Captions

Microsoft

a person standing in front of a building 66.1%
a person sitting in front of a building 53.7%
a person standing in front of a building 53.6%