Human Generated Data

Title

Untitled (two men selling peppers displayed on newspapers and burlap, Brazil)
Date

1974
People

Artist: Ken Heyman, American born 1930
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Susan and Neal Yanofsky, 2011.551
Copyright

© Ken Heyman

Human Generated Data

Title

Untitled (two men selling peppers displayed on newspapers and burlap, Brazil)

People

Artist: Ken Heyman, American born 1930

Date

1974

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.6
Human 99.6
Person 99.1
Apparel 79
Clothing 79
Animal 74.2
Rug 64.7
Soil 63.2
Archaeology 62.6
Chess 61.2
Game 61.2
Footwear 55.7
Shoe 55.7

Clarifai
created on 2018-02-10

people 99.9
group 99.3
adult 99.1
many 96.4
one 95.8
man 95.7
woman 95.3
group together 94.6
wear 91.9
war 90.6
two 90.5
several 89.1
child 88.4
three 87.9
administration 87.7
portrait 87.5
leader 85.8
four 85.7
street 84.3
military 82.2

Imagga
created on 2018-02-10

chalk 100
texture 26.4
surface 22.9
pattern 19.8
stone 19.7
textured 18.4
old 18.1
sand 18
wall 18
rough 15.5
beach 15.2
concrete 14.4
construction 13.7
sidewalk 13
grunge 12.8
gray 12.6
brown 12.5
wallpaper 12.3
person 12.1
water 12
dirty 11.7
structure 11.7
material 11.6
rock 11.3
sea 10.9
cement 10.7
detail 10.5
close 10.3
color 10
brick 9.6
weathered 9.5
street 9.2
aged 9
road 9
design 9
obsolete 8.6
rusty 8.6
grungy 8.5
travel 8.5
summer 8.4
ocean 8.3
fun 8.2
retro 8.2
backgrounds 8.1
metal 8
pavement 7.9
architecture 7.8
people 7.8
art 7.8
antique 7.8
walk 7.6
man 7.6
vintage 7.4
shore 7.4
game 7.4
checker 7.3
puzzle 7.3
paint 7.2
black 7.2

Google
created on 2018-02-10

photograph 95.5
black 94.9
black and white 91.4
snapshot 81.8
photography 81.4
monochrome photography 79.2
monochrome 77.1
human 71.7
human behavior 53.7
recreation 51.5

Microsoft
created on 2018-02-10

person 99.2
ground 97.8
outdoor 89.2
people 55.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.5%
Happy 0.4%
Sad 45.6%
Disgusted 1.3%
Surprised 6.2%
Calm 34.5%
Confused 7.9%
Angry 4.1%

AWS Rekognition

Age 26-43
Gender Male, 99.5%
Calm 28.7%
Happy 27.1%
Disgusted 5%
Surprised 8.5%
Angry 6%
Sad 18.7%
Confused 6.1%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Rug 64.7%
Chess 61.2%
Shoe 55.7%

Captions

Microsoft

a group of people sitting posing for the camera 91.2%
a group of people posing for a photo 89.5%
a group of people posing for the camera 89.4%

Text analysis

Amazon

sow
a3G