Human Generated Data

Title

Untitled (Minneapolis)

Date

1980s

People

Artist: Gilles Peress, French born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.388

Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Untitled (Minneapolis)

People

Artist: Gilles Peress, French born 1946

Date

1980s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.388

Copyright

© Gilles Peress/Magnum Photos

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 99.3
Person 99.3
Person 97.8
Goggles 96.8
Accessories 96.8
Accessory 96.8
Car 95.6
Vehicle 95.6
Automobile 95.6
Transportation 95.6
Car 95.5
Person 92.1
Person 92.1
Machine 91.4
Wheel 91.4
Head 88
Clothing 87.3
Apparel 87.3
Face 85.6
Person 84.7
Car 80.9
Water 78.2
Car 77.9
Photo 70.2
Photography 70.2
Portrait 70.2
Outdoors 68.8
Glasses 64.4
Female 58.7
Crowd 58.4
Costume 56.8

Clarifai
created on 2018-02-09

people 99.7
group 98
adult 97.8
vehicle 95.8
group together 95.1
man 92.9
wear 92.7
woman 91.6
portrait 90.7
one 90.4
outfit 88.3
many 86.8
street 86.7
two 86.1
music 85.9
administration 82.4
child 82.3
transportation system 81.1
leader 78.1
war 77.4

Imagga
created on 2018-02-09

mask 75.1
covering 53
armor 32.5
shield 32.1
disguise 30.5
helmet 24.3
face 24.1
war 24
military 23.2
person 20.2
attire 20.1
clothing 19.5
man 18.8
portrait 18.8
religion 17.9
soldier 17.6
culture 17.1
weapon 17.1
goggles 15.8
male 15.6
protection 15.5
people 15.1
safety 13.8
protective 13.6
statue 13.4
ancient 13
human 12.7
army 12.7
metal 12.1
old 11.8
warfare 11.8
history 11.6
gas 11.6
sky 11.5
travel 11.3
fun 11.2
church 11.1
danger 10.9
toxic 10.7
black 10.2
head 10.1
sculpture 10.1
wreckage 10
gold 9.9
temple 9.8
battle 9.8
warrior 9.8
disaster 9.8
uniform 9.7
equipment 9.7
diver 9.7
worship 9.7
antique 9.5
art 9.4
part 9.3
air 9.2
historic 9.2
tourism 9.1
square 9
costume 8.9
armed 8.8
sword 8.8
st 8.7
chemical 8.7
render 8.6
faith 8.6
aviator 8.4
monument 8.4
headdress 8.4
breastplate 8.3
architecture 8.2
respirator 8.2
suit 8.1
science 8
camouflage 7.9
day 7.8
radiation 7.8
gun 7.8
diving 7.8
education 7.8
adult 7.8
nuclear 7.8
golden 7.7
meditation 7.7
cross 7.5
historical 7.5
style 7.4
environment 7.4

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 99.9
sky 99.9
person 98.4
people 73.8
mask 72.7
goggles 38.6
posing 36.5
spectacles 32.7
armor 28.4
crowd 0.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Female, 73.4%
Surprised 2.7%
Disgusted 1.2%
Confused 2.8%
Angry 2.2%
Sad 1.9%
Happy 51.6%
Calm 37.6%

AWS Rekognition

Age 57-77
Gender Female, 59.7%
Sad 7.1%
Calm 58%
Angry 5.9%
Surprised 4.2%
Confused 3.5%
Happy 19.3%
Disgusted 2%

AWS Rekognition

Age 26-43
Gender Female, 98%
Surprised 7.7%
Happy 0.5%
Disgusted 1.3%
Angry 4.9%
Confused 1.9%
Calm 79.6%
Sad 4%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Happy 45%
Surprised 45%
Disgusted 45%
Sad 54.9%
Angry 45%
Confused 45%
Calm 45%

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Car 95.6%
Wheel 91.4%
Glasses 64.4%