Human Generated Data

Title

Untitled

Date

1968

People

Artist: Richard Balzer,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Richard J. Balzer and Patricia S. Bellinger, 2018.94

Human Generated Data

Title

Untitled

People

Artist: Richard Balzer,

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.4
Person 99.4
Person 99
Sailor Suit 98.6
Person 98.3
Clothing 97.9
Apparel 97.9
Person 97.1
Hat 96.2
Hat 96.2
Person 95.2
Person 93.2
Person 92.1
Person 87.1
Person 86.8
Person 84.7
Hat 82.7
Person 80.5
Person 78.7
Shoe 78.4
Footwear 78.4
Crowd 77.4
Military Uniform 77.2
Military 77.2
Officer 77.2
People 74.1
Person 72
Person 71.3
Helmet 66.8
Person 66.7
Person 61
Sun Hat 56.3

Clarifai
created on 2018-08-22

people 99.9
group 99.2
group together 99.1
many 99
leader 98.2
adult 98.1
administration 97.2
several 96.8
wear 94.5
vehicle 93.8
man 93.7
outfit 92.2
military 92.1
war 90.4
woman 88.7
veil 88.1
uniform 87.1
chair 85.9
recreation 78.2
police 77.9

Imagga
created on 2018-08-22

chain mail 37
armor 32.7
body armor 30.2
clothing 25.4
people 25.1
man 22.9
protective covering 22.6
covering 21
hat 20
person 17.7
mask 16.4
old 14.6
uniform 14.1
weapon 13.7
male 13.5
outdoors 13.4
traditional 13.3
black 13.2
adult 13
portrait 11.6
war 11.5
umbrella 11.2
men 11.2
women 11.1
military uniform 11
face 10.6
ancient 10.4
culture 10.3
dress 9.9
religion 9.9
shop 9.8
soldier 9.8
helmet 9.7
military 9.7
religious 9.4
costume 9.3
travel 9.2
protection 9.1
fashion 9
human 9
history 8.9
army 8.8
tradition 8.3
fun 8.2
lady 8.1
art 7.9
world 7.9
couple 7.8
sword 7.8
battle 7.8
carnival 7.8
cold 7.7
stone 7.7
consumer goods 7.6
shield 7.6
hand 7.6
store 7.6
clothes 7.5
style 7.4
girls 7.3
smiling 7.2

Google
created on 2018-08-22

Microsoft
created on 2018-08-22

person 99.9
military uniform 81
old 77.4
player 71.5
white 68
group 63.2
crowd 0.7

Face analysis

Amazon

AWS Rekognition

Age 35-55
Gender Female, 97.5%
Confused 3.1%
Surprised 2.2%
Sad 51.4%
Calm 26.2%
Angry 4.2%
Disgusted 10.4%
Happy 2.5%

AWS Rekognition

Age 26-43
Gender Male, 91.1%
Angry 3.2%
Disgusted 1%
Sad 61.2%
Surprised 1.5%
Calm 29.5%
Happy 0.5%
Confused 3%

AWS Rekognition

Age 35-52
Gender Male, 75.3%
Confused 0.1%
Angry 0.1%
Surprised 0.2%
Calm 99.4%
Disgusted 0%
Happy 0.1%
Sad 0.1%

AWS Rekognition

Age 48-68
Gender Male, 95.6%
Surprised 6.6%
Calm 65.3%
Angry 6.2%
Sad 10.1%
Happy 4.7%
Confused 5.3%
Disgusted 1.8%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Confused 0.7%
Happy 3.3%
Disgusted 0.6%
Calm 87.5%
Surprised 0.9%
Sad 6.4%
Angry 0.6%

AWS Rekognition

Age 26-43
Gender Male, 81.9%
Surprised 5.1%
Disgusted 2.6%
Happy 1.5%
Angry 4.6%
Calm 7.4%
Sad 72.7%
Confused 6.1%

Feature analysis

Amazon

Person 99.4%
Hat 96.2%
Shoe 78.4%
Helmet 66.8%

Captions

Microsoft

a group of people in uniform 97.1%
a vintage photo of a group of people in uniform 96%
an old photo of a group of people in uniform 95.1%