Human Generated Data

Title

Untitled (three soldiers in uniform standing on front step)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3400

Human Generated Data

Title

Untitled (three soldiers in uniform standing on front step)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.9
Human 99.9
Person 99.8
Person 99.7
Military 98
Military Uniform 98
Officer 95.4
Police 65.3
Soldier 64.6
Guard 62.3
People 61.5
Clothing 61.1
Apparel 61.1

Imagga
created on 2022-01-22

sculpture 39.2
statue 39
art 25.5
religion 21.5
ancient 20.7
culture 20.5
history 19.7
column 19.6
old 18.8
travel 18.3
architecture 16.6
historical 16
religious 15
monument 14.9
tourism 14.8
stone 14.3
traditional 14.1
clothing 13.8
dress 13.5
face 12.8
temple 12.7
portrait 12.3
maillot 12.2
famous 12.1
marble 12.1
decoration 11.8
antique 11.6
historic 11
swimsuit 10.9
city 10.8
people 10.6
god 10.5
garment 10.4
figure 10.1
person 10
tourist 10
landmark 9.9
vintage 9.9
world 9.9
bride 9.6
church 9.2
elegance 9.2
fountain 9.1
carving 9
lady 8.9
detail 8.8
look 8.8
symbol 8.7
man 8.7
women 8.7
spirituality 8.6
golden 8.6
model 8.5
structure 8.4
attractive 8.4
fashion 8.3
film 8.1
sexy 8
celebration 8
love 7.9
black 7.9
party 7.7
heritage 7.7
negative 7.7
covering 7.7
holy 7.7
pretty 7.7
spiritual 7.7
festival 7.6
faith 7.6
head 7.6
building 7.5
adult 7.3
male 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

clothing 98.9
text 97.5
posing 93.3
man 93
window 90.5
person 88.1
standing 87.6
smile 87.3
human face 77.5
white 63.2
group 57.1
old 56.3
image 31.7

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 72.2%
Happy 24.2%
Surprised 1.6%
Fear 0.7%
Disgusted 0.4%
Angry 0.3%
Sad 0.3%
Confused 0.3%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 88.1%
Happy 8%
Sad 1%
Surprised 0.9%
Confused 0.8%
Fear 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 46%
Calm 16.8%
Fear 14.1%
Surprised 7.2%
Sad 6.1%
Disgusted 3.9%
Confused 3.4%
Angry 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a group of people posing for a photo 95.2%
a group of people posing for a picture 95.1%
a group of people posing for the camera 95%

Text analysis

Amazon

4