Human Generated Data

Title

Untitled (five men lined up in hats, man at left in tie, at Uhland Community Fair)

Date

1947

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11246

Human Generated Data

Title

Untitled (five men lined up in hats, man at left in tie, at Uhland Community Fair)

People

Artist: Harry Annas, American 1897 - 1980

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.9
Human 99.9
Person 99.9
Person 99.9
Person 99.9
Person 99.8
Military 99.3
Military Uniform 99.3
Officer 98.9
Tie 96.5
Accessories 96.5
Accessory 96.5
Apparel 89.8
Clothing 89.8
Hat 87.9
Captain 86.8
People 84.1
Shoe 83.9
Footwear 83.9
Soldier 83.3
Person 83.1
Shoe 79.7
Troop 71.4
Army 71.4
Armored 71.4
Shoe 69.3
Sailor Suit 59.3
Helmet 55.4
Shoe 55.3
Shoe 50.2

Imagga
created on 2022-01-23

military uniform 95.8
uniform 89.7
clothing 59.8
consumer goods 38.7
covering 35
people 25.6
helmet 24.9
man 24.8
person 21.2
commodity 19.2
male 19.1
military 18.3
war 16.3
ballplayer 15.6
athlete 13.9
weapon 13.7
army 13.6
adult 13.6
private 13.5
nurse 12.9
player 12.8
soldier 12.7
gun 12.2
hat 12.2
old 11.8
armor plate 10.9
black 10.8
travel 10.5
contestant 10.3
men 10.3
industrial 10
history 9.8
outdoor 9.2
rifle 9.1
danger 9.1
boy 8.7
walking 8.5
sport 8.4
city 8.3
street 8.3
human 8.2
protection 8.2
group 8
to 8
worker 7.9
standing 7.8
conflict 7.8
mask 7.8
portrait 7.8
statue 7.6
horse 7.6
hand 7.6
dark 7.5
vacation 7.4
tourist 7.2
together 7

Microsoft
created on 2022-01-23

person 100
outdoor 98.7
posing 96.5
standing 96.5
text 96.3
man 95.4
clothing 94.8
old 94.1
military uniform 89.7
group 85.8
black 84.6
military 74.5
army 72.5
white 72.3
uniform 60.4
team 44.8
clothes 21.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 95.9%
Sad 1.6%
Angry 1.2%
Disgusted 0.4%
Happy 0.4%
Fear 0.2%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 62.1%
Happy 26.7%
Surprised 3.2%
Fear 2.2%
Angry 1.8%
Disgusted 1.5%
Confused 1.4%
Sad 1.1%

AWS Rekognition

Age 37-45
Gender Male, 98.5%
Calm 43.5%
Happy 42.9%
Angry 5.2%
Surprised 3.2%
Sad 2.2%
Confused 1.5%
Disgusted 0.9%
Fear 0.5%

AWS Rekognition

Age 36-44
Gender Male, 99.1%
Calm 90.6%
Angry 3.8%
Surprised 1.4%
Happy 1.3%
Disgusted 1.3%
Sad 1%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.2%
Calm 94.3%
Sad 3.2%
Confused 1.6%
Angry 0.4%
Surprised 0.3%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Female, 78.1%
Sad 31.3%
Calm 23.6%
Angry 15.5%
Happy 12.5%
Fear 6.8%
Confused 4.8%
Disgusted 3.4%
Surprised 2.2%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Tie 96.5%
Hat 87.9%
Shoe 83.9%
Helmet 55.4%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people in uniform posing for a photo 98.2%
an old photo of a group of people posing for the camera 97.7%

Text analysis

Google

.......
....... ......
......