Human Generated Data

Title

Untitled (Middleboro, Kentucky)

Date

October 1935, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3333

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Middleboro, Kentucky)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Person 99.4
Person 99.4
Person 99.4
Person 99.2
Person 99.2
Person 99
Person 98.6
Person 98.4
Person 95.4
Person 95.3
Crowd 94
Pedestrian 90.4
People 79.9
Face 78.7
Person 69.7
Parade 69.4
Clothing 68.5
Apparel 68.5
Person 67.5
Person 67.3
Person 63.4
Military 62.8
Standing 61
Military Uniform 57
Marching 56

Imagga
created on 2021-12-15

military uniform 100
uniform 100
clothing 71.5
covering 50.4
consumer goods 50
pedestrian 27.2
commodity 25
man 20.8
city 17.5
horse 17.1
travel 16.9
military 16.4
people 14.5
history 14.3
male 14.2
war 13.5
transportation 13.4
winter 12.8
danger 12.7
soldier 12.7
nuclear 12.6
animal 12.6
old 12.5
urban 12.2
private 12.2
snow 11.8
destruction 11.7
outdoor 11.5
walking 11.4
person 11.3
weapon 11.3
protection 10.9
industrial 10.9
gun 10.6
building 10.3
rifle 10.2
street 10.1
tourism 9.9
battle 9.8
army 9.8
horses 9.7
sky 9.6
statue 9.5
sport 9.5
power 9.2
sign 9
vacation 9
outdoors 9
toxic 8.8
protective 8.8
historical 8.5
speed 8.2
transport 8.2
tourist 8.2
dirty 8.1
radioactive 7.9
radiation 7.8
conflict 7.8
architecture 7.8
black 7.8
accident 7.8
adult 7.8
cold 7.7
chemical 7.7
gas 7.7
mask 7.7
warning 7.7
smoke 7.4
landscape 7.4
symbol 7.4
season 7

Google
created on 2021-12-15

Building 86.9
Style 84
Black-and-white 83.6
Motor vehicle 80.8
Crowd 78.1
Sky 77.8
Monochrome 77.4
Suit 76.5
Monochrome photography 76
City 75.1
Event 72.6
Vintage clothing 71
Pole 70.6
Street 69.6
Pedestrian 66.9
History 66.3
Stock photography 63.7
Art 63.6
Town 62.7
Crew 62.2

Microsoft
created on 2021-12-15

text 99.7
outdoor 99.2
person 98.5
clothing 95
man 92.6
group 89.1
people 80.5
black and white 77.9
street 68
old 53.2
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 61.5%
Calm 89.6%
Angry 3.3%
Sad 3.1%
Surprised 1.8%
Confused 1.1%
Happy 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 26-40
Gender Male, 99.9%
Calm 71.8%
Angry 15.4%
Happy 10.3%
Sad 0.7%
Surprised 0.5%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%

AWS Rekognition

Age 24-38
Gender Male, 93.2%
Calm 85.9%
Angry 4.3%
Confused 3.6%
Sad 2.4%
Disgusted 1.4%
Happy 1.3%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 36-54
Gender Male, 84.5%
Calm 96.5%
Sad 1.7%
Confused 0.7%
Surprised 0.6%
Happy 0.3%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 24-38
Gender Male, 92.8%
Angry 59.5%
Confused 32.9%
Calm 2.7%
Disgusted 2.4%
Surprised 1.3%
Sad 0.5%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 21-33
Gender Female, 96.4%
Calm 89.3%
Disgusted 3.9%
Sad 3.2%
Angry 1.2%
Happy 1.1%
Confused 0.5%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 38-56
Gender Male, 98%
Calm 85.7%
Sad 7.5%
Happy 4.7%
Confused 0.9%
Angry 0.4%
Surprised 0.4%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 19-31
Gender Female, 83.5%
Happy 69.8%
Calm 26.4%
Sad 1.6%
Angry 0.9%
Confused 0.6%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 44-62
Gender Female, 95.4%
Happy 50%
Calm 28.8%
Confused 8.8%
Sad 6.7%
Surprised 2.4%
Fear 1.2%
Disgusted 1.1%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people standing in front of a building 95.6%
a group of people standing in front of a crowd 94.4%
a group of people standing in front of a crowd posing for the camera 92.3%

Text analysis

Amazon

WHISKE
DRUGS
YORK
ALI
NEW
H
WATSON'S
I

Google

WHISKE DRUGS
WHISKE
DRUGS