Human Generated Data

Title

Street scene, Washington Court House, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3022

Human Generated Data

Title

Street scene, Washington Court House, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.4
Person 99.4
Person 98.8
Person 98.7
Person 98.5
Transportation 92.4
Car 92.4
Automobile 92.4
Vehicle 92.4
Machine 90.3
Wheel 90.3
Person 89.8
Apparel 89.4
Clothing 89.4
Wheel 86.4
Car 86.2
Car 84.1
Military 81.3
Car 78.5
Military Uniform 77.9
Officer 77.9
Wheel 77.3
Person 69.8
Fireman 68
People 65
Wheel 64.8
Police 55.6
Wheel 51.8

Imagga
created on 2021-12-15

military uniform 100
uniform 100
clothing 86.6
consumer goods 60.4
covering 59.1
man 31.6
commodity 29.9
people 20.6
male 19.8
city 17.5
person 16.9
street 15.6
military 14.5
hat 14.4
soldier 13.7
adult 13.6
protection 12.7
history 12.5
outdoor 12.2
helmet 12.1
travel 12
safety 12
private 11.5
gun 11.3
vacation 10.6
old 10.4
tourism 9.9
army 9.7
job 9.7
war 9.7
urban 9.6
tourist 9.2
industrial 9.1
black 9
to 8.8
rifle 8.6
architecture 8.6
walk 8.6
statue 8.6
smoke 8.4
weapon 8.2
danger 8.2
worker 8
lifestyle 7.9
work 7.8
battle 7.8
boy 7.8
protective 7.8
portrait 7.8
horse 7.6
walking 7.6
outdoors 7.5
historic 7.3
occupation 7.3
sport 7.2
building 7.1
day 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.7
person 99.7
outdoor 99.3
clothing 96.3
vehicle 93
man 91.1
car 87.6
land vehicle 85.1
posing 56.6

Face analysis

Amazon

Google

AWS Rekognition

Age 31-47
Gender Male, 93.4%
Calm 98.5%
Sad 1.4%
Angry 0%
Surprised 0%
Happy 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-43
Gender Male, 88.2%
Sad 90%
Calm 3%
Surprised 2.2%
Fear 1.6%
Confused 1.6%
Angry 0.7%
Disgusted 0.6%
Happy 0.3%

AWS Rekognition

Age 23-35
Gender Male, 92.4%
Calm 91.2%
Sad 4.6%
Disgusted 2.3%
Angry 0.5%
Fear 0.5%
Happy 0.4%
Surprised 0.3%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Car 92.4%
Wheel 90.3%

Captions

Microsoft

a group of people posing for a photo 88.8%
a group of people posing for the camera 88.7%
a group of people posing for a picture 88.6%

Text analysis

Amazon

SH
DI
U
STORE
Coca-Cola
E.E.R
E.E.R 10%
10%
KIM
"NNI

Google

UMEILY
Coca-Cola
UMEILY EL.I SH Coca-Cola DI
SH
DI
EL.I