Human Generated Data

Title

Street scene, Washington Court House, Ohio

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3014

Human Generated Data

Title

Street scene, Washington Court House, Ohio

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Human 99.8
Person 99.8
Hat 99.8
Person 99.8
Person 99.7
Person 99.6
Sun Hat 97.9
Hat 92.1
Cowboy Hat 88.6
Hat 78.8
Vehicle 74
Transportation 74
Car 74
Automobile 74
Car 61.8

Imagga
created on 2021-12-15

cowboy hat 100
headdress 100
hat 100
clothing 66.2
man 45
male 39.7
consumer goods 35.3
covering 34.9
person 29.1
people 28.4
senior 28.1
portrait 26.5
adult 25.9
men 21.5
old 20.9
face 19.9
outdoors 18.7
smile 17.8
happy 17.5
hand 17.5
guy 17.5
cowboy 16.9
two 16.1
looking 16
smiling 15.9
mature 15.8
couple 15.7
elderly 15.3
shirt 14.9
lifestyle 13
hair 12.7
western 12.6
handsome 12.5
love 11.8
head 11.8
older 11.6
look 11.4
style 11.1
work 11
model 10.9
retirement 10.6
together 10.5
husband 10.5
attractive 10.5
standing 10.4
summer 10.3
outside 10.3
romance 9.8
beard 9.8
worker 9.7
job 9.7
one 9.7
retired 9.7
married 9.6
serious 9.5
wife 9.5
expression 9.4
beach 9.3
pretty 9.1
fashion 9
gray 9
happiness 8.6
age 8.6
wearing 8.6
close 8.6
horse 8.5
casual 8.5
professional 8.4
black 8.4
hold 8.3
safety 8.3
vintage 8.3
human 8.2
pose 8.2
lady 8.1
eye 8
posing 8
helmet 7.7
sky 7.6
walk 7.6
pair 7.6
enjoy 7.5
dark 7.5
relationship 7.5
glasses 7.4
retro 7.4
vacation 7.4
occupation 7.3
friendly 7.3
romantic 7.1
family 7.1

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

hat 99.8
person 99.7
clothing 98.2
fashion accessory 97.5
outdoor 95.6
fedora 94.6
text 94.6
man 94
human face 93.9
cowboy hat 93.6
sun hat 93.2
headdress 81.5
people 79.2
old 51.2
helmet 20.1
crowd 1.5

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Female, 94%
Calm 89.8%
Surprised 3.1%
Angry 2.8%
Sad 2%
Happy 1.5%
Confused 0.5%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 36-54
Gender Male, 57.1%
Calm 99.6%
Happy 0.2%
Surprised 0.1%
Angry 0%
Sad 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 40-58
Gender Female, 65.8%
Calm 83.6%
Happy 7.6%
Surprised 4.3%
Fear 1.9%
Sad 1.4%
Angry 0.6%
Confused 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Hat 99.8%
Car 74%

Captions

Microsoft

a group of people in uniform 96.6%
a group of people in uniform standing in front of a crowd 95.2%
a group of people looking at a man who is wearing a hat 91.6%

Text analysis

Amazon

GOV.
The
Baker
GOV. DA
Chandler
Building
DA
Chandler It
It
P Baker Nert
D
By Gover
- By Gover
-
Nert
P

Google

The
DA
Chandler
By
The GOV. DA Chandler Bding By Gove
GOV.
Bding
Gove