Human Generated Data

Title

Two boys standing in front of candy store window, street scene, Circleville, Ohi

Date

1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3122

Human Generated Data

Title

Two boys standing in front of candy store window, street scene, Circleville, Ohi

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.9
Person 99.9
Apparel 99.8
Clothing 99.8
Person 99.7
Shop 81.5
Hat 78.6
Shelf 72.2
Helmet 65.1
Hardhat 65.1
Cap 64.5
Food 59.6
Deli 59.6
Bar Counter 56.7
Pub 56.7
Baseball Cap 55.9
Cowboy Hat 55.3

Imagga
created on 2021-12-15

shop 45.2
mercantile establishment 32.5
man 24.8
toyshop 23.8
people 23.4
military uniform 22.5
clothing 22.4
place of business 21.6
uniform 21.1
person 20.3
world 19.2
old 18.1
male 16.4
seller 16.2
portrait 16.2
adult 14.9
hat 14.6
black 13.2
ancient 13
cowboy hat 12.4
city 11.6
consumer goods 11.5
covering 11.5
statue 11.4
smile 11.4
happy 11.3
human 11.2
tobacco shop 11.2
men 11.2
business 10.9
vintage 10.7
establishment 10.7
family 10.7
child 10.4
happiness 10.2
smiling 10.1
shoe shop 10.1
holding 9.9
room 9.7
love 9.5
lifestyle 9.4
face 9.2
historic 9.2
girls 9.1
history 8.9
new 8.9
newspaper 8.9
soldier 8.8
sepia 8.7
women 8.7
antique 8.7
sculpture 8.6
culture 8.5
art 8.5
life 8.4
outdoors 8.2
aged 8.1
athlete 8.1
product 8
businessman 7.9
day 7.8
military 7.7
two 7.6
fashion 7.5
senior 7.5
one 7.5
headdress 7.4
retro 7.4
street 7.4
occupation 7.3
decoration 7.2
dress 7.2
looking 7.2
home 7.2
religion 7.2
interior 7.1
travel 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

text 99.8
clothing 98.8
person 97.5
man 93.1
outdoor 88.1
black 69.8
black and white 54.7
store 53.8
human face 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 98.8%
Calm 88.1%
Happy 4.6%
Confused 3.3%
Surprised 2.3%
Angry 0.9%
Sad 0.4%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 26-40
Gender Male, 99%
Calm 99.5%
Sad 0.4%
Angry 0%
Happy 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Captions

Microsoft

a man standing in front of a store 93.7%
a man standing in front of a store window 90.3%
a group of people standing in front of a store 90.2%

Text analysis

Amazon

STORE
BASEN
8
and
10
VISIT
5
POUND
Salest
5 and 10 STORE
BASEN OT
CHARLE
OT
HS
SPOW
POUNO
McCARTE
POUN
SPOW WFLtc
MALL
POLICE
DIDI
POUC
PEONO
POINT
WFLtc

Google

and
AT
10
WritW
Salest
now
10¢
5 and 10¢ STORE VIST BASEL, AT Salest 10 10 10 10 10 8 10 10 10 10 now WritW 10 10
5
STORE
VIST
BASEL,
8