Human Generated Data

Title

Two boys standing in front of candy store window, street scene, Circleville, Ohi
Date

1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3122

Human Generated Data

Title

Two boys standing in front of candy store window, street scene, Circleville, Ohi

People

Artist: Ben Shahn, American 1898 - 1969

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3122

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.9
Human 99.9
Clothing 99.8
Apparel 99.8
Person 99.7
Shop 81.5
Hat 78.6
Shelf 72.2
Hardhat 65.1
Helmet 65.1
Cap 64.5
Food 59.6
Deli 59.6
Pub 56.7
Bar Counter 56.7
Baseball Cap 55.9
Cowboy Hat 55.3

Clarifai
created on 2023-10-15

people 100
adult 99.1
two 99.1
group together 98.8
group 98.6
man 97.3
monochrome 97.1
three 96.7
merchant 94.8
wear 93.3
portrait 93.3
many 92.3
street 91.5
war 91.4
woman 91.2
uniform 90.5
commerce 90.4
one 90.2
veil 89
vehicle 87.7

Imagga
created on 2021-12-15

shop 45.2
mercantile establishment 32.5
man 24.8
toyshop 23.8
people 23.4
military uniform 22.5
clothing 22.4
place of business 21.6
uniform 21.1
person 20.3
world 19.2
old 18.1
male 16.4
seller 16.2
portrait 16.2
adult 14.9
hat 14.6
black 13.2
ancient 13
cowboy hat 12.4
city 11.6
consumer goods 11.5
covering 11.5
statue 11.4
smile 11.4
happy 11.3
human 11.2
tobacco shop 11.2
men 11.2
business 10.9
vintage 10.7
establishment 10.7
family 10.7
child 10.4
happiness 10.2
smiling 10.1
shoe shop 10.1
holding 9.9
room 9.7
love 9.5
lifestyle 9.4
face 9.2
historic 9.2
girls 9.1
history 8.9
new 8.9
newspaper 8.9
soldier 8.8
sepia 8.7
women 8.7
antique 8.7
sculpture 8.6
culture 8.5
art 8.5
life 8.4
outdoors 8.2
aged 8.1
athlete 8.1
product 8
businessman 7.9
day 7.8
military 7.7
two 7.6
fashion 7.5
senior 7.5
one 7.5
headdress 7.4
retro 7.4
street 7.4
occupation 7.3
decoration 7.2
dress 7.2
looking 7.2
home 7.2
religion 7.2
interior 7.1
travel 7

Google
created on 2021-12-15

Hat 82.1
Window 78.2
Picture frame 74.8
Vintage clothing 72.5
Monochrome photography 71.7
Monochrome 68.9
Room 65.6
History 62.3
Stock photography 62.1
Door 61.6
Plant 60.8
Sitting 59.2
Photographic paper 57.9
Art 57.3
Collection 55.4
Paper product 54.6

Microsoft
created on 2021-12-15

text 99.8
clothing 98.8
person 97.5
man 93.1
outdoor 88.1
black 69.8
black and white 54.7
store 53.8
human face 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 98.8%
Calm 88.1%
Happy 4.6%
Confused 3.3%
Surprised 2.3%
Angry 0.9%
Sad 0.4%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 26-40
Gender Male, 99%
Calm 99.5%
Sad 0.4%
Angry 0%
Happy 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%

Categories

Imagga

people portraits 91.3%
paintings art 7.2%

Text analysis

Amazon

STORE
BASEN
8
and
10
VISIT
5
POUND
Salest
5 and 10 STORE
BASEN OT
CHARLE
OT
HS
SPOW
POUNO
McCARTE
POUN
SPOW WFLtc
MALL
POLICE
DIDI
POUC
PEONO
POINT
WFLtc

Google

5 and 10¢ STORE VIST BASEL, AT Salest 10 10 10 10 10 8 10 10 10 10 now WritW 10 10
STORE
BASEL,
AT
10
now
WritW
5
and
10¢
VIST
Salest
8