Human Generated Data

Title

Untitled (Marion, Ohio)
Date

July 1938-August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3320
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Marion, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3320

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Coat 100
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Brick 98.5
Accessories 88.5
Glasses 88.5
Car 88.3
Transportation 88.3
Vehicle 88.3
Hat 85.3
Outdoors 85.1
Face 81.5
Head 81.5
City 78.1
Jacket 75.8
Overcoat 69.4
Nature 68.8
Snow 64.5
Photography 64.5
Portrait 64.5
Winter 57.1
Urban 57
Sun Hat 56.7
Smoke 56.6
Cap 56.4
Formal Wear 56.4
Suit 56.4
Bus Stop 55.1

Clarifai
created on 2018-05-10

people 99.7
adult 97.2
street 96.6
man 95.4
one 95.3
monochrome 95.1
portrait 94.2
military 89.5
administration 88.3
vehicle 87.4
business 87
wear 86.9
newspaper 86.1
outfit 86.1
group 85.7
telephone 85.6
subway system 85.4
two 85.4
room 84.8
three 84.3

Imagga
created on 2023-10-05

case 49.3
shop 38.4
man 26.2
locker 25.4
mercantile establishment 24.6
business 21.8
office 21.7
people 21.7
male 20.6
fastener 20.3
person 19
bookshop 18.2
place of business 16.4
restraint 15.3
building 15
device 14.6
computer 14.5
men 13.7
industry 13.7
old 13.2
adult 13
tobacco shop 12.8
technology 12.6
job 12.4
casual 11.9
work 11.8
equipment 11.7
businessman 11.5
industrial 10.9
city 10.8
door 10.8
warehouse 10.8
worker 10.7
box 10.7
working 10.6
indoors 10.5
wall 10.3
center 9.6
education 9.5
room 9.5
architecture 9.4
horizontal 9.2
safety 9.2
vintage 9.1
portrait 9.1
black 9
looking 8.8
urban 8.7
professional 8.7
modern 8.4
security 8.3
occupation 8.2
call 8.2
establishment 8.2
protection 8.2
handsome 8
information 8
interior 8
steel 8
lifestyle 7.9
women 7.9
machine 7.9
factory 7.7
construction 7.7
monitor 7.6
storage 7.6
finance 7.6
sign 7.5
stock 7.5
outdoors 7.5
one 7.5
suit 7.4
indoor 7.3
metal 7.2
structure 7.2
home 7.2

Google
created on 2018-05-10

photograph 95.3
standing 90.2
black and white 89.1
infrastructure 88.3
snapshot 81.8
photography 80.4
monochrome photography 76.1
monochrome 69.6
street 68.5
vintage clothing 59.1
window 57.3
angle 55.5
stock photography 52
gentleman 50.3

Microsoft
created on 2018-05-10

building 99.3
outdoor 95
person 87.6
standing 82.5
black 77.6
store 65
white 62.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Sad 99.7%
Calm 15.4%
Confused 14.7%
Surprised 6.6%
Fear 6%
Angry 1%
Happy 0.7%
Disgusted 0.3%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Glasses 88.5%
Car 88.3%
Hat 85.3%

Categories

Imagga

interior objects 98.8%

Text analysis

Amazon

"Warm
CREDIT
RATING
OUR
MARION
COAL
OUR COAL MAKES
the
110
MAKES
PAINT
70
COAL PAINT
Way
30
20
120
Friends
50
60
100
Our
10
INC.
40
go
80
or
Our Way is the
WEIGH"
HONEST
11 ml or
is
11
ml
:
it

Google

INC. s 120 110 100 80 60 70 50 30 10 MARION CREDIT RATING ec 20 30 OUR COAL MAKES Warm Friends Our Way is the HONEST WEIGH
INC.
s
120
110
100
80
60
70
50
30
10
MARION
CREDIT
RATING
ec
20
OUR
COAL
MAKES
Warm
Friends
Our
Way
is
the
HONEST
WEIGH