Human Generated Data

Title

Untitled (Plain City, Ohio)
Date

August 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2656
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Plain City, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2656

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Clothing 100
Sun Hat 100
Brick 100
Face 100
Head 100
Photography 100
Portrait 100
Person 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Hat 98.8
Hat 98.5
Shirt 97.5
Accessories 90.1
Glasses 90.1
Glasses 84.6
Formal Wear 81.6
Tie 81.6
Architecture 72.8
Building 72.8
Wall 72.8
Dress Shirt 55.9
Cap 55.4
Cowboy Hat 55.2

Clarifai
created on 2018-05-10

people 99.8
elderly 99.1
lid 99
adult 98.3
man 98.1
veil 96.7
wear 96.4
two 96.2
portrait 95.3
leader 95.3
three 94.4
one 91.5
group 89.9
administration 86.2
group together 85.4
fedora 82.6
four 81.5
actor 80.6
five 75.2
offense 72.9

Imagga
created on 2023-10-05

man 49.7
hat 44.8
male 42
helmet 33.1
person 32.4
clothing 32.3
engineer 31.8
people 31.2
worker 29.9
architect 29.9
professional 29.1
builder 28.7
construction 26.5
business 26.1
work 25.9
occupation 25.7
adult 24.1
handsome 24.1
uniform 23.9
suit 23.2
industry 23
job 22.1
smiling 21.7
foreman 21.5
engineering 20.9
smile 20.7
site 20.6
contractor 19.5
portrait 18.8
manager 18.6
building 18.2
headdress 17.9
men 17.2
success 16.9
architecture 16.4
looking 16
happy 15.7
designer 15.5
bow tie 15
working 15
workplace 14.3
businessman 14.1
cowboy hat 14.1
attractive 14
standing 13.9
necktie 13.9
safety 13.8
hardhat 13.7
structure 13.2
cap 13
blueprints 12.8
military uniform 12.5
team 12.5
holding 12.4
covering 12.2
face 12.1
consumer goods 12
one 11.9
20s 11.9
mortarboard 11.9
expert 11.8
hard 11.4
employee 11.1
successful 11
confident 10.9
plans 10.8
employment 10.6
skill 10.6
collar 10.5
profession 10.5
corporate 10.3
black 10.2
industrial 10
hard hat 9.9
seller 9.7
serious 9.5
build 9.5
plan 9.5
office 9.2
garment 8.9
urban 8.7
project 8.7
confidence 8.6
wearing 8.6
development 8.6
guy 8.5
shirt 8.4
hand 8.4
teamwork 8.3
inspector 7.9
consultant 7.8
labor 7.8
diversity 7.7
casual 7.6
studio 7.6
career 7.6
map 7.6
smart 7.5
meeting 7.5
businesswoman 7.3
happiness 7.1
look 7

Google
created on 2018-05-10

photograph 96.1
white 96.1
man 95.8
black 94.9
black and white 89.2
standing 83.8
male 82.9
photography 82.5
snapshot 81.8
monochrome photography 79.7
fedora 73.5
monochrome 73.5
gentleman 71.2
headgear 70
vintage clothing 61.3
hat 60.6
material 58.5
stock photography 53
senior citizen 52.8

Microsoft
created on 2018-05-10

person 98.8
man 96.8
outdoor 89.6
headdress 86.8
hat 74.9
old 55.5
older 34.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 65-75
Gender Male, 99.9%
Angry 44.6%
Calm 18.7%
Disgusted 16.1%
Confused 11.6%
Surprised 9.5%
Fear 6.3%
Sad 2.8%
Happy 0.5%

AWS Rekognition

Age 57-65
Gender Male, 99.7%
Calm 84.5%
Surprised 7%
Happy 6.8%
Fear 6.4%
Sad 2.9%
Angry 1.6%
Confused 1.2%
Disgusted 0.9%

Microsoft Cognitive Services

Age 81
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Adult 99.7%
Male 99.7%
Man 99.7%
Hat 98.8%
Shirt 97.5%
Glasses 90.1%
Tie 81.6%

Categories

Imagga

paintings art 83.4%
interior objects 13.4%
people portraits 1.8%

Captions

Microsoft
created on 2018-05-10

a man wearing a hat 97.6%
a man wearing a black hat 96.2%
a man wearing a white hat 95.9%