Human Generated Data

Title

Untitled (Plain City, Ohio)
Date

August 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3528
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Plain City, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3528

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Brick 100
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Hat 99
Face 98.8
Head 98.8
Photography 98.8
Portrait 98.8
Hat 98.6
Accessories 88.3
Glasses 88.3
Glasses 87.5
Shirt 77.9
Architecture 56.4
Building 56.4
Wall 56.4
Dress Shirt 55.9
Cowboy Hat 55.2

Clarifai
created on 2018-05-10

people 99.7
lid 99.7
adult 98.6
elderly 98.3
man 98.2
veil 97.8
two 97.4
wear 96.1
leader 94.1
fedora 93.6
three 93.4
group 93
portrait 92.9
group together 87.5
one 86.9
four 86.1
several 84.8
five 76
administration 72.7
actor 71.1

Imagga
created on 2023-10-06

man 54.4
builder 54.3
helmet 47.5
worker 46.5
male 44
engineer 43.8
architect 39.6
construction 37.6
industry 36.7
work 34.5
occupation 33.9
people 32.9
person 32.7
hat 31.8
business 31
engineering 30.5
contractor 30.2
professional 30
job 29.2
suit 29
manager 28.9
site 28.1
foreman 27.2
uniform 26.2
building 26.2
adult 25.4
clothing 25.2
success 24.9
architecture 24.2
handsome 24.1
men 24
hardhat 23.5
happy 23.2
smiling 22.4
designer 22.3
working 22.1
bow tie 21.4
workplace 21
safety 20.2
industrial 20
expert 18.7
smile 18.5
necktie 18.1
businessman 16.8
corporate 16.3
portrait 16.2
development 16.2
team 16.1
attractive 16.1
blueprints 15.8
urban 15.7
successful 15.6
collar 15.3
build 15.1
looking 14.4
military uniform 14.3
one 14.2
plan 14.2
standing 13.9
plans 13.8
employment 13.5
skill 13.5
structure 13.1
garment 13
supervisor 12.8
consultant 12.7
holding 12.4
employee 11.8
confident 11.8
project 11.5
black 11.4
look 11.4
teamwork 11.1
clipboard 10.8
talk 10.5
profession 10.5
hard 10.5
20s 10.1
indoor 10
equipment 10
businesswoman 10
hard hat 9.9
covering 9.8
factory 9.6
architects 8.9
blueprint 8.8
seller 8.8
home 8.8
labor 8.8
diversity 8.6
yellow 8.6
consumer goods 8.6
modern 8.4
group 8.1
paper 7.9
prints 7.9
happiness 7.8
face 7.8
order 7.7
partner 7.7
serious 7.6
ethnic 7.6
office 7.6
meeting 7.5
doctor 7.5
outdoors 7.5
brick 7.2
interior 7.1
indoors 7

Google
created on 2018-05-10

white 96
photograph 95.9
man 92.7
black and white 88.8
photography 82.1
snapshot 81.8
standing 79.5
monochrome photography 78.1
wall 77.4
monochrome 73
fedora 69.7
vintage clothing 57
hat 56.8
portrait 52.3
stock photography 52.1
window 51.8

Microsoft
created on 2018-05-10

person 99.2
man 96.4
headdress 87.5
hat 77.7
brick 71.8
old 49.4
older 35.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 67-77
Gender Male, 95.9%
Calm 37.3%
Angry 30.2%
Disgusted 14.4%
Surprised 10.3%
Confused 10.3%
Fear 6.1%
Sad 2.3%
Happy 0.4%

AWS Rekognition

Age 56-64
Gender Male, 99.7%
Calm 92%
Surprised 6.6%
Fear 6%
Sad 3.6%
Confused 1.5%
Happy 0.9%
Angry 0.6%
Disgusted 0.4%

Microsoft Cognitive Services

Age 82
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Hat 99%
Glasses 88.3%
Shirt 77.9%