Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.16
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.16

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-06-11

Person 99.7
Human 99.7
Person 99.6
Apparel 98.2
Clothing 98.2
Person 97.9
Hat 95.4
Hat 92.2
Worker 84.3
Helmet 81.1
Hardhat 80.2
Face 65.4
Military Uniform 61.4
Military 61.4
Carpenter 56.7
Goggles 56.1
Accessory 56.1
Accessories 56.1
Officer 55.9

Clarifai
created on 2023-10-29

people 99.9
adult 99.3
three 98.7
two 98.4
group 98.2
man 97.4
group together 97
portrait 96.6
veil 96.2
wear 93.5
four 92.3
monochrome 92.1
administration 89.5
several 88.2
five 87.1
woman 85
one 84.4
leader 83.6
military 82.6
vehicle 82.5

Imagga
created on 2022-06-11

man 45.7
male 38.3
person 37
specialist 33
people 30.7
work 30.6
job 30.1
professional 29.9
worker 26.8
working 25.6
adult 25.4
men 24.9
engineer 23.7
business 22.5
office 22.2
businessman 22.1
nurse 21
occupation 20.2
doctor 19.7
medical 19.4
patient 18.9
surgeon 18.6
hospital 17.9
coat 17.5
laptop 17.3
senior 16.9
computer 16.9
looking 16.8
health 16.7
industry 16.2
happy 15.7
portrait 15.5
uniform 15.3
smiling 15.2
medicine 15
education 14.7
equipment 14.6
indoors 14.1
mature 13.9
lab coat 13.5
serious 13.3
desk 13.2
manager 13
technology 12.6
architect 12.5
smile 12.1
success 12.1
builder 12
clinic 11.8
helmet 11.7
team 11.6
elderly 11.5
standing 11.3
home 11.2
teamwork 11.1
construction 11.1
successful 11
building 10.9
hat 10.5
collar 10.5
plan 10.4
table 10.4
meeting 10.4
sitting 10.3
women 10.3
hand 9.9
contractor 9.7
together 9.6
project 9.6
case 9.6
casual 9.3
two 9.3
glasses 9.2
face 9.2
safety 9.2
mask 9.1
industrial 9.1
student 9.1
care 9
lifestyle 8.7
illness 8.6
old 8.4
web site 8.3
room 8.3
suit 8.2
businesswoman 8.2
to 8
look 7.9
hardhat 7.8
couple 7.8
surgery 7.8
corporate 7.7
exam 7.7
clothing 7.7
profession 7.7
staff 7.6
site 7.5
20s 7.3
confident 7.3
group 7.3
color 7.2
handsome 7.1
paper 7.1

Google
created on 2022-06-11

Hat 94.6
Photograph 94.2
Shirt 94
Cap 88.4
Sleeve 87.1
Sun hat 83.2
Fedora 82.8
Black-and-white 82.8
Collar 79.2
Font 73.3
Monochrome photography 72
Monochrome 68.4
Vintage clothing 68.2
Picture frame 63.2
Stock photography 62.8
Photo caption 61.7
Crew 61.6
Room 61.5
History 61.3
Cowboy hat 61.1

Microsoft
created on 2022-06-11

text 99.8
person 96.3
man 95.6
outdoor 91.7
clothing 88.5
hat 87.7
old 72.7
black and white 60.7
fashion accessory 58.3
posing 40.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 79.8%
Angry 9.2%
Confused 7.1%
Surprised 6.6%
Fear 6.1%
Sad 2.7%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Male, 100%
Sad 54.2%
Surprised 32.7%
Angry 19%
Calm 10.4%
Fear 9.6%
Disgusted 6.5%
Happy 3.2%
Confused 2.1%

Microsoft Cognitive Services

Age 41
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 95.4%

Categories

Imagga

paintings art 97%

Captions

Microsoft
created on 2022-06-11

an old photo of a man 93.3%
old photo of a man 92.1%
an old photo of a man in a suit and tie 92%

Text analysis

Amazon

TL36/20.6

Google

TL 36 120.6
TL
36
120.6