Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.19

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-11

Furniture 99.8
Person 99.4
Human 99.4
Person 97.8
Person 93.9
Person 93.6
Bench 91.8
Sitting 80.6
Clothing 79.8
Apparel 79.8
Railing 70.3
Park Bench 63.2
Shorts 61.6
Person 61.4
Dating 61.1
Face 57.8

Imagga
created on 2022-06-11

man 20.9
people 19.5
old 19.5
adult 19.5
male 19.1
sitting 18.9
indoors 16.7
shop 15.5
person 14.7
home 14.3
casual 13.5
women 13.4
computer 12.9
device 12.3
men 12
looking 12
laptop 11.8
lifestyle 11.5
room 11.4
work 11.3
mercantile establishment 10.9
horizontal 10.9
black 10.3
barbershop 10.1
indoor 10
travel 9.8
interior 9.7
business 9.7
couch 9.6
industry 9.4
machine 9.4
face 9.2
inside 9.2
house 9.2
20s 9.1
city 9.1
alone 9.1
happy 8.8
sea lion 8.5
seat 8.3
health 8.3
office 8.3
sofa 8
worker 7.9
sculpture 7.9
businessman 7.9
urban 7.9
professional 7.8
smile 7.8
architecture 7.8
attractive 7.7
chair 7.6
sit 7.6
fashion 7.5
wood 7.5
senior 7.5
building 7.4
vintage 7.4
holding 7.4
pillory 7.4
place of business 7.3
bench press 7.3
confident 7.3
industrial 7.3
smiling 7.2
clothing 7.2
handsome 7.1
portrait 7.1
job 7.1

Google
created on 2022-06-11

Microsoft
created on 2022-06-11

text 99.9
black and white 94.5
person 93.7
man 90
human face 89.4
clothing 78.8
monochrome 56.5
seat 38.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 89.9%
Surprised 6.4%
Fear 6.2%
Sad 4.6%
Confused 2%
Angry 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 41.2%
Confused 33.4%
Angry 16.5%
Surprised 6.9%
Fear 6.6%
Sad 4.2%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Angry 82.9%
Surprised 6.5%
Fear 6.1%
Calm 5.6%
Confused 5.2%
Sad 4.2%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

calendar 15.5%

Text analysis

Amazon

TL
TL 36120.70
36120.70

Google

TL
TL 36120-72
36120-72