Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)
Date

May 1934-June 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.19
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-06-11

Furniture 99.8
Person 99.4
Human 99.4
Person 97.8
Person 93.9
Person 93.6
Bench 91.8
Sitting 80.6
Clothing 79.8
Apparel 79.8
Railing 70.3
Park Bench 63.2
Shorts 61.6
Person 61.4
Dating 61.1
Face 57.8

Imagga
created on 2022-06-11

man 20.9
people 19.5
old 19.5
adult 19.5
male 19.1
sitting 18.9
indoors 16.7
shop 15.5
person 14.7
home 14.3
casual 13.5
women 13.4
computer 12.9
device 12.3
men 12
looking 12
laptop 11.8
lifestyle 11.5
room 11.4
work 11.3
mercantile establishment 10.9
horizontal 10.9
black 10.3
barbershop 10.1
indoor 10
travel 9.8
interior 9.7
business 9.7
couch 9.6
industry 9.4
machine 9.4
face 9.2
inside 9.2
house 9.2
20s 9.1
city 9.1
alone 9.1
happy 8.8
sea lion 8.5
seat 8.3
health 8.3
office 8.3
sofa 8
worker 7.9
sculpture 7.9
businessman 7.9
urban 7.9
professional 7.8
smile 7.8
architecture 7.8
attractive 7.7
chair 7.6
sit 7.6
fashion 7.5
wood 7.5
senior 7.5
building 7.4
vintage 7.4
holding 7.4
pillory 7.4
place of business 7.3
bench press 7.3
confident 7.3
industrial 7.3
smiling 7.2
clothing 7.2
handsome 7.1
portrait 7.1
job 7.1

Google
created on 2022-06-11

Black-and-white 83.3
Hat 82.9
Rectangle 79.5
Font 77.9
Snapshot 74.3
Monochrome 74.1
Monochrome photography 72.8
Window 70.1
Vintage clothing 66.3
Wood 65.3
Stock photography 64.9
Motor vehicle 64.5
Room 64.2
History 62
Photo caption 59.6
Art 59
Photographic paper 56.9
Fence 56.2
Crew 55.5

Microsoft
created on 2022-06-11

text 99.9
black and white 94.5
person 93.7
man 90
human face 89.4
clothing 78.8
monochrome 56.5
seat 38.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 89.9%
Surprised 6.4%
Fear 6.2%
Sad 4.6%
Confused 2%
Angry 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 41.2%
Confused 33.4%
Angry 16.5%
Surprised 6.9%
Fear 6.6%
Sad 4.2%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Angry 82.9%
Surprised 6.5%
Fear 6.1%
Calm 5.6%
Confused 5.2%
Sad 4.2%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

calendar 15.5%

Text analysis

Amazon

TL
TL 36120.70
36120.70

Google

TL
TL 36120-72
36120-72