Human Generated Data

Title

Scene at Clay, West Virginia

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3083

Human Generated Data

Title

Scene at Clay, West Virginia

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3083

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 99
Human 99
Person 99
Hat 98.9
Person 97.1
Person 96.2
Overcoat 89.4
Coat 89.4
Person 72.4
Person 69.7
Suit 68
Hat 67.9
Sun Hat 67.5
Person 43.5

Clarifai
created on 2023-10-15

people 100
lid 99.6
group 99.2
adult 99.2
monochrome 99
man 98.6
fedora 98.3
group together 97.5
portrait 97.2
veil 96.9
three 94.9
administration 93.7
woman 91.6
two 90.8
four 89.7
wear 89.4
several 88.9
leader 88.4
bill 86.8
offense 86.5

Imagga
created on 2021-12-15

man 29.5
male 22.7
billboard 20.5
people 19.5
person 19.1
hat 17.4
sky 16.6
signboard 16.1
structure 15.9
men 15.4
adult 14.9
black 13.8
clothing 13.2
uniform 12.9
landscape 12.6
work 12.5
business 12.1
outdoor 11.5
portrait 11
equipment 10.9
cowboy hat 10.6
building 10.4
clouds 10.1
helmet 9.9
worker 9.6
world 9.6
military uniform 9.4
architecture 9.4
street 9.2
occupation 9.2
silhouette 9.1
industrial 9.1
outdoors 8.9
trees 8.9
job 8.8
cloud 8.6
industry 8.5
covering 8.4
cloudy 8.4
professional 8.4
house 8.4
city 8.3
safety 8.3
alone 8.2
happy 8.1
road 8.1
working 7.9
businessman 7.9
grass 7.9
smile 7.8
office 7.8
travel 7.7
old 7.7
factory 7.5
field 7.5
sign 7.5
headdress 7.5
smoke 7.4
guy 7.3
transportation 7.2

Google
created on 2021-12-15

Hat 91.1
Fedora 89.7
Sleeve 87
Coat 86.7
Style 83.8
Sun hat 83.6
Black-and-white 83.5
Font 82.9
Headgear 81.2
Blazer 74.9
Monochrome photography 73.7
Vintage clothing 71.1
Suit 71.1
Monochrome 70.8
Photo caption 67.2
Room 66.9
Event 66.4
Stock photography 63.5
History 63.3
Cap 61.9

Microsoft
created on 2021-12-15

person 99.9
text 99.9
clothing 98.5
man 92.7
standing 90.7
hat 90.6
outdoor 90.4
fashion accessory 78.2
human face 68.3
group 63.9
fedora 57.4
people 55.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 97.3%
Calm 98.8%
Happy 0.4%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 41-59
Gender Male, 99.9%
Calm 97.1%
Happy 0.7%
Confused 0.6%
Surprised 0.5%
Sad 0.4%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 24-38
Gender Male, 80.2%
Calm 95.4%
Sad 2.4%
Angry 1.6%
Confused 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 14-26
Gender Female, 55.9%
Calm 97.5%
Fear 0.8%
Sad 0.7%
Happy 0.5%
Angry 0.4%
Surprised 0.1%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Hat 98.9%

Text analysis

Amazon

GLAY
US
OFFICE
AILURE
TO
THE
OST
DO
AILURE TO DO Sn
OST AGE
Sn
ST
AGE
ELAYS THE
ENLIST
ELAYS
GLAY ١٧.)
DE
١٧.)
DE MARINES
VIDANTSA
MARINES
IST BE FULLY PREPA

Google

OSTAGE STVE CLAL PREEAN ALOASSSFOLVATT AILURE TO S ELAYS THE US OFFICE ST SNUST GLAY IVV
OSTAGE
STVE
CLAL
PREEAN
ALOASSSFOLVATT
AILURE
TO
ELAYS
THE
GLAY
S
US
OFFICE
ST
SNUST
IVV