Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1273

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1273

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Formal Wear 99.7
Suit 99.7
Adult 99.7
Male 99.7
Man 99.7
Person 99.7
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Male 99
Person 99
Boy 99
Child 99
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Person 98.4
Coat 97.8
Architecture 97.1
Building 97.1
Hospital 97.1
Jeans 94
Pants 94
Adult 88.8
Male 88.8
Man 88.8
Person 88.8
Jacket 85.9
Face 85.9
Head 85.9
Shirt 83
Footwear 79.9
Shoe 79.9
House 74.3
Housing 74.3
Porch 74.3
People 73.9
Hat 73.3
Shoe 72.9
Photography 67.3
Portrait 57.7
Furniture 57.4
Clinic 56.1
Staircase 56
Overcoat 55.7
Bench 55.5
Indoors 55.4
Accessories 55.2
Tie 55.2
Animal 55.1
Mammal 55.1
Outdoors 55.1
Shelter 55.1
Operating Theatre 55

Clarifai
created on 2018-05-11

people 100
group 99.7
group together 99.7
several 98.8
many 98.8
administration 98.4
adult 98.2
leader 97.2
five 97
four 95.2
man 94.4
wear 93.8
three 93.3
outfit 93
woman 92.2
war 89.2
military 88.5
recreation 86.3
uniform 86
vehicle 85.9

Imagga
created on 2023-10-07

people 22.9
man 22.2
person 18.5
city 17.5
shop 16.2
building 15.8
business 15.2
urban 14.9
male 12.9
silhouette 12.4
barbershop 12.4
mercantile establishment 11.6
old 11.1
window 11.1
world 11
men 10.3
industry 10.2
black 10
life 9.8
architecture 9.4
spectator 9.4
adult 9.4
dark 9.2
travel 9.2
industrial 9.1
night 8.9
worker 8.9
happy 8.8
light 8.5
newspaper 8.3
new 8.1
boy 7.8
portrait 7.8
place of business 7.7
two 7.6
walking 7.6
sign 7.5
house 7.5
tourism 7.4
vacation 7.4
smiling 7.2
dirty 7.2
home 7.2
family 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.8
outdoor 93.1
standing 80.3
posing 71.4
old 41.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Calm 69.9%
Confused 15.6%
Surprised 7.1%
Fear 6.4%
Angry 4.2%
Disgusted 3.3%
Sad 3.1%
Happy 1.3%

AWS Rekognition

Age 49-57
Gender Male, 99.7%
Sad 43.7%
Calm 30.7%
Confused 27.7%
Surprised 7.3%
Fear 6.6%
Angry 5%
Happy 4.9%
Disgusted 2.8%

AWS Rekognition

Age 6-14
Gender Female, 61%
Sad 100%
Calm 9.4%
Surprised 6.3%
Fear 6%
Confused 0.4%
Angry 0.3%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Male, 65%
Sad 94.8%
Angry 33.3%
Calm 14.1%
Fear 6.9%
Surprised 6.5%
Confused 1.5%
Disgusted 0.7%
Happy 0.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Fear 37.6%
Surprised 27.4%
Sad 18.2%
Angry 13.3%
Confused 7%
Calm 6%
Happy 1.9%
Disgusted 1.7%

AWS Rekognition

Age 4-12
Gender Female, 97.9%
Sad 99.9%
Calm 22.3%
Surprised 6.7%
Fear 6.2%
Angry 0.8%
Confused 0.8%
Disgusted 0.7%
Happy 0.7%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.7%
Male 99.7%
Man 99.7%
Person 99.7%
Boy 99%
Child 99%
Coat 97.8%
Jeans 94%
Shirt 83%
Shoe 79.9%

Text analysis

Amazon

WHISTLE
TOBACCO
RE
ola
COLD
BEST
Preservatives
POUCH
thirsty?
Genuine
BE COLD
jost
BE
US Preservatives
MATI
Designst
US

Google

irsty Genuine TOBACCO
irsty
Genuine
TOBACCO