Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1244
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New Deal Inn, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1244

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Hat 99.9
Face 99.8
Head 99.8
Photography 99.8
Portrait 99.8
Person 99.3
Boy 99.3
Child 99.3
Male 99.3
Person 98.7
Adult 98.7
Female 98.7
Woman 98.7
Person 98.5
Male 98.5
Adult 98.5
Man 98.5
People 90.5
Lady 77
Formal Wear 72.8
Suit 72.8
Bench 66.7
Furniture 66.7
Coat 66.2
Jacket 57.6
Bonnet 57.1
Cap 57
Sun Hat 56.9
Dress 56.5
Architecture 56.5
Building 56.5
Hospital 56.5
Overcoat 56
Happy 55.9
Smile 55.9
Archaeology 55.8
House 55.4
Housing 55.4
Staircase 55.4
Pants 55.2

Clarifai
created on 2018-05-11

people 100
group 99.4
two 98.7
three 98.4
group together 98.4
adult 98.2
four 98
child 97.9
several 96.7
woman 96.1
five 95.9
offspring 95.2
administration 94.9
man 93.9
wear 91.7
sibling 90.4
facial expression 90
many 89.9
sit 89.6
furniture 86.9

Imagga
created on 2023-10-06

man 35.6
person 32.9
male 31.9
people 29.6
grandfather 22.9
happy 20
adult 19.3
home 19.1
smiling 18.8
senior 17.8
barbershop 17.3
men 17.2
scholar 16.1
coat 16.1
clothing 15.6
portrait 15.5
lab coat 15.2
smile 15
indoors 14.9
professional 14.5
couple 13.9
sitting 13.7
shop 13.7
work 13.3
mature 13
intellectual 12.8
business 12.7
old 12.5
happiness 12.5
family 12.5
working 12.4
occupation 11.9
lifestyle 11.6
medical 11.5
mother 11.2
worker 11
mercantile establishment 10.8
40s 10.7
businessman 10.6
together 10.5
looking 10.4
two 10.2
office 9.8
nurse 9.7
retired 9.7
mid adult 9.6
retirement 9.6
elderly 9.6
table 9.5
talking 9.5
love 9.5
doctor 9.4
farmer 9.3
face 9.2
room 9.1
uniform 9.1
health 9
job 8.8
30s 8.7
relaxed 8.4
black 8.4
father 8.1
hospital 8.1
hat 8.1
building 8
patient 7.8
colleagues 7.8
chair 7.6
daughter 7.6
park 7.4
inside 7.4
cook 7.3
cheerful 7.3
relaxing 7.3
color 7.2
place of business 7.2
computer 7.2
team 7.2
kitchen 7.2
bench 7.1

Google
created on 2018-05-11

photograph 96.3
black and white 91.6
standing 86.6
monochrome photography 83.9
snapshot 81.8
vintage clothing 76.7
family 70.8
history 63.4
monochrome 62.8
human behavior 54.6
stock photography 51.3

Microsoft
created on 2018-05-11

person 98.9
outdoor 94.9
black 80.9
old 74.9
posing 38.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 83.7%
Sad 100%
Surprised 6.4%
Fear 6%
Angry 2.9%
Confused 1.4%
Disgusted 0.9%
Calm 0.8%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Female, 100%
Calm 64.9%
Sad 47%
Surprised 7.8%
Fear 6.1%
Happy 2.5%
Angry 1.6%
Confused 1.3%
Disgusted 0.5%

AWS Rekognition

Age 6-16
Gender Male, 98.8%
Happy 95.3%
Surprised 6.3%
Fear 5.9%
Calm 4.3%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 0-3
Gender Female, 77.4%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Happy 0%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Boy 99.3%
Child 99.3%
Male 99.3%
Adult 98.7%
Female 98.7%
Woman 98.7%
Man 98.5%
Coat 66.2%

Categories

Imagga

people portraits 82.9%
paintings art 16.5%

Text analysis

Amazon

CH
TOBA
PO
CHICO'S
MA
ANDE
ml
BY
When
34 When
34
h

Google

CHICO'S
CHICO'S