Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3466
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Omar, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3466

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Coat 99.9
Sun Hat 99.6
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Male 99.3
Person 99.3
Boy 99.3
Child 99.3
Jacket 94.7
Sitting 94.4
Face 92.9
Head 92.9
Photography 92.9
Portrait 92.9
Footwear 92.2
Shoe 92.2
Formal Wear 91
Suit 91
Hat 89.7
Shoe 74.5
Shoe 72.5
Shoe 68.5
Text 60.5
Body Part 57
Finger 57
Hand 57
Cowboy Hat 56.5
Smoke 56.2
Pants 56.1
Cap 55.3
Accessories 55
Tie 55

Clarifai
created on 2018-05-10

people 99.9
group 99.1
group together 98.9
adult 97.5
several 95.5
man 94.7
four 91.7
administration 91
woman 88.5
child 88.4
many 86.8
three 86.4
five 82.1
vehicle 82
outfit 81.8
leader 81.4
war 79.2
street 78
furniture 77.4
military 77.3

Imagga
created on 2023-10-06

man 36.3
people 30.1
male 29.8
person 26.9
adult 24.1
businessman 22.1
business 20.6
men 18
work 16.5
portrait 14.9
suit 14.8
newspaper 14.7
office 13.7
success 13.7
worker 13.4
product 13
looking 12.8
old 12.5
city 12.5
working 12.4
building 12.1
sitting 12
human 11.2
street 11
job 10.6
professional 10.5
shop 10.5
urban 10.5
creation 10.4
casual 10.2
team 9.8
outdoors 9.7
black 9.6
corporate 9.4
happy 9.4
room 9.2
silhouette 9.1
computer 8.8
world 8.8
couple 8.7
women 8.7
smile 8.5
face 8.5
two 8.5
senior 8.4
manager 8.4
scholar 8.3
uniform 8.3
successful 8.2
executive 8.2
group 8.1
lifestyle 7.9
love 7.9
hat 7.8
modern 7.7
wall 7.7
intellectual 7.6
adults 7.6
mature 7.4
jacket 7.4
holding 7.4
occupation 7.3
smiling 7.2
handsome 7.1
day 7.1
indoors 7

Google
created on 2018-05-10

photograph 95.5
black and white 89.7
human behavior 84.1
snapshot 81.8
monochrome photography 73.7
gentleman 69.8
monochrome 65.4
vintage clothing 64.6
stock photography 50.9

Microsoft
created on 2018-05-10

outdoor 99.7
person 98.6
group 73.6
old 63.9
people 61.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Confused 0.3%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 88.8%
Calm 92.4%
Surprised 6.4%
Fear 6%
Sad 2.6%
Angry 2.3%
Disgusted 1.8%
Happy 1.2%
Confused 0.4%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Boy 99.3%
Child 99.3%
Shoe 92.2%
Hat 89.7%

Categories

Imagga

paintings art 98.8%

Text analysis

Amazon

the
Glorious
RANDOLPH
ERTA
From the Glorious
From
ERS
TT
AIRE
GER

Google

E P RANDOLPH morT * ERTA om the GloriousS
E
P
RANDOLPH
morT
*
ERTA
om
the
GloriousS