Human Generated Data

Title

Untitled (Fourteenth Street, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3142

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourteenth Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3142

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-06-18

Person 99.1
Human 99.1
Person 99
Person 98.2
Apparel 98.1
Hat 98.1
Clothing 98.1
Suit 97.9
Overcoat 97.9
Coat 97.9
Tie 96
Accessories 96
Accessory 96
Pub 87.9
Bar Counter 86.5
Person 73.8
Face 70.3
Crowd 68.8
Finger 68
Sleeve 65.4
People 63.5
Drink 63.1
Beverage 63.1
Alcohol 62.1
Glass 55.8

Clarifai
created on 2023-10-29

people 99.9
adult 99.1
portrait 98.5
two 98.2
man 98
group 96.8
one 96.2
woman 95.1
music 94.8
administration 93.4
wear 93.4
street 93.3
several 92.7
actor 91.1
monochrome 90.9
movie 89.6
three 89.1
group together 88.9
actress 88.2
leader 87.2

Imagga
created on 2022-06-18

man 56.5
male 51.1
businessman 45
suit 43.1
person 41.9
portrait 35.6
executive 35.2
handsome 34.8
business 32.8
men 32.7
corporate 30.9
people 30.7
adult 29.2
professional 27.9
tie 26.6
senior 26.3
looking 23.2
happy 23.2
office 22.5
mature 22.3
old 20.9
baron 20.8
confident 20
standing 20
manager 19.6
smiling 19.5
smile 19.3
face 19.2
work 18.1
success 17.7
black 17.5
worker 16
successful 15.6
elderly 15.3
boss 15.3
smart 15.1
expression 14.5
guy 13.9
formal 13.4
look 13.1
cheerful 13
modern 12.6
shirt 12.1
hair 11.9
head 11.8
job 11.5
attractive 11.2
occupation 11
happiness 11
communication 10.9
lifestyle 10.8
necktie 10.8
team 10.8
grandfather 10.7
hand 10.6
couple 10.5
one 10.5
businesspeople 10.4
meeting 10.4
beard 10.3
friendly 10.1
secretary 9.9
businessmen 9.8
human 9.8
jacket 9.7
colleagues 9.7
older 9.7
group 9.7
thinking 9.5
love 9.5
elegant 9.4
glasses 9.3
businesswoman 9.1
planner 8.9
60s 8.8
boy 8.7
30s 8.7
retirement 8.6
confidence 8.6
mobile 8.5
entrepreneur 8.4
teamwork 8.3
holding 8.3
working 8
together 7.9
40s 7.8
partners 7.8
spectator 7.8
retired 7.8
corporation 7.7
collar 7.7
workplace 7.6
ethnic 7.6
studio 7.6
phone 7.4
building 7.2
gray 7.2
family 7.1

Google
created on 2022-06-18

Hairstyle 95.1
Black 89.5
Black-and-white 86.5
Style 84
Hat 83.3
Tie 81.4
Blazer 77
Sun hat 77
Suit 76.7
City 74.6
Event 74.4
Monochrome photography 73.9
Crowd 73.9
Monochrome 72.1
Eyewear 70.2
Formal wear 69.5
Street 68.9
Fedora 68.9
White-collar worker 67.8
Fun 65.6

Microsoft
created on 2022-06-18

person 99.8
human face 99.2
clothing 97.3
smile 93.4
suit 90.8
man 90
fashion accessory 84.4
black and white 81.6
people 76.5
woman 66.3
text 61.4
crowd 1.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 87%
Surprised 6.4%
Fear 6.1%
Angry 5.1%
Sad 4%
Happy 1.2%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Female, 99.9%
Happy 80.3%
Fear 12.4%
Surprised 7.6%
Sad 2.5%
Angry 1.2%
Disgusted 1.1%
Calm 1%
Confused 0.9%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 98.1%
Suit 97.9%
Tie 96%

Categories

Imagga

people portraits 95.6%
paintings art 3.5%

Text analysis

Amazon

for
in
1%
Pin in
Pin
KOREAN

Google

78
NA
78 NA