Human Generated Data

Title

Untitled (New York City)

Date

c. 1945

People

Artist: Sol Libsohn, American 1914 - 2001

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.28

Human Generated Data

Title

Untitled (New York City)

People

Artist: Sol Libsohn, American 1914 - 2001

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.28

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Audience 99.7
Crowd 99.7
Human 99.7
Person 99.1
Person 99
Person 98.9
Person 98.3
Person 98.2
Person 97.9
Person 96.7
Person 95.5
Face 91.9
Person 89.2
Suit 88.4
Coat 88.4
Overcoat 88.4
Clothing 88.4
Apparel 88.4
People 83.2
Person 82.6
Hat 82.2
Head 68.9
Suit 67.6
Interior Design 67.3
Indoors 67.3
Portrait 64.3
Photography 64.3
Photo 64.3
Hat 56.2
Speech 55.3

Clarifai
created on 2023-10-25

people 100
group 99.7
many 98.9
adult 98.6
leader 98.4
administration 98.2
woman 97.6
man 96.6
group together 95.9
several 95.2
portrait 93
elderly 89.5
chair 89
war 87.3
street 81.9
facial expression 80.4
music 78.9
trial 77.1
wear 77.1
offense 75.9

Imagga
created on 2022-01-08

man 45.7
couple 39.2
male 37.7
happy 37
senior 36.5
people 35.7
bartender 33.5
smiling 28.2
adult 28
person 24.5
home 22.3
smile 22.1
together 21.9
portrait 21.4
husband 21.2
elderly 21.1
grandfather 20.4
wife 19.9
men 19.7
family 18.7
indoors 18.4
love 18.1
grandma 17.7
mature 17.7
retired 17.4
old 17.4
sitting 17.2
cheerful 16.3
lifestyle 14.5
happiness 14.1
two 13.6
kin 13.5
face 13.5
spectator 13.5
60s 12.7
businessman 12.4
enjoying 12.3
friends 12.2
grandmother 11.7
middle aged 11.7
office 11.6
mother 11.6
handsome 11.6
professional 11.6
business 11.5
married 11.5
adults 11.4
executive 11.3
group 11.3
child 11.3
success 11.3
table 11.2
fun 11.2
pretty 11.2
color 11.1
women 11.1
communication 10.9
businesswoman 10.9
30s 10.6
retirement 10.6
father 10.5
parent 10.4
corporate 10.3
gray 9.9
suit 9.9
attractive 9.8
to 9.7
black 9.6
hair 9.5
marriage 9.5
businesspeople 9.5
pair 9.4
friendship 9.4
casual 9.3
teamwork 9.3
glasses 9.3
camera 9.2
leisure 9.1
world 9.1
blond 8.9
70s 8.9
job 8.8
sixties 8.8
40s 8.8
partner 8.7
affection 8.7
work 8.6
togetherness 8.5
evening 8.4
horizontal 8.4
bow tie 8.4
emotion 8.3
classroom 8
looking 8
older 7.8
loving 7.6
worker 7.4
20s 7.3
lady 7.3
laptop 7.3
aged 7.2
computer 7.2
team 7.2
romantic 7.1
day 7.1

Google
created on 2022-01-08

Photograph 94.2
Hat 88.5
Black-and-white 84.2
Style 83.8
Monochrome photography 75.8
Snapshot 74.3
Event 73.5
Monochrome 73.3
Vintage clothing 73.2
Stock photography 65.8
History 65.2
Crowd 62.1
Photo caption 61.6
Eyewear 61.5
Suit 59.9
Room 59.1
Art 58.9
Crew 57.7
Team 57.6
White-collar worker 55.2

Microsoft
created on 2022-01-08

person 100
human face 98.8
clothing 98.6
people 98.2
text 95
group 94.6
man 92.3
smile 84.4
woman 83.5
black and white 79.7
posing 37
crowd 2.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-64
Gender Female, 99.9%
Confused 48.7%
Calm 23.5%
Angry 21.9%
Sad 1.8%
Fear 1.7%
Disgusted 1.2%
Surprised 0.9%
Happy 0.3%

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 88.5%
Disgusted 3.8%
Sad 2.2%
Confused 1.9%
Happy 1.7%
Angry 1.2%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 51-59
Gender Female, 100%
Sad 72.3%
Calm 11%
Confused 7.3%
Happy 5.2%
Angry 1.9%
Surprised 1.2%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 58-66
Gender Female, 100%
Calm 98.6%
Angry 0.6%
Sad 0.5%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 63-73
Gender Male, 100%
Calm 92.9%
Sad 5.9%
Angry 0.4%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Female, 72.6%
Calm 42.2%
Confused 24.6%
Angry 14.6%
Sad 7.1%
Disgusted 4%
Surprised 3.2%
Fear 2.3%
Happy 2.1%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 97.5%
Sad 1.5%
Fear 0.3%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 41-49
Gender Male, 98.9%
Calm 76.5%
Sad 13.5%
Happy 3.2%
Fear 2.2%
Confused 2.1%
Surprised 0.9%
Angry 0.8%
Disgusted 0.7%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 94.5%
Confused 1.7%
Angry 1.2%
Fear 1%
Surprised 0.6%
Sad 0.5%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 41-49
Gender Female, 99.5%
Calm 98.4%
Sad 1.3%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 20-28
Gender Male, 72.8%
Sad 96.2%
Calm 1.6%
Fear 1.3%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 24-34
Gender Male, 72.7%
Calm 58.3%
Confused 14%
Happy 13.8%
Sad 4.8%
Fear 3.7%
Disgusted 3.5%
Surprised 0.9%
Angry 0.9%

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 63
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 61
Gender Female

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 53
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 88.4%
Hat 82.2%

Categories

Imagga

people portraits 99.8%

Text analysis

Amazon

rol
Sthib rol
Sthib