Human Generated Data

Title

Untitled (Red House, West Virginia)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1195
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1195

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

People 100
Baseball Cap 99.8
Cap 99.8
Clothing 99.8
Hat 99.8
Person 99.4
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 98.9
Face 97.4
Head 97.4
Photography 97.4
Portrait 97.4
Person 95.6
Male 95.6
Boy 95.6
Child 95.6
Person 91.3
Male 91.3
Boy 91.3
Child 91.3
Pants 74.7
Jeans 69
Coat 64.7
Jacket 64.7
Accessories 64
Knitwear 62.1
Sweater 62.1
Shirt 57.4
Happy 55.5
Smile 55.5
Blouse 55.4

Clarifai
created on 2018-05-11

people 99.8
group 98.8
portrait 98.7
man 97.1
group together 96.3
adult 95.7
administration 93.7
woman 90.7
child 89.6
wear 88.1
five 87.8
four 87.6
three 86.3
war 86.1
several 85.6
facial expression 84.8
retro 83.9
leader 83.7
music 82.7
military 81.1

Imagga
created on 2023-10-07

man 47
male 45.2
kin 44.9
happy 37.6
senior 37.5
couple 37.5
people 34.6
smiling 34
mature 32.5
together 30.7
person 30.4
home 30.3
elderly 29.7
adult 28.7
husband 24.8
men 23.2
indoors 22.8
family 22.2
group 21.8
lifestyle 21.7
wife 20.9
portrait 20.7
grandfather 20.4
child 20.4
60s 18.6
sibling 18.3
love 18.1
cheerful 17.1
casual 16.9
office 16.9
old 16.7
sitting 16.3
color 16.1
women 15.8
middle aged 15.6
retired 15.5
business 15.2
smile 15
leisure 14.9
classroom 14.8
older 14.6
30s 14.4
retirement 14.4
professional 14
businesswoman 13.6
computer 13.6
married 13.4
horizontal 13.4
happiness 13.3
camera 12.9
father 12.9
laptop 12.8
team 12.5
businessman 12.4
talking 12.4
meeting 12.2
education 12.1
clothing 11.7
thirties 11.7
job 11.5
desk 11.3
work 11
class 10.6
working 10.6
modern 10.5
loving 10.5
mother 10.5
boy 10.4
standing 10.4
enjoying 10.4
females 10.4
looking 10.4
relaxed 10.3
day 10.2
teamwork 10.2
children 10
granddaughter 9.9
70s 9.8
casual clothing 9.8
executive 9.5
age 9.5
adults 9.5
corporate 9.4
togetherness 9.4
parent 9.4
friendship 9.4
daughter 9.3
two 9.3
face 9.2
aged 9
technology 8.9
explaining 8.9
discussing 8.8
sixties 8.8
50s 8.8
40s 8.8
table 8.7
spectator 8.6
room 8.6
college 8.5
businesspeople 8.5
friends 8.5
pensioner 8.3
school 8.2
outdoors 8.2
suit 8.1
grandchild 7.9
classmate 7.9
grandparent 7.9
gray hair 7.9
their 7.8
son 7.8
affection 7.7
active 7.6
learning 7.5
human 7.5
relationship 7.5
fun 7.5
20s 7.3
student 7.3
relaxing 7.3
handsome 7.1
romantic 7.1

Google
created on 2018-05-11

photograph 95.9
person 93.3
man 92.2
standing 90.7
black and white 89.2
male 83.4
snapshot 81.8
photography 79.4
monochrome photography 79.3
family 68.9
monochrome 65.3
team 64.8
vintage clothing 64
crew 62.4
military person 59.9
military officer 59.3
staff 57.6
human behavior 53.8
uniform 52.4
gentleman 52.1

Microsoft
created on 2018-05-11

person 99.9
posing 96.7
group 91.9
standing 89.3
outdoor 87.5
people 63.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Male, 58.9%
Calm 76.8%
Angry 13.6%
Surprised 6.4%
Fear 6%
Sad 5.1%
Confused 2.2%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Male, 51.5%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 10-18
Gender Male, 100%
Calm 97.4%
Surprised 6.4%
Fear 6%
Sad 2.6%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Male, 100%
Sad 97.7%
Calm 37.3%
Surprised 8.8%
Fear 6.4%
Angry 1.9%
Confused 1.3%
Disgusted 0.7%
Happy 0.3%

AWS Rekognition

Age 18-26
Gender Male, 92%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Child
Jeans
Jacket
Person 99.4%
Person 99.1%
Person 98.9%
Person 95.6%
Person 91.3%
Adult 99.1%
Male 99.1%
Male 95.6%
Male 91.3%
Man 99.1%
Boy 95.6%
Boy 91.3%
Child 95.6%
Child 91.3%
Jeans 69%
Jacket 64.7%

Categories

Imagga

people portraits 62%
paintings art 36.8%