Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)
Date

July 30, 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2687
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2687

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Architecture 99.9
Building 99.9
House 99.9
Housing 99.9
Porch 99.9
Sun Hat 99.8
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Person 99.3
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Person 99
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
People 95.8
Footwear 92
Shoe 92
Shoe 91.6
Shoe 82.7
Accessories 80.6
Formal Wear 80.6
Tie 80.6
Tie 78.3
Tie 78.2
Hat 73.5
Pants 72.7
Shorts 71.4
Face 69.4
Head 69.4
Outdoors 69.4
Hat 65.9
Shoe 64.2
Furniture 63.1
Hat 62.5
Shoe 59.6
Shirt 57
Nature 56.7
Shoe 56.5
Bench 56.4
Cap 56.2
Photography 55.7
Portrait 55.7
Cowboy Hat 55.6
Baseball 55.4
Baseball Glove 55.4
Glove 55.4
Sport 55.4
Coat 55.3

Clarifai
created on 2018-05-10

people 100
child 98.5
group 98.4
group together 98.2
man 96.2
adult 95.4
woman 93.5
boy 93.2
family 92.1
many 91.6
several 89.2
five 87.6
offspring 85.6
position 85.1
four 84.3
home 84.1
sibling 82.1
education 81.6
military 81.5
sit 79.4

Imagga
created on 2023-10-06

man 28.9
people 26.8
person 24.5
stretcher 21.6
litter 17.2
family 16.9
male 16.4
happy 16.3
portrait 16.2
conveyance 15.5
old 15.3
kin 14.8
home 14.3
smile 14.2
outdoors 14.2
couple 13.9
men 13.7
adult 13.1
smiling 13
nurse 12.5
to 12.4
city 11.6
mother 11.5
together 11.4
walking 11.4
boy 11.3
love 11
patient 11
two 11
day 11
barbershop 10.9
happiness 10.2
street 10.1
lifestyle 10.1
girls 10
house 10
world 9.8
women 9.5
holiday 9.3
worker 9.3
case 9.3
life 8.8
urban 8.7
musical instrument 8.6
child 8.5
building 8.5
travel 8.4
senior 8.4
mature 8.4
back 8.3
human 8.2
shop 8.2
retired 7.8
outside 7.7
youth 7.7
elderly 7.7
outdoor 7.6
health 7.6
daughter 7.6
walk 7.6
fashion 7.5
sick person 7.5
care 7.4
vacation 7.4
new 7.3
aged 7.2
road 7.2
room 7.1
medical 7.1

Google
created on 2018-05-10

people 96.9
photograph 96.2
black and white 89
sitting 84.7
snapshot 81.8
male 80.6
standing 80.2
family 76.8
monochrome photography 73.5
human behavior 63.4
monochrome 62.6
vintage clothing 61.9
recreation 56.6
house 54.3

Microsoft
created on 2018-05-10

building 99.5
outdoor 94.5
window 92.8
black 81
old 76.6
group 62.3
posing 52.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 6.1%
Calm 4%
Confused 1%
Disgusted 0.7%
Angry 0.5%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Female, 94.7%
Calm 90.8%
Surprised 6.4%
Fear 5.9%
Angry 4.7%
Sad 3.3%
Happy 0.5%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 45-53
Gender Female, 99.5%
Calm 76%
Fear 8.7%
Surprised 7.6%
Sad 4.7%
Angry 3.4%
Happy 2.9%
Confused 2.2%
Disgusted 0.9%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Calm 88%
Surprised 7%
Fear 6.1%
Sad 3.9%
Confused 1.5%
Disgusted 1.4%
Happy 1.4%
Angry 1.4%

AWS Rekognition

Age 59-67
Gender Male, 100%
Sad 33.4%
Calm 32.2%
Confused 12.6%
Disgusted 11.4%
Angry 9.1%
Surprised 8.6%
Fear 6.7%
Happy 6.7%

AWS Rekognition

Age 51-59
Gender Male, 98.8%
Calm 96.6%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 1.8%
Confused 0.4%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 49-57
Gender Male, 100%
Disgusted 49.3%
Confused 22.3%
Calm 19.1%
Surprised 7%
Fear 6.1%
Sad 3.7%
Angry 1.6%
Happy 1.6%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 98.6%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Calm 92.8%
Surprised 6.7%
Fear 5.9%
Sad 4.2%
Angry 0.8%
Confused 0.4%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Feature analysis

Amazon

Adult
Male
Man
Person
Shoe
Tie
Hat
Adult 99.3%
Adult 99.3%
Adult 99.2%
Adult 99.2%
Adult 99.2%
Adult 99.1%
Adult 99.1%
Adult 98.7%
Male 99.3%
Male 99.3%
Male 99.2%
Male 99.2%
Male 99.2%
Male 99.1%
Male 99.1%
Male 98.7%
Man 99.3%
Man 99.3%
Man 99.2%
Man 99.2%
Man 99.2%
Man 99.1%
Man 99.1%
Man 98.7%
Person 99.3%
Person 99.3%
Person 99.2%
Person 99.2%
Person 99.2%
Person 99.1%
Person 99.1%
Person 99%
Person 98.7%
Shoe 92%
Shoe 91.6%
Shoe 82.7%
Shoe 64.2%
Shoe 59.6%
Shoe 56.5%
Tie 80.6%
Tie 78.3%
Tie 78.2%
Hat 73.5%
Hat 65.9%
Hat 62.5%