Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)
Date

July 30, 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.327
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.327

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Pants 100
Bench 99.6
Furniture 99.6
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Sitting 99.1
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Shirt 97.6
People 97.3
Face 95.9
Head 95.9
Photography 95.9
Portrait 95.9
Adult 95.8
Male 95.8
Man 95.8
Person 95.8
Footwear 90.1
Shoe 90.1
Couch 87.1
Sun Hat 85.5
Outdoors 83.2
Formal Wear 81.4
Hat 74.3
Grass 70.6
Plant 70.6
Nature 70.3
Hat 58.2
Accessories 57.8
Tie 57.8
Shorts 57.4
Suit 57.2
Cap 57
Architecture 56.9
Building 56.9
Housing 56.9
House 56.3
Porch 56.3
Garden 56.2
Gardening 56.2
Coat 55.9
Gardener 55.4

Clarifai
created on 2018-05-11

people 99.9
group 98.8
group together 98.8
adult 98.7
man 97.6
woman 95.5
several 94.7
four 93.7
three 93.6
administration 93
leader 91.7
five 89.7
wear 89.4
many 88.8
sit 87.9
offspring 85.4
two 84.7
war 80
recreation 79.4
military 77.8

Imagga
created on 2023-10-07

grass 33.2
man 29.6
field 28.5
outdoor 26
person 23
outdoors 22.4
outside 22.3
people 21.8
male 20.1
summer 18.7
landscape 17.9
kin 17.3
boy 16.5
child 15.6
farmer 15.6
sky 14.7
farm 14.3
countryside 13.7
active 13.5
meadow 12.6
hiking 12.5
park 12.4
men 12
happy 11.9
old 11.8
leisure 11.6
rural 11.5
country 11.4
walking 11.4
sitting 11.2
day 11
activity 10.8
kid 10.6
autumn 10.5
together 10.5
adult 10.4
rest 10.2
relax 10.1
environment 9.9
work 9.8
backpack 9.8
working 9.7
cowboy 9.7
agriculture 9.7
elderly 9.6
resting 9.5
spring 9.4
happiness 9.4
relaxing 9.1
fun 9
couple 8.7
forest 8.7
lifestyle 8.7
farming 8.5
two 8.5
clouds 8.5
free 8.4
joy 8.4
dog 8.3
teenager 8.2
children 8.2
family 8
to 8
businessman 8
smile 7.8
tool 7.8
sport 7.7
garden 7.5
dairy 7.5
senior 7.5
natural 7.4
freedom 7.3
sun 7.2
fall 7.2
portrait 7.1
mountain 7.1
rice 7.1

Google
created on 2018-05-11

photograph 96
black and white 93
monochrome photography 85.9
snapshot 81.8
sitting 79.9
standing 79.7
photography 78.6
family 70.9
monochrome 69.4
vintage clothing 68.8
human behavior 58.8
stock photography 53.4
recreation 52

Microsoft
created on 2018-05-11

grass 100
outdoor 99.8
person 88.7
old 71.7
group 62.3
posing 50.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 58-66
Gender Male, 99.6%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 85.6%
Sad 9.2%
Surprised 6.3%
Fear 5.9%
Confused 2.5%
Angry 0.6%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.5%
Angry 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.5%
Male 99.5%
Man 99.5%
Person 99.5%
Shoe 90.1%
Hat 74.3%