Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)
Date

July 30, 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.782
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.782

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Pants 99.9
Shirt 99.8
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.6
Male 99.6
Man 99.6
Person 99.6
Adult 99.5
Male 99.5
Man 99.5
Person 99.5
Sitting 99.4
People 98.4
Sun Hat 98
Adult 97.3
Male 97.3
Man 97.3
Person 97.3
Adult 97.2
Male 97.2
Man 97.2
Person 97.2
Formal Wear 95.8
Face 95.7
Head 95.7
Photography 95.7
Portrait 95.7
Accessories 92.5
Couch 90.5
Furniture 90.5
Bench 87.1
Jeans 83.7
Outdoors 83.5
Shorts 81.5
Hat 78
Tie 77.6
Hat 75.3
Footwear 73.8
Shoe 73.8
Nature 69.3
Shoe 58.2
Suit 57.4
Garden 56.3
Gardening 56.3
Grass 56.2
Plant 56.2
Gardener 55.4

Clarifai
created on 2018-05-11

people 99.9
adult 99
man 98.5
group 98.3
group together 98
three 95.2
two 95
woman 94.3
several 94
wear 93.9
leader 93.4
administration 93.4
four 93.4
lid 90.8
sit 90.2
elderly 86.9
veil 86.8
one 86.3
position 86.1
five 85.6

Imagga
created on 2023-10-06

kin 79.6
field 27.6
person 26.6
outdoor 26
male 24.8
people 24
man 22.2
summer 21.2
grass 20.5
outside 19.7
outdoors 19.4
adult 17.6
portrait 17.5
boy 15.6
happy 15
autumn 14.9
country 14.9
countryside 14.6
sitting 14.6
relax 14.3
park 14
old 13.9
child 13.6
meadow 13.5
love 13.4
happiness 12.5
cowboy 11.8
joy 11.7
farm 11.6
rural 11.5
couple 11.3
hay 11.2
attractive 11.2
rest 11.1
youth 11.1
family 10.7
sky 10.2
two 10.2
agriculture 9.6
look 9.6
musical instrument 9.6
jeans 9.5
free 9.4
cute 9.3
pretty 9.1
blond 9
work 8.9
kid 8.9
together 8.8
straw 8.7
smiling 8.7
lifestyle 8.7
day 8.6
smile 8.5
farming 8.5
casual 8.5
teen 8.3
freedom 8.2
pose 8.1
activity 8.1
women 7.9
model 7.8
play 7.8
accordion 7.8
sunny 7.7
men 7.7
farmer 7.6
uniform 7.5
mother 7.5
fun 7.5
leisure 7.5
vintage 7.4
landscape 7.4
holding 7.4
cheerful 7.3
teenager 7.3
children 7.3
childhood 7.2
posing 7.1
to 7.1
spring 7.1
clothing 7

Google
created on 2018-05-11

photograph 95.2
black and white 90.5
snapshot 81.8
monochrome photography 77.5
family 64.5
vintage clothing 64
monochrome 61
farmworker 58.8
human behavior 53.2
goats 51.5

Microsoft
created on 2018-05-11

grass 100
outdoor 99.9
person 98.7
old 91.5
black 77.3
vintage 27.1
older 20.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-56
Gender Male, 100%
Sad 85.1%
Calm 54.2%
Surprised 6.4%
Fear 6%
Confused 4.1%
Angry 1.1%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 56-64
Gender Male, 99.8%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 48.4%
Confused 33.2%
Sad 18.9%
Surprised 6.3%
Fear 6%
Angry 1.1%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 69
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.6%
Male 99.6%
Man 99.6%
Person 99.6%
Jeans 83.7%
Hat 78%
Tie 77.6%
Shoe 73.8%