Human Generated Data

Title

In front of church on Sunday, Little Rock, Arkansas
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3053

Human Generated Data

Title

In front of church on Sunday, Little Rock, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3053

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 100
Apparel 100
Person 99.6
Human 99.6
Person 99.3
Person 99.1
Hat 99.1
Hat 99
Hat 98.3
Sun Hat 95.7
Cap 75.7
Cowboy Hat 75.6
Face 61.5

Clarifai
created on 2023-10-15

people 99.8
child 99.6
lid 99.5
two 98.9
group 98.6
three 98.5
son 98.1
boy 97.5
group together 97.3
wear 97.1
portrait 97.1
veil 96.7
man 94.2
four 94.1
adult 92.6
recreation 92.4
sibling 90.4
retro 88.3
family 87.4
offspring 87.2

Imagga
created on 2021-12-15

hat 41.2
umbrella 29.5
headdress 27.9
clothing 26.9
cowboy hat 26.4
outdoor 26
happy 22.5
sky 22.3
man 22.2
winter 21.3
person 21.2
fun 20.9
child 20.8
snow 20.1
people 20.1
outdoors 19.7
park 18.9
active 18.9
grass 18.2
cold 18.1
adult 17.4
happiness 17.2
joy 15.9
landscape 15.6
portrait 15.5
summer 15.4
parasol 15.3
canopy 15.3
covering 15.1
leisure 14.9
season 14.8
jumping 14.5
activity 14.3
male 14.3
day 14.1
freedom 13.7
cute 13.6
human 13.5
spring 13.3
tree 13.1
lifestyle 13
jump 12.5
smiling 12.3
sport 12.1
pretty 11.9
model 11.7
shelter 11.5
smile 11.4
sun 11.3
attractive 11.2
outside 11.1
girls 10.9
relaxation 10.9
field 10.9
meadow 10.8
consumer goods 10.6
look 10.5
bonnet 10.4
hair 10.3
women 10.3
love 10.3
healthy 10.1
face 9.9
vacation 9.8
autumn 9.7
together 9.6
play 9.5
cloud 9.5
laughing 9.4
men 9.4
free 9.4
air 9.2
playing 9.1
childhood 9
cheerful 8.9
color 8.9
forest 8.7
high 8.7
son 8.5
two 8.5
relax 8.4
action 8.4
parent 8.2
children 8.2
exercise 8.2
mother 8.1
dog 7.9
couple 7.8
boy 7.8
sunny 7.7
travel 7.7
life 7.7
protective covering 7.7
clouds 7.6
walking 7.6
garden 7.5
fashion 7.5
enjoy 7.5
weather 7.5
one 7.5
mountains 7.4
holiday 7.2
scarf 7.1

Google
created on 2021-12-15

Photograph 94.3
White 92.2
Cap 89
Hat 85.2
Tree 83.5
Headgear 82.2
Adaptation 79.3
Snapshot 74.3
Plant 73.4
Goggles 71.2
Vintage clothing 69.9
Monochrome photography 66.9
Child 65.2
Stock photography 63.9
Monochrome 62.8
Art 55
History 54.5
Photo caption 52.2
Photography 52
Family 51.9

Microsoft
created on 2021-12-15

tree 99.8
outdoor 99.3
hat 98.4
fashion accessory 97.5
human face 96
person 94.5
clothing 94
text 91.5
sun hat 86.1
smile 75.6
cowboy hat 70
people 64.8
fedora 57.2
old 45.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 88.9%
Calm 75.9%
Surprised 10.1%
Fear 6.3%
Angry 3.1%
Confused 2.1%
Sad 1.9%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 99.8%
Angry 97.3%
Calm 2%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 22-34
Gender Female, 85.3%
Sad 92%
Calm 5.3%
Fear 1%
Surprised 0.9%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 70
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 99.1%

Categories

Imagga

paintings art 92.4%
nature landscape 7%