Human Generated Data

Title

Untitled (rehabilitation clients, Boone County, Arkansas)
Date

October 1935, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3478
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (rehabilitation clients, Boone County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3478

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 100
Building 100
Outdoors 100
Shelter 100
Countryside 100
Hut 100
Nature 100
Rural 100
Face 100
Head 100
Photography 100
Portrait 100
Shack 99.8
Person 99.5
Adult 99.5
Bride 99.5
Female 99.5
Wedding 99.5
Woman 99.5
Person 98.9
Housing 97.3
House 90.3
Cabin 76.6
Log Cabin 56.4

Clarifai
created on 2018-05-10

people 99.9
adult 98.8
one 98.1
woman 97.8
monochrome 97.5
two 96.8
portrait 96.5
wear 93.3
child 92.1
facial expression 90.6
barn 90.3
model 90.1
girl 87.1
man 85.9
home 85.6
group 85.3
log cabin 83.9
music 78.5
family 75.7
street 75.1

Imagga
created on 2023-10-06

window 20.2
building 18.8
person 17.5
people 17.3
adult 16.8
attractive 16.8
hair 16.6
outdoors 15.7
roof 15.4
old 15.3
wall 15
structure 14.8
sexy 14.4
house 14.2
architecture 14.1
lifestyle 13.7
portrait 13.6
fashion 13.6
model 13.2
black 12.7
call 12.6
pretty 12.6
man 12.1
human 12
dress 11.7
protective covering 11.6
sky 11.5
face 11.4
brick 11.3
door 11.2
sensuality 10.9
outdoor 10.7
posing 10.7
world 10.6
thatch 10.5
body 10.4
fence 10.3
alone 10
happy 10
one 9
lady 8.9
women 8.7
smiling 8.7
swing 8.6
outside 8.6
hut 8.5
net 8.5
stone 8.4
city 8.3
vintage 8.3
framework 8
home 8
male 7.9
covering 7.7
entrance 7.7
sad 7.7
prison 7.6
head 7.6
street 7.4
light 7.3
water 7.3
makeup 7.3
cute 7.2
lovely 7.1
love 7.1

Google
created on 2018-05-10

photograph 96.5
black and white 92.3
monochrome photography 84.9
photography 84
standing 82.1
snapshot 81.8
house 73.7
vintage clothing 72.3
picture frame 71.2
girl 68.8
window 64.6
monochrome 63.3
stock photography 54.1

Microsoft
created on 2018-05-10

building 99.1
outdoor 92
person 89.6
roof 34.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 98.4%
Sad 96.1%
Confused 33.6%
Surprised 7.6%
Fear 7.3%
Calm 6.6%
Disgusted 2.5%
Angry 2%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Calm 87.8%
Sad 6.9%
Surprised 6.3%
Fear 5.9%
Confused 3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Bride
Female
Woman
Person 99.5%
Person 98.9%
Adult 99.5%
Bride 99.5%
Female 99.5%
Woman 99.5%

Categories

Imagga

paintings art 94.8%
streetview architecture 3.1%

Captions

Microsoft
created on 2018-05-10

a person standing in front of a building 89.7%
a person standing in front of a house 89.6%
a person standing in front of a white building 78.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a woman in a white dress standing in front of a log cabin -100%