Human Generated Data

Title

Untitled (Skyline Farms, Alabama)
Date

Summer 1937, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3376
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Skyline Farms, Alabama)

People

Artist: Ben Shahn, American 1898 - 1969

Date

Summer 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.9
Human 99.9
Person 99.8
Person 99.8
Apparel 99.8
Hat 99.8
Clothing 99.8
Person 99.1
Face 98.8
Person 94.5
Beard 85.1
Sun Hat 59.9
Finger 58
Undershirt 56

Imagga
created on 2021-12-15

man 46.4
male 40.5
person 38.6
senior 33.7
people 33.5
happy 30.1
portrait 27.8
elderly 26.8
adult 26.7
couple 26.1
hat 23.9
grandfather 22.9
face 21.3
smiling 21
old 20.9
smile 20.7
men 20.6
love 18.9
mature 18.6
happiness 18
looking 17.6
clothing 16.8
lifestyle 16.6
retired 16.5
handsome 15.2
sitting 14.6
family 14.2
businessman 13.2
together 13.1
scholar 13
business 12.8
two 12.7
aged 12.7
husband 12.7
hairdresser 12.6
work 12.6
father 12.4
mother 12.3
wife 12.3
indoors 12.3
home 12
casual 11.9
day 11.8
cheerful 11.4
intellectual 11.4
professional 11.3
outdoors 11.2
model 10.9
grandmother 10.8
affection 10.6
retirement 10.6
mortarboard 10.4
standing 10.4
guy 10.3
cap 10.1
indoor 10
joy 10
headdress 9.8
middle aged 9.7
interior 9.7
married 9.6
serious 9.5
women 9.5
suit 9.4
relationship 9.4
inside 9.2
hand 9.1
park 9.1
black 9
job 8.8
sexy 8.8
half length 8.8
dad 8.7
executive 8.7
adults 8.5
laughing 8.5
doctor 8.5
student 8.4
head 8.4
attractive 8.4
grandma 8.4
parent 8.3
gown 8.3
fashion 8.3
joyful 8.3
human 8.2
style 8.2
computer 8
shop 7.9
hair 7.9
boy 7.8
older 7.8
pensioner 7.7
worker 7.7
smart 7.5
room 7.5
one 7.5
close 7.4
glasses 7.4
camera 7.4
occupation 7.3
laptop 7.3
spectator 7.2
working 7.1
medical 7.1
life 7
look 7

Google
created on 2021-12-15

Shirt 95.3
Hat 91.5
Gesture 85.3
Style 83.9
Black-and-white 82.7
Tree 82.2
Headgear 81.3
Adaptation 79.3
Vintage clothing 74.8
Monochrome photography 73.2
Event 71.8
Photo caption 70.8
Happy 70.6
Monochrome 68.5
Art 64.9
History 64.1
Moustache 63.8
Tie 62.7
Stock photography 62.5
Sun hat 59.6

Microsoft
created on 2021-12-15

person 98.8
text 95.9
clothing 95.3
human face 94.2
old 88.5
man 87.6
hat 87.1
smile 81.3
fashion accessory 71.5
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Male, 99.8%
Calm 98.9%
Sad 0.7%
Angry 0.3%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 26-40
Gender Male, 91.8%
Calm 90.1%
Angry 2.9%
Sad 2.2%
Confused 1.5%
Happy 1%
Disgusted 1%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 15-27
Gender Male, 50.6%
Angry 65.7%
Sad 24.3%
Fear 5.9%
Calm 2.5%
Happy 0.8%
Surprised 0.4%
Confused 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.9%
Hat 99.8%

Captions

Microsoft

an old photo of a man 96.1%
old photo of a man 95%
a old photo of a man 94.9%