Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

Date

July 30, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2549

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2549

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99
Male 99
Man 99
Person 99
Adult 98.9
Male 98.9
Man 98.9
Person 98.9
Adult 98.2
Male 98.2
Man 98.2
Person 98.2
Adult 95.8
Male 95.8
Man 95.8
Person 95.8
Hat 92.8
Bench 92.6
Furniture 92.6
Adult 92.6
Male 92.6
Man 92.6
Person 92.6
Adult 91.4
Male 91.4
Man 91.4
Person 91.4
Footwear 91.1
Shoe 91.1
Hat 90.5
Face 88.7
Head 88.7
Sitting 83.1
Hat 79.5
Shoe 75.3
Person 75
Hat 73.7
Hat 68.9
Accessories 66.7
Glasses 66.7
Hat 56.9
Cowboy Hat 55.8
People 55.8
Dugout 55.6
Sport 55.6
Outdoors 55.1

Clarifai
created on 2018-05-10

people 99.9
group together 98.9
adult 98.7
group 98
man 97.9
woman 97.5
lid 97.3
wear 94.5
veil 93.5
several 93.2
four 92.8
three 92
five 91.6
two 88.6
many 88.4
reclining 88
watercraft 87.9
recreation 87.8
child 87.4
vehicle 81.5

Imagga
created on 2023-10-06

bench 34.9
hat 31.9
park bench 30.6
cowboy hat 28.2
person 24
man 23.5
people 23.4
outdoors 20.9
male 19.9
seat 19.8
clothing 19.1
headdress 17.9
sitting 14.6
child 14.1
old 13.9
happy 13.8
portrait 12.9
outside 12.8
adult 12.3
furniture 11.9
two 11.9
park 11.5
working 11.5
autumn 11.4
building 11.2
outdoor 10.7
scholar 10.1
holding 9.9
newspaper 9.8
stone 9.8
work 9.7
together 9.6
looking 9.6
boy 9.6
men 9.4
smiling 9.4
travel 9.2
vintage 9.1
uniform 8.7
youth 8.5
covering 8.5
summer 8.4
fashion 8.3
girls 8.2
product 8.2
lady 8.1
intellectual 8.1
consumer goods 8.1
worker 8
cowboy 8
grass 7.9
country 7.9
day 7.8
smile 7.8
happiness 7.8
architecture 7.8
season 7.8
pretty 7.7
hiking 7.7
culture 7.7
fun 7.5
vacation 7.4
black 7.2
rural 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.9
sitting 94.4
outdoor 88.3
old 83.8
people 59.6
group 55.3
older 25.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 78.1%
Confused 18.2%
Surprised 6.8%
Fear 5.9%
Sad 2.4%
Angry 1.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Calm 91.3%
Surprised 6.4%
Fear 5.9%
Sad 3.3%
Confused 3.2%
Angry 0.7%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 24-34
Gender Female, 76.2%
Sad 98.5%
Calm 20.8%
Surprised 10.7%
Happy 7.6%
Fear 6.2%
Angry 5.2%
Disgusted 1.7%
Confused 0.7%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 82.5%
Surprised 7.8%
Sad 7.8%
Fear 6%
Angry 2.9%
Disgusted 1.2%
Happy 0.6%
Confused 0.3%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Hat 92.8%
Shoe 91.1%
Glasses 66.7%

Text analysis

Amazon

47%F