Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)
Date

July 30, 1938, printed later
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3420
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (auction, New Carlisle, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 30, 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3420

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99.4
Male 99.4
Man 99.4
Person 99.4
Photography 99.2
Adult 99.2
Male 99.2
Man 99.2
Person 99.2
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Hat 98.4
Hat 98
Face 96.9
Head 96.9
Portrait 96.9
Accessories 95.3
Glasses 95.3
Shirt 92.8
Formal Wear 91.3
Suit 91.3
Coat 89.2
Jacket 89.2
Hat 89.1
Hat 88.7
Glasses 87.8
Cowboy Hat 65.8
Glasses 56.3
Cap 55

Clarifai
created on 2018-05-10

lid 99.7
people 99.7
man 99.1
veil 98.1
adult 97.7
elderly 95.4
fedora 95.2
cowboy 94.1
group 93.7
two 93.6
three 93.5
portrait 92.1
wear 91.8
group together 89.8
monochrome 89.6
cowboy hat 89.1
administration 85.6
cowman 84.9
four 84.5
facial expression 84.4

Imagga
created on 2023-10-06

cowboy hat 100
hat 100
headdress 97.7
clothing 66.2
male 41.1
man 40.3
person 35.8
portrait 34.3
consumer goods 33.9
covering 33.7
face 32
adult 28.5
people 27.9
senior 25.3
outdoors 22.4
happy 20.7
cowboy 20.6
men 18.9
elderly 18.2
handsome 17.8
smile 17.8
western 17.4
looking 16.8
old 16.7
mature 15.8
attractive 15.4
casual 15.3
shirt 14.9
boy 14.8
guy 14.7
lifestyle 14.5
hand 13.7
two 13.6
look 13.1
smiling 13
child 12.5
couple 12.2
outside 12
old-timer 11.9
pretty 11.9
kid 11.5
serious 11.4
together 11.4
human 11.2
hair 11.1
expression 11.1
hold 11.1
model 10.9
jacket 10.6
age 10.5
grandfather 10.3
uniform 10.1
head 10.1
cute 10
older 9.7
black 9.6
wearing 9.5
farmer 9.5
happiness 9.4
close 9.1
aged 9
one 9
style 8.9
standing 8.7
straw 8.7
retirement 8.6
alone 8.2
children 8.2
farm 8
rural 7.9
cowgirl 7.9
country 7.9
love 7.9
retired 7.8
cold 7.7
industry 7.7
husband 7.6
walk 7.6
horse 7.6
wife 7.6
pair 7.6
fashion 7.5
cheerful 7.3
lady 7.3
active 7.2

Google
created on 2018-05-10

photograph 95.8
man 94
black and white 89
snapshot 81.8
photography 81.4
male 80.7
headgear 80.3
monochrome photography 78.7
fedora 74
sunglasses 72.7
human behavior 71.7
vision care 69.7
eyewear 69.4
monochrome 69.2
gentleman 63.4
glasses 58.3
hat 53.8
stock photography 53.6
vintage clothing 52.7
cowboy 52

Microsoft
created on 2018-05-10

person 99.5
man 98.1
outdoor 96.3
hat 95.8
headdress 82.5
military uniform 82.1
old 70.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 65-75
Gender Male, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 58.7%
Confused 19.6%
Surprised 7.2%
Sad 7%
Disgusted 6.4%
Fear 6.3%
Angry 2.3%
Happy 1.5%

Microsoft Cognitive Services

Age 73
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 99.4%
Male 99.4%
Man 99.4%
Person 99.4%
Hat 98.4%
Glasses 95.3%
Suit 91.3%
Jacket 89.2%

Categories

Imagga

paintings art 96.8%
streetview architecture 2.2%

Text analysis

Amazon

58%F,