Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)
Date

July 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.703
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.703

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 99
Male 99
Man 99
Person 99
Adult 98.8
Male 98.8
Man 98.8
Person 98.8
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Adult 98.3
Male 98.3
Man 98.3
Person 98.3
Face 97.8
Head 97.8
Photography 97.8
Portrait 97.8
Person 97.1
Hat 94.8
Person 94.8
Person 94.1
Shirt 90.8
Person 89.9
Accessories 85.3
Formal Wear 85.3
Tie 85.3
Hat 84.1
Hat 82.9
Outdoors 74.1
Person 70.6
Hat 64.4
Nature 60.9
Hat 58.8
Cowboy Hat 57.8
Suit 57.4
People 57.3
Coat 56.3
Cap 55.8

Clarifai
created on 2018-05-11

people 99.9
lid 99.4
group 98.5
adult 98.4
group together 98.3
veil 98.2
man 96.8
wear 96.5
several 95
administration 94
leader 93.9
portrait 92.3
outfit 91.6
many 90.8
five 87.4
recreation 86.3
military 86.3
four 86.3
watercraft 86.2
fedora 85.6

Imagga
created on 2023-10-06

bow tie 45.4
hat 41.4
necktie 37.9
man 35.6
clothing 35.6
people 34.6
male 31.5
person 28.7
headdress 27.9
adult 20.7
portrait 20.7
cowboy hat 20.4
garment 18.1
work 18
smile 17.8
mortarboard 17.2
happiness 16.4
happy 16.3
cap 15.2
worker 15
face 14.9
men 14.6
business 14.6
job 13.3
smiling 13
professional 12.8
businessman 12.4
covering 12.2
consumer goods 11.8
hand 11.4
outdoors 11.2
old 11.1
uniform 10.5
human 10.5
attractive 10.5
couple 10.5
one 10.4
looking 10.4
guy 10.3
women 10.3
two 10.2
lifestyle 10.1
handsome 8.9
success 8.8
building 8.7
student 8.7
model 8.6
shirt 8.4
fashion 8.3
waiter 8.1
working 8
love 7.9
sitting 7.7
serious 7.6
college 7.6
leisure 7.5
holding 7.4
style 7.4
occupation 7.3
book 7.3
cheerful 7.3
suit 7.3
computer 7.2
hair 7.1
look 7

Google
created on 2018-05-11

photograph 95.8
black and white 90.6
standing 84.4
snapshot 81.8
monochrome photography 79.3
vintage clothing 77.2
headgear 76.8
monochrome 71.6
history 67.6
human behavior 52.3
stock photography 52.2
militia 50.4

Microsoft
created on 2018-05-11

person 99.6
outdoor 99.1
man 96.4
old 88.6
standing 76.8
posing 61.7
necktie 16.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 58-66
Gender Male, 100%
Calm 71.5%
Confused 19.6%
Surprised 6.4%
Fear 6%
Sad 4.6%
Happy 2.1%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 98.9%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Angry 0.6%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 66.6%
Sad 54.9%
Surprised 6.4%
Fear 6.1%
Happy 1.4%
Confused 1.3%
Angry 1%
Disgusted 0.6%

AWS Rekognition

Age 41-49
Gender Male, 89.3%
Calm 69.9%
Angry 16.5%
Surprised 7.5%
Sad 7.3%
Fear 6%
Disgusted 0.8%
Happy 0.8%
Confused 0.5%

Microsoft Cognitive Services

Age 82
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Adult 99%
Male 99%
Man 99%
Person 99%
Hat 94.8%
Tie 85.3%

Captions

Microsoft
created on 2018-05-11

a man wearing a uniform posing for a photo 95.2%
a man wearing a hat 95.1%
a man wearing a black hat 94.1%