Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)
Date

July 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1818
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1818

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Clothing 100
Sun Hat 100
Hat 99.3
Adult 99.1
Male 99.1
Man 99.1
Person 99.1
Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Adult 97.7
Person 97.7
Female 97.7
Woman 97.7
Head 97.6
Face 97.5
Smoke Pipe 92.3
Formal Wear 91.5
Suit 91.5
Adult 85.9
Male 85.9
Man 85.9
Person 85.9
Person 84.7
Photography 78.8
Portrait 78.8
Accessories 70.7
Tie 70.7
Tie 69.2
Suit 64.4
Smoke 61.4
Shirt 58
Cowboy Hat 56
Body Part 55.5
Finger 55.5
Hand 55.5

Clarifai
created on 2018-05-11

people 100
man 99
group 98.9
lid 98.6
adult 98.5
group together 97.7
veil 97
leader 95.5
administration 95.4
several 94.7
many 93.9
wear 93.8
two 92.6
fedora 92
facial expression 90.9
four 90.5
portrait 90
three 89.5
music 87
elderly 86.9

Imagga
created on 2023-10-07

hat 95.3
cowboy hat 43.3
headdress 38.7
man 38.3
clothing 35.2
male 33.4
person 32.2
portrait 28.5
people 28.5
adult 27.8
happy 21.9
bow tie 21.7
face 21.3
cowboy 20.8
couple 20
smile 20
senior 19.7
sombrero 18.2
two 17.8
hand 17.5
outdoors 17.2
necktie 16.6
guy 16.1
love 15.8
smiling 15.2
fashion 15.1
black 15
shirt 15
attractive 14.7
style 14.1
looking 13.6
western 13.6
old 13.2
consumer goods 13
covering 13
men 12.9
hair 12.7
pretty 12.6
model 12.5
lady 11.4
boy 11.3
one 11.2
expression 11.1
suit 11.1
casual 11
happiness 11
cute 10.8
handsome 10.7
married 10.6
elderly 10.5
look 10.5
fun 10.5
mature 10.2
lifestyle 10.1
head 10.1
romance 9.8
romantic 9.8
human 9.8
boyfriend 9.6
standing 9.6
vintage 9.1
retro 9
cowgirl 8.9
posing 8.9
husband 8.8
together 8.8
costume 8.7
women 8.7
straw 8.7
garment 8.6
horse 8.5
hold 8.3
leisure 8.3
eye 8
work 7.9
mysterious 7.8
serious 7.6
wearing 7.6
pair 7.6
dark 7.5
relationship 7.5
child 7.5
beard 7.4
emotion 7.4
friendly 7.3
cheerful 7.3
business 7.3
make 7.3
pose 7.3
sexy 7.2
kid 7.1
mustache 7

Google
created on 2018-05-11

photograph 95.9
black and white 92.8
monochrome photography 88.6
photography 82.1
snapshot 81.8
headgear 78.3
standing 76.2
monochrome 73
gentleman 72.6
human 71
human behavior 66
vintage clothing 65.4
smile 59.8
stock photography 57.1
fedora 51.8

Microsoft
created on 2018-05-11

person 99.2
man 98
hat 84.9
old 73.3
white 66.6
male 18.1
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 37.4%
Angry 30.4%
Confused 18.3%
Sad 7.9%
Surprised 7.3%
Fear 6.2%
Disgusted 0.9%
Happy 0.6%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Happy 96.6%
Surprised 6.5%
Fear 6%
Sad 2.2%
Confused 1.5%
Angry 0.5%
Disgusted 0.4%
Calm 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 92.6%
Surprised 6.4%
Fear 5.9%
Happy 3%
Sad 2.8%
Confused 0.9%
Angry 0.8%
Disgusted 0.5%

AWS Rekognition

Age 35-43
Gender Female, 98.4%
Happy 51.7%
Calm 19.9%
Sad 12%
Angry 10.3%
Surprised 7.3%
Fear 6.5%
Disgusted 1.1%
Confused 0.7%

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.3%
Adult 99.1%
Male 99.1%
Man 99.1%
Person 99.1%
Female 97.7%
Woman 97.7%
Smoke Pipe 92.3%
Suit 91.5%
Tie 70.7%

Categories

Imagga

paintings art 59.9%
people portraits 37.7%
pets animals 1.7%

Captions

Microsoft
created on 2018-05-11

a man wearing a hat 94.9%
a man wearing a black hat 93.5%
a black and white photo of a man 93.4%