Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)
Date

July 1938
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.687
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Fourth of July Carnival and Fishfry, Ashville, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.687

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Lady 100
Person 99.5
Adult 99.5
Male 99.5
Man 99.5
Person 99.2
Adult 99.2
Female 99.2
Woman 99.2
Person 99.2
Adult 99.2
Female 99.2
Woman 99.2
Sun Hat 98.9
Hat 96.7
Person 93.6
Face 92.1
Head 92.1
Hat 92.1
Photography 91.9
Car 91.6
Transportation 91.6
Vehicle 91.6
Accessories 91.2
Bag 91.2
Handbag 91.2
Hat 87.3
Electronics 80.6
Phone 80.6
Portrait 73.1
Person 69.9
Mobile Phone 68.7
Dress 57.3
Formal Wear 56.8
Smoke 56.6
Body Part 56.1
Finger 56.1
Hand 56.1
Suit 55.2
Cowboy Hat 55.2

Clarifai
created on 2018-05-11

people 99.9
adult 98.9
group 98.6
group together 98.4
woman 97.9
several 95.8
man 95.6
wear 94.1
two 93.6
administration 93.6
outfit 90.9
recreation 90.4
many 90.3
three 87
leader 86.9
actor 86.6
actress 86.3
portrait 85.3
veil 85.1
five 84.9

Imagga
created on 2023-10-06

man 33.6
people 29
person 25.5
male 25.5
men 18.9
adult 17.4
musical instrument 15.3
business 14
women 13.4
senior 13.1
group 12.1
weapon 12.1
work 11.8
lifestyle 11.6
hat 11.5
musician 11.4
hand 11.4
couple 11.3
sitting 11.2
smiling 10.8
indoors 10.5
gun 10.4
wind instrument 10.3
two 10.2
street 10.1
music 10.1
happy 10
smile 10
violin 9.9
holding 9.9
uniform 9.8
old 9.7
job 9.7
office 9.6
together 9.6
standing 9.6
love 9.5
stringed instrument 9.1
fashion 9
dress 9
businessman 8.8
professional 8.7
armor 8.6
chain mail 8.5
meeting 8.5
casual 8.5
employee 8.4
portrait 8.4
mature 8.4
city 8.3
suit 8.3
leisure 8.3
outdoors 8.2
bowed stringed instrument 8.1
clothing 8
home 8
happiness 7.8
soldier 7.8
singer 7.8
life 7.8
corporate 7.7
military 7.7
war 7.7
attractive 7.7
businesspeople 7.6
rifle 7.4
performer 7.4
device 7.2
hair 7.1
face 7.1

Google
created on 2018-05-11

photograph 95.5
black and white 92
monochrome photography 83.3
snapshot 81.8
standing 80.9
vintage clothing 75.9
monochrome 66.9
gentleman 59.9
militia 54.7

Microsoft
created on 2018-05-11

person 99.7
outdoor 98.3
standing 81.4
gun 40.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Female, 99.9%
Calm 93.5%
Surprised 6.4%
Fear 5.9%
Sad 2.7%
Happy 2.3%
Angry 1.4%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 59-67
Gender Female, 100%
Confused 65.6%
Calm 26%
Fear 7.7%
Surprised 7.3%
Sad 2.3%
Angry 1.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Female, 94.2%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.3%
Confused 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 73
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Female
Woman
Hat
Car
Person 99.5%
Person 99.2%
Person 99.2%
Person 93.6%
Person 69.9%
Adult 99.5%
Adult 99.2%
Adult 99.2%
Male 99.5%
Man 99.5%
Female 99.2%
Female 99.2%
Woman 99.2%
Woman 99.2%
Hat 96.7%
Hat 92.1%
Hat 87.3%
Car 91.6%