Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)
Date

October 1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3195
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (medicine show, Huntingdon, Tennessee)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3195

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Person 99.4
Human 99.4
Helmet 99.2
Clothing 99.2
Apparel 99.2
Person 98.1
Person 96.6
Face 96.4
Person 95.4
Person 95.1
Person 94.4
Head 92.3
Person 85.8
Chair 81.1
Furniture 81.1
People 71.4
Coat 65.8
Suit 62.1
Overcoat 62.1
Photography 61.2
Photo 61.2
Text 61.1
Military 58.9
Military Uniform 58.9
Officer 58.9
Sculpture 56.8
Art 56.8
Finger 56.7
Man 55.2

Clarifai
created on 2023-10-30

people 100
two 98.9
monochrome 98.7
group 98.7
child 98.7
adult 98.4
portrait 98.3
group together 97.7
three 96.6
wear 96.5
four 93.8
woman 93.3
war 93.3
facial expression 93.2
man 93.1
several 91.9
music 91.5
street 89.9
offspring 89.3
veil 89.1

Imagga
created on 2022-05-28

wheelchair 51.4
machinist 38.2
chair 36
seat 26.9
man 24.2
people 24
helmet 22.4
person 20.8
furniture 16.7
adult 16.2
male 15.6
men 15.4
vehicle 15.3
safety 13.8
street 13.8
city 13.3
child 13.2
sport 13.1
conveyance 11.6
transportation 11.6
tricycle 11.2
outdoors 11.2
protection 10.9
wheeled vehicle 10.8
road 10.8
human 10.5
urban 10.5
stretcher 9.8
portrait 9.7
black 9.6
clothing 9.3
competition 9.1
activity 9
athlete 8.8
lifestyle 8.7
ancient 8.6
industry 8.5
outdoor 8.4
help 8.4
furnishing 8.1
family 8
equipment 8
smiling 8
women 7.9
disabled 7.9
soldier 7.8
warrior 7.8
litter 7.8
army 7.8
travel 7.7
old 7.7
uniform 7.3
speed 7.3
children 7.3
game 7.1
to 7.1

Google
created on 2022-05-28

Photograph 94.3
Facial expression 93.3
White 92.2
Black 90
Black-and-white 86.7
Style 84.1
Headgear 83.5
Adaptation 79.3
Smile 79
Monochrome photography 75.4
Snapshot 74.3
Vintage clothing 73.3
Monochrome 73.3
Child 72.8
Art 72.1
Toddler 68.2
Event 67
Personal protective equipment 66.2
Stock photography 65.7
Street 65.3

Microsoft
created on 2022-05-28

human face 98.1
person 97.4
clothing 96.1
text 95.9
smile 81.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Male, 99.5%
Sad 83.6%
Calm 55.3%
Surprised 6.3%
Fear 5.9%
Confused 5.7%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 94.2%
Fear 93.7%
Surprised 12.3%
Sad 3.9%
Confused 2.3%
Calm 1.3%
Disgusted 1.2%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 99.2%

Categories

Imagga

people portraits 68.5%
paintings art 30.6%

Captions

Microsoft
created on 2022-05-28

a group of people in uniform 85.9%
a man and a woman in a uniform 74.6%
a person in a uniform 74.5%