Human Generated Data

Title

Coal Miners
Date

c. 1908, printed later
People

Artist: Lewis Wickes Hine, American 1874 - 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Walter Rosenblum, P1975.38

Human Generated Data

Title

Coal Miners

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

c. 1908, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Walter Rosenblum, P1975.38

Machine Generated Data

Tags

Amazon
created on 2023-08-30

Clothing 100
Face 99.9
Head 99.9
Photography 99.9
Portrait 99.9
Hat 99.8
People 99.7
Person 99.6
Adult 99.6
Male 99.6
Man 99.6
Person 99.4
Adult 99.4
Male 99.4
Man 99.4
Cap 99.4
Person 99.3
Adult 99.3
Male 99.3
Man 99.3
Jacket 99.1
Captain 93
Officer 93
Formal Wear 84.8
Suit 84.8
Coat 84.2
Overcoat 57.9
Baseball Cap 57.1
Accessories 56.8
Goggles 56.8
Military 56.1
Military Uniform 56.1
Glove 55.4

Clarifai
created on 2023-11-01

people 99.9
portrait 99.6
group together 99.4
group 98.9
man 97.8
adult 97.4
three 96.7
wear 95.1
leader 93.4
military 93.3
veil 93.1
uniform 91.3
outfit 91.2
five 90.8
administration 88.9
four 88.6
several 88.1
lid 86.9
two 85.1
many 84

Imagga
created on 2018-12-21

uniform 51.7
military uniform 51.2
man 51
male 47.5
clothing 42.2
person 38.3
covering 35.7
portrait 34.3
adult 34.3
black 29.4
mask 28.5
face 27
consumer goods 23.8
suit 23.7
handsome 23.2
businessman 22.9
professional 22.8
people 22.3
job 21.2
occupation 20.2
business 20
human 19.5
men 18.9
comedian 18
studio 17.5
guy 17.2
hat 16.8
one 16.4
head 15.9
disguise 15.9
smiling 15.9
happy 15.7
performer 15.6
helmet 15.4
worker 15.1
attractive 14.7
smile 14.2
jacket 14.1
look 14
safety 13.8
serious 13.3
work 13.3
success 12.9
security 12.9
looking 12.8
standing 12.2
bow tie 12.1
mature 12.1
expression 11.9
modern 11.9
confident 11.8
necktie 11.8
entertainer 11.7
dark 11.7
model 11.7
tie 11.4
corporate 11.2
hand 10.6
fashion 10.5
executive 10.1
sunglasses 9.9
officer 9.8
crime 9.7
collar 9.6
attendant 9.5
casual 9.3
alone 9.1
protection 9.1
danger 9.1
beard 8.9
cool 8.9
office 8.8
law 8.8
closeup 8.8
youth 8.5
color 8.3
fun 8.2
single 8.2
attire 8.2
commodity 7.9
happiness 7.8
middle aged 7.8
eyes 7.7
military 7.7
businesspeople 7.6
style 7.4
glasses 7.4
emotion 7.4
lifestyle 7.2

Google
created on 2018-12-21

photograph 95.6
black and white 89.7
snapshot 81.8
standing 80.5
male 80.3
monochrome photography 77.4
gentleman 77.4
military person 70.9
military officer 70.7
monochrome 65
crew 61.1
vintage clothing 60.8
human behavior 57.1
stock photography 52.6

Microsoft
created on 2018-12-21

person 98.8
outdoor 97.3
standing 77.7
posing 68.9
group 64.4
old 44.6
black and white 18.2
monochrome 7.2
retro 4.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 43-51
Gender Male, 100%
Confused 72.8%
Calm 17.1%
Surprised 6.5%
Fear 5.9%
Sad 4.3%
Angry 4.1%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Adult
Male
Man
Suit
Coat
Person 99.6%
Person 99.4%
Person 99.3%
Adult 99.6%
Adult 99.4%
Adult 99.3%
Male 99.6%
Male 99.4%
Male 99.3%
Man 99.6%
Man 99.4%
Man 99.3%
Suit 84.8%
Coat 84.2%