Human Generated Data

Title

Beginning his day, Specialist Five Thomas R. Katke pauses to help a school teacher line up her students for the daily flag raising ceremony. Katke often takes time out from his work in the village to help the teachers -- at the same time learning more about the people of Gadsden Village. (U. S. Army Photo)

Date

July 1967

People

Artist: Gordon W. Gahan, American 1945 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.108

Human Generated Data

Title

Beginning his day, Specialist Five Thomas R. Katke pauses to help a school teacher line up her students for the daily flag raising ceremony. Katke often takes time out from his work in the village to help the teachers -- at the same time learning more about the people of Gadsden Village. (U. S. Army Photo)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

July 1967

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 99.8
Person 99.8
Person 99.4
Person 99.4
Person 98.9
Person 98.6
Person 98.4
Person 98.4
Person 96.9
Person 95.4
People 87.1
Person 85
Clothing 82.9
Apparel 82.9
Person 81.7
Military 73.4
Military Uniform 73
Text 65.2
Person 64
Soldier 63.5
Urban 62.2
Poster 60.6
Advertisement 60.6
Kindergarten 59.2
Army 57.8
Armored 57.8
Kid 56.9
Child 56.9
Person 47.7
Person 46.8
Person 45.1

Clarifai
created on 2019-03-22

people 99.8
child 99.3
group 98.8
group together 96.6
adult 96.6
war 96.3
many 95.9
education 94.4
administration 94
man 90.9
boy 89.9
portrait 89.6
monochrome 89.5
school 88.4
woman 88.2
military 87.6
elementary school 86.9
several 86.7
leader 83.5
wear 82.7

Imagga
created on 2019-03-22

newspaper 62
product 46.9
creation 37.7
barbershop 28.6
shop 27.5
mercantile establishment 21.1
man 19.5
old 17.4
people 16.7
vintage 16.5
grunge 15.3
person 15.1
black 14.4
place of business 14
dirty 12.6
male 12.2
adult 11.7
antique 11.2
child 11.1
portrait 11
business 10.9
wall 10.3
nurse 10.2
decoration 10.1
daily 10.1
money 9.3
house 9.2
aged 9
drawing 9
texture 9
sign 9
retro 9
human 9
currency 9
family 8.9
pattern 8.9
urban 8.7
ancient 8.6
paper 8.6
poster 8.5
mother 8.4
design 8.4
window 8.4
building 8.3
city 8.3
paint 8.1
scene 7.8
men 7.7
kin 7.6
danger 7.3
history 7.2
interior 7.1
establishment 7

Google
created on 2019-03-22

Photograph 95.4
Text 85.2
Snapshot 82.9
Child 69.3
Photography 62.4
Photo caption 53.2

Microsoft
created on 2019-03-22

newspaper 98.8
text 95.3
outdoor 92.5
person 91.2
posing 79.7
school 37.9
boy 23.4
child 9.6
recreation 8.5
black and white 8.4
presentation 7.8
assembly 7.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Confused 46.3%
Disgusted 46.1%
Happy 45.3%
Calm 48.4%
Sad 45.7%
Angry 47.3%
Surprised 45.8%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Happy 54.7%
Sad 45%
Calm 45.2%
Confused 45%
Angry 45%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 4-9
Gender Male, 79.2%
Disgusted 0.2%
Confused 0.7%
Sad 95.3%
Surprised 0.3%
Calm 1.6%
Angry 1.8%
Happy 0.2%

AWS Rekognition

Age 4-7
Gender Female, 51.4%
Disgusted 45.3%
Sad 51.4%
Surprised 45.5%
Happy 45.4%
Calm 45.9%
Angry 45.8%
Confused 45.6%

AWS Rekognition

Age 10-15
Gender Female, 52.3%
Disgusted 45.1%
Angry 45.2%
Happy 45.2%
Confused 45.2%
Calm 45.3%
Sad 53.9%
Surprised 45.1%

AWS Rekognition

Age 11-18
Gender Female, 52.1%
Sad 54.7%
Angry 45.1%
Calm 45.1%
Disgusted 45%
Surprised 45%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50%
Angry 47.9%
Disgusted 45.3%
Confused 45.2%
Calm 45.6%
Surprised 45.3%
Sad 50.6%
Happy 45.1%

AWS Rekognition

Age 23-38
Gender Female, 54.5%
Confused 45.5%
Angry 45.5%
Sad 50.4%
Calm 47.6%
Disgusted 45.3%
Surprised 45.2%
Happy 45.6%

AWS Rekognition

Age 9-14
Gender Female, 54.9%
Happy 46.9%
Sad 46.3%
Disgusted 45.5%
Angry 47.4%
Calm 46.2%
Surprised 46.6%
Confused 46.1%

AWS Rekognition

Age 9-14
Gender Female, 51.9%
Angry 45.8%
Calm 46%
Disgusted 45.5%
Sad 51.5%
Happy 45.5%
Surprised 45.3%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Happy 49%
Sad 46.9%
Disgusted 45.9%
Angry 45.9%
Calm 46%
Surprised 45.9%
Confused 45.5%

AWS Rekognition

Age 9-14
Gender Female, 55%
Happy 45%
Disgusted 45.1%
Sad 54.5%
Angry 45.1%
Calm 45.2%
Confused 45.1%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Sad 49%
Disgusted 45.2%
Angry 45.5%
Calm 46.1%
Happy 48.4%
Confused 45.4%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Female, 53%
Happy 45.6%
Confused 45.4%
Disgusted 45.2%
Calm 45.7%
Angry 45.4%
Surprised 45.3%
Sad 52.4%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Calm 46.9%
Surprised 45.8%
Happy 46.2%
Sad 47%
Disgusted 45.7%
Angry 47.6%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Female, 50%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Sad 49.8%
Surprised 49.6%
Calm 50%
Disgusted 49.6%

AWS Rekognition

Age 38-59
Gender Female, 50.9%
Angry 46.1%
Sad 50.7%
Happy 45.4%
Disgusted 45.3%
Calm 46.9%
Confused 45.3%
Surprised 45.4%

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Poster 60.6%

Captions

Microsoft

a group of people posing for a photo 92.1%
a group of people posing for a photo in front of a newspaper 77.7%
a group of people posing for a photo in a newspaper 77.6%

Text analysis

Amazon

GADSDEN
LANG
ALABAMA
of
dan
VIETNAM
nhan
the
moi
&
is
bry
ve
My
thi
U.S.A
GADSDEN VIETNAM I LANG GADSDEN VIETNAM
Chis
ve moi phuong'a
& citi financed GADSDEN GANSDEN- ALABAMA
U.S.A My quce dien.
financed
itirens of ALABAMA do dau
rrillage bry the nhan dan thi xa
citi
do
suypported
quce
dien.
Chis is suypported LaNg nay duioe
duioe
nay
phuong'a
dau
rrillage
itirens
GANSDEN-
I
LaNg
xa

Google

GADSDEN
VIETNAMİLANG
nhân
dau
thi
ALABAMAm
U.S.Ave
mei
GADSDEN VIETNAMİLANG GADSDEN VIETNAM & financed by the nhân dàn thi o ALABAMAm qute do dau U.S.Ave mei nhuong dlitn
financed
the
dàn
qute
do
nhuong
dlitn
VIETNAM
&
by
o