Human Generated Data

Title

Untitled (men in group called Knights of Pythias at funeral)

Date

c. 1903

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21943

Human Generated Data

Title

Untitled (men in group called Knights of Pythias at funeral)

People

Artist: Hamblin Studio, American active 1930s

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Advertisement 99.6
Poster 99.6
Person 99.2
Human 99.2
Person 98.9
Person 98.5
Person 98.4
Person 97.1
Person 96.2
Sailor Suit 90.1
Military 85.8
People 84
Officer 83
Military Uniform 83
Person 82.1
Person 81.8
Person 79.3
Person 74.2
Person 73.9
Person 72.8
Painting 71.5
Art 71.5
Crowd 66.3
Person 61.3
Clothing 57.7
Apparel 57.7
Standing 57.2
Person 47.7
Person 41.6

Imagga
created on 2022-03-11

x-ray film 30.1
blackboard 29
structure 28.5
film 27.5
freight car 25.3
billboard 24
car 18.9
signboard 18.6
photographic paper 18.3
grunge 16.2
vintage 15.7
wheeled vehicle 15.7
black 15
art 14.4
brass 14.1
memorial 14
old 13.9
landscape 12.6
texture 12.5
design 12.4
photographic equipment 12.2
winter 11.9
graphic 11.7
equipment 11
pattern 10.9
water 10.7
ice 10.2
tree 10
paint 10
snow 9.9
vehicle 9.7
antique 9.5
decoration 9.3
dirty 9
retro 9
mountain 8.9
symbol 8.7
light 8.7
architecture 8.6
grungy 8.5
frame 8.3
sky 8.3
liquid crystal display 8.2
border 8.1
text 7.9
color 7.8
space 7.8
cold 7.7
travel 7.7
collage 7.7
dark 7.5
city 7.5
ocean 7.5
building 7.4
letter 7.3
business 7.3
drop 7.2
aged 7.2
scenery 7.2
bright 7.1
night 7.1
season 7

Google
created on 2022-03-11

Standing 86.4
Font 81.3
Art 73.8
History 67.7
Vintage clothing 66.3
Event 64.7
Visual arts 64.3
Room 62.6
Uniform 61.2
Monochrome 58.9
Paper product 56.1
Monochrome photography 55.5
Pattern 54.4
Rectangle 54.1
Paper 54
Team 51

Microsoft
created on 2022-03-11

text 100
black 89.1
old 87.8
white 80.5
standing 75.7
person 67.4
plaque 20.4

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 98%
Calm 96.4%
Happy 2%
Sad 0.5%
Disgusted 0.3%
Surprised 0.3%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Female, 86%
Happy 82.7%
Calm 14.3%
Surprised 1.1%
Sad 1.1%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 40-48
Gender Male, 92.3%
Happy 92.6%
Calm 4%
Surprised 1.4%
Sad 0.7%
Disgusted 0.4%
Fear 0.3%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Calm 45.7%
Happy 30.1%
Surprised 6.3%
Fear 5.1%
Confused 4.2%
Disgusted 3.4%
Sad 3%
Angry 2.1%

AWS Rekognition

Age 26-36
Gender Male, 96.7%
Calm 46.6%
Happy 46.2%
Disgusted 3.8%
Surprised 2.5%
Angry 0.4%
Confused 0.2%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 30-40
Gender Male, 90.7%
Happy 89.2%
Calm 5.3%
Sad 3.8%
Disgusted 0.7%
Angry 0.5%
Fear 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 81.2%
Confused 11.9%
Sad 2.7%
Disgusted 2%
Surprised 0.9%
Happy 0.8%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 18-24
Gender Male, 77.8%
Happy 66.4%
Sad 16.3%
Calm 8.2%
Angry 3.5%
Confused 1.8%
Disgusted 1.5%
Fear 1.3%
Surprised 1%

AWS Rekognition

Age 45-53
Gender Male, 91.4%
Calm 82.4%
Happy 10.1%
Disgusted 4%
Confused 1.4%
Sad 1%
Surprised 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 70.3%
Disgusted 7%
Confused 5.8%
Surprised 4.7%
Fear 4.1%
Sad 3.3%
Happy 3.2%
Angry 1.6%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Happy 40.4%
Calm 18.7%
Confused 11.1%
Fear 9.4%
Surprised 8%
Sad 7.3%
Disgusted 3.1%
Angry 2%

AWS Rekognition

Age 34-42
Gender Male, 87%
Calm 67.9%
Happy 14.1%
Disgusted 9.8%
Sad 4.7%
Fear 1.3%
Surprised 1%
Confused 0.6%
Angry 0.5%

AWS Rekognition

Age 33-41
Gender Female, 75.4%
Happy 65.7%
Calm 29%
Sad 2.7%
Surprised 1.1%
Fear 0.7%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99.6%
Person 99.2%
Painting 71.5%

Captions

Microsoft

a group of people standing in an old photo of a man 68.4%
a group of people in an old photo of a man 68.3%
an old photo of a group of people standing next to a book 57.9%

Text analysis

Amazon

OF
JAMES
JESSE
KNIGHTS
FUNERAL
CHURCH
GEORGE
WEST
FRANK
JOHN
WADE
ABEL
BERNSTEIN
CAS
20
EAST
JULIAN BERNSTEIN
DREWETT
JULIAN
WEST CHURCH EAST OF WINNFIELD 1903
1903
JUDGE
16
MIXON
JONES
19
MORRIS
MORRIS BERNSTEIN
W.
PORTER
AARON
10
R.C. JONES
PYTHIAS
12
WINNFIELD
R.C.
L.ALLEN.
8
AARON T. DREWETT
ASA L.ALLEN.
P. K. ABEL
WALLACE
17
IS
ASA
K.
C.P.
H.C.
W. M. WALLACE
12345
P.
IS JUDGE M. F. MACHEN.
R.L.TANNEHILL.
SHRW.
G.
MACHEN.
F.
T.
M.
7
WRIGHT.
JOHN G. TEAGLE.
14
13 CAS MOSS
WADE A. WRIGHT.
KNIGHTS OF PYTHIAS FUNERAL OF JAMES S. DoLOACH
12 JAMES T. WALLACE.
FRANK L. SHRW.
MOSS
R PORTER
C.P. MATHIS.
H.C. DUNN
KELLY,
JESSE J. MIXON
GEORGE A KELLY,
18
GEORGE P. LONG.
13
A.
TEAGLE.
6
MATHIS.
DUNN
R
//
LONG.
و
L.
WALLACE.
A
S.
DoLOACH
J.
CBM@PE

Google

KNIGHTS OF PYTHIAS FUNERAL OF JAMES S. DeLDACH, WEST CHURCH EAST OF WINNFIELD 1903. " GEORSE BERNSTEIN JUOGE
WEST
OF
CHURCH
GEORSE
KNIGHTS
EAST
1903.
BERNSTEIN
PYTHIAS
WINNFIELD
JUOGE
FUNERAL
JAMES
S.
DeLDACH,
"