Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Cologne. Lodging House and Men's Shelter: Salvation Army: Germany: Cologne.: Shelter for men, reading room.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2562.2

Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Cologne. Lodging House and Men's Shelter: Salvation Army: Germany: Cologne.: Shelter for men, reading room.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2562.2

Machine Generated Data

Tags

Amazon
created on 2019-06-04

School 100
Room 100
Indoors 100
Classroom 100
Human 96.1
Person 96.1
Person 94.5
Person 90.5
Person 88.4
Person 83.8
Person 82.2
Person 81.2
Person 79.4
Person 75
Furniture 68.3
Chair 68.3
Painting 67.1
Art 67.1
Person 51.5

Clarifai
created on 2019-06-04

people 100
many 99.3
group 99.2
adult 99.1
group together 98.1
man 97.1
leader 96.8
administration 95.6
wear 93.7
war 93.2
military 92.8
woman 92.7
several 92.2
furniture 89.7
chair 88.5
offense 86.4
uniform 83.4
sit 81
child 80
room 79.8

Imagga
created on 2019-06-04

old 51.6
grunge 47.7
vintage 47.5
texture 42.4
aged 40.7
antique 36.7
wall 32.6
wallpaper 29.9
paper 28.6
material 26.8
brown 25
ancient 23.3
rough 22.8
grungy 22.8
dirty 22.6
pattern 21.9
retro 21.3
textured 21
decay 20.3
art 20.1
panel 19.4
rusty 19
weathered 19
canvas 18
backgrounds 17.8
surface 17.6
jigsaw puzzle 17.3
empty 17.2
damaged 17.2
structure 17.1
design 16.9
aging 16.3
paint 15.4
frame 15
architecture 14.8
puzzle 14.8
grain 14.8
detail 14.5
stain 14.4
worn 14.3
graphic 13.9
parchment 13.4
backdrop 13.2
map 13.1
grime 12.7
rust 12.5
stained 12.5
artistic 12.2
stucco 11.8
border 11.8
fracture 11.7
cardboard 11.5
obsolete 11.5
game 11.5
yellow 11.3
document 11.1
letter 11
ragged 10.7
mottled 10.7
tile 10.7
color 10.6
textures 10.4
sheet 10.3
blank 10.3
construction 10.3
page 10.2
blackboard 10.1
burnt 9.7
crumpled 9.7
metal 9.7
detailed 9.6
rustic 9.6
stone 9.4
building 9.3
wood 9.2
room 8.8
faded 8.8
crack 8.7
torn 8.7
edge 8.7
space 8.5
decorative 8.3
historic 8.2
hall 8.1
classroom 8.1
painterly 7.9
smudged 7.9
text 7.9
pages 7.8
scratch 7.8
stains 7.8
beige 7.7
flower 7.7
spot 7.7
concrete 7.7
floral 7.7
chandelier 7.5
effect 7.3
industrial 7.3

Google
created on 2019-06-04

Photograph 95.7
Snapshot 83.3

Microsoft
created on 2019-06-04

clothing 98.1
person 98
old 86.4
human face 82.2
man 70.2
smile 57.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-38
Gender Male, 69.6%
Sad 29.5%
Surprised 6.5%
Angry 7.4%
Disgusted 17.6%
Confused 15.6%
Happy 15.1%
Calm 8.4%

AWS Rekognition

Age 38-59
Gender Male, 53.3%
Disgusted 46.2%
Sad 45.1%
Surprised 45.1%
Calm 53%
Angry 45.4%
Happy 45.1%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 52.9%
Disgusted 47.8%
Calm 45.8%
Surprised 45.3%
Sad 48.6%
Confused 45.3%
Angry 46.8%
Happy 45.4%

AWS Rekognition

Age 26-44
Gender Male, 52.2%
Calm 45.6%
Sad 49%
Happy 45.9%
Angry 45.4%
Disgusted 45.4%
Confused 45.3%
Surprised 48.3%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Sad 46.4%
Disgusted 45.1%
Surprised 45.1%
Angry 46.6%
Happy 45.2%
Calm 51.4%
Confused 45.2%

AWS Rekognition

Age 29-45
Gender Female, 51.6%
Disgusted 47.4%
Surprised 45.5%
Confused 45.3%
Sad 46.1%
Angry 46.2%
Calm 49.3%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54%
Disgusted 45.2%
Surprised 45.2%
Confused 45.2%
Sad 45.7%
Angry 45.4%
Calm 53.2%
Happy 45%

AWS Rekognition

Age 45-63
Gender Male, 51.9%
Sad 48.8%
Angry 46.3%
Calm 46.9%
Happy 45.2%
Disgusted 46.8%
Confused 45.4%
Surprised 45.6%

AWS Rekognition

Age 35-52
Gender Male, 50.5%
Surprised 45.4%
Confused 45.7%
Sad 48.6%
Disgusted 45.9%
Calm 47.4%
Angry 45.9%
Happy 46.1%

AWS Rekognition

Age 29-45
Gender Male, 52.7%
Happy 45.3%
Angry 46.9%
Disgusted 45.2%
Confused 45.1%
Sad 47.5%
Calm 49.7%
Surprised 45.2%

AWS Rekognition

Age 45-65
Gender Male, 52%
Surprised 45.1%
Happy 45.3%
Sad 53.5%
Calm 45.2%
Confused 45.1%
Disgusted 45.4%
Angry 45.3%

AWS Rekognition

Age 26-43
Gender Female, 50.9%
Calm 49.7%
Disgusted 47.6%
Angry 45.7%
Sad 45.4%
Happy 45.1%
Confused 45.4%
Surprised 46.1%

AWS Rekognition

Age 48-68
Gender Female, 53%
Sad 45.8%
Surprised 45.3%
Disgusted 51.2%
Calm 46.6%
Happy 45.2%
Confused 45.2%
Angry 45.7%

AWS Rekognition

Age 26-43
Gender Male, 51.7%
Sad 48.8%
Calm 47.7%
Disgusted 45.3%
Happy 45.4%
Confused 45.5%
Angry 47%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 53.2%
Calm 45.1%
Disgusted 45.1%
Angry 45.4%
Sad 53.9%
Happy 45.3%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 14-25
Gender Female, 53.5%
Disgusted 45%
Sad 45.1%
Surprised 45%
Calm 45%
Angry 45.1%
Happy 54.7%
Confused 45%

AWS Rekognition

Age 30-47
Gender Female, 52.8%
Disgusted 47%
Confused 45.4%
Angry 45.8%
Calm 49.7%
Surprised 46.5%
Happy 45.2%
Sad 45.5%

AWS Rekognition

Age 38-59
Gender Female, 51%
Sad 48.7%
Surprised 45.3%
Calm 45.4%
Happy 45.4%
Disgusted 48%
Confused 45.3%
Angry 47%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Surprised 45.7%
Confused 46.2%
Happy 45.1%
Angry 45.7%
Calm 45.4%
Sad 51.4%
Disgusted 45.6%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Confused 45.4%
Disgusted 51%
Sad 45.6%
Surprised 45.3%
Calm 45.4%
Happy 45.2%
Angry 47.2%

AWS Rekognition

Age 26-43
Gender Female, 53.1%
Happy 45.1%
Surprised 45.1%
Angry 45.3%
Sad 53.2%
Confused 45.2%
Calm 46.1%
Disgusted 45.1%

AWS Rekognition

Age 26-44
Gender Female, 53.6%
Confused 45.1%
Angry 45.2%
Calm 45.6%
Disgusted 45.1%
Sad 52.3%
Happy 46.7%
Surprised 45.1%

Microsoft Cognitive Services

Age 30
Gender Male

Feature analysis

Amazon

Person 96.1%
Chair 68.3%
Painting 67.1%

Categories

Imagga

interior objects 99.4%

Captions

Microsoft
created on 2019-06-04

a vintage photo of a person 70.8%
a vintage photo of some people 70.7%
an old photo of a person 70.5%

Text analysis

Amazon

$3

Google

EN
EN