Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Salvation Army Work for Children: Salvation Army: Germany: Work with Children.: Creche of Hamburg.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2559.3

Human Generated Data

Title

Religious Agencies, Salvation Army: Germany. Salvation Army Work for Children: Salvation Army: Germany: Work with Children.: Creche of Hamburg.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2559.3

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Classroom 99.7
Indoors 99.7
School 99.7
Room 99.7
Human 98.8
Person 98.8
Person 98.4
Person 97.6
Person 96.8
Person 95.4
Person 95.3
Person 93.5
Person 93.1
Painting 92.7
Art 92.7
Person 91.3
Person 90.1
Person 90
Person 86.4
Person 81.6
Person 77.5
Person 77
Person 73.8
Person 72.2
Person 67
Jacuzzi 62.3
Hot Tub 62.3
Tub 62.3
People 59
Kindergarten 56.4

Clarifai
created on 2019-06-04

people 99.6
adult 96.5
group 95.9
wear 95.5
man 94.8
many 91.4
group together 87.5
retro 86.3
veil 85.1
woman 83.1
music 81.2
art 78.8
child 78.7
one 76
ceremony 68.3
leader 67.9
several 67.6
portrait 66.5
paper 65.9
outfit 64.7

Imagga
created on 2019-06-04

grunge 48.5
texture 47.2
old 44.6
aged 39.8
vintage 39.1
antique 35.4
wallpaper 31.4
pattern 27.3
dirty 27.1
material 26.8
surface 26.5
chandelier 24.5
design 24.2
stain 24
wall 22.7
art 22.7
decay 22.2
textured 21.9
canvas 21.8
paper 21.2
rough 21
grungy 20.9
aging 20.1
paint 19.9
retro 19.7
lighting fixture 19.6
rusty 19
structure 18.7
frame 18.3
border 18.1
flower 17.8
rust 17.3
effect 17.3
obsolete 17.2
weathered 17.1
ancient 16.4
tile 16.4
backgrounds 16.2
brown 16.2
floral 16.2
grain 15.7
grime 15.6
graphic 15.3
damaged 15.3
backdrop 14.8
smudged 14.8
fixture 14.7
mottled 14.6
fracture 14.6
stained 14.4
worn 14.3
style 14.1
painterly 13.8
detail 13.7
crack 13.6
detailed 13.5
color 13.3
textures 13.3
element 13.2
space 13.2
edge 12.5
artistic 12.2
map 11.5
metal 11.3
close 10.8
decoration 10.7
text 10.5
stucco 10.3
empty 10.3
world 9.7
crumpled 9.7
messy 9.7
dirt 9.5
blank 9.4
panel 9.3
yellow 9.3
rusted 8.8
album 8.8
torn 8.7
rustic 8.6
display 8.5
sheet 8.5
iron 8.4
page 8.3
decorative 8.3
metallic 8.3
artwork 8.2
global 8.2
industrial 8.2
plant 7.9
liquid 7.8
architecture 7.8
leaf 7.8
burnt 7.8
industry 7.7
parchment 7.7
spot 7.7
atlas 7.2
steel 7.1
creative 7.1

Google
created on 2019-06-04

Photograph 95.6
Snapshot 83.3
Class 68.9
Room 65.7
Family 53.7

Microsoft
created on 2019-06-04

person 98.7
human face 98.7
clothing 97.5
smile 89.5
girl 89
toddler 88.2
family 86.5
child 80.7
baby 79.4
boy 78.8
posing 78.7
old 77.1
woman 70.6
black 70.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 96.2%
Angry 2.5%
Calm 68.2%
Sad 24.1%
Confused 0.8%
Disgusted 1%
Happy 1%
Surprised 2.4%

AWS Rekognition

Age 4-9
Gender Female, 97.9%
Happy 8.8%
Disgusted 4%
Sad 8.6%
Confused 5.3%
Angry 2.5%
Surprised 6.3%
Calm 64.5%

AWS Rekognition

Age 1-5
Gender Female, 94.7%
Sad 93.5%
Happy 0.6%
Calm 2.2%
Surprised 0.9%
Angry 1.4%
Disgusted 0.5%
Confused 0.9%

AWS Rekognition

Age 2-5
Gender Female, 93.4%
Sad 54.4%
Happy 1.4%
Surprised 4.5%
Disgusted 2.5%
Angry 19.5%
Calm 12.3%
Confused 5.5%

AWS Rekognition

Age 4-7
Gender Female, 96.2%
Surprised 6.9%
Happy 2.2%
Confused 6.5%
Sad 37%
Calm 40.2%
Disgusted 1.7%
Angry 5.5%

AWS Rekognition

Age 14-23
Gender Male, 53.5%
Disgusted 45.2%
Sad 46.2%
Calm 48.1%
Happy 45.1%
Confused 45.7%
Surprised 45.5%
Angry 49.3%

AWS Rekognition

Age 4-9
Gender Female, 98.6%
Surprised 18.9%
Sad 28.8%
Happy 11%
Disgusted 5.3%
Confused 5.4%
Calm 25.8%
Angry 5%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Calm 53.4%
Disgusted 45.4%
Angry 45.2%
Sad 45.4%
Happy 45.2%
Confused 45.1%
Surprised 45.3%

AWS Rekognition

Age 4-9
Gender Female, 66.8%
Disgusted 3%
Happy 2.5%
Confused 3.6%
Sad 22.8%
Angry 4.5%
Surprised 4.4%
Calm 59.2%

AWS Rekognition

Age 35-55
Gender Female, 54.9%
Angry 45.1%
Happy 45.3%
Disgusted 45.1%
Confused 45.2%
Surprised 45.2%
Sad 45.8%
Calm 53.3%

AWS Rekognition

Age 10-15
Gender Female, 51.7%
Sad 46.4%
Disgusted 45.4%
Angry 45.4%
Surprised 46.1%
Calm 49.3%
Confused 45.8%
Happy 46.5%

AWS Rekognition

Age 11-18
Gender Female, 54.6%
Disgusted 45.3%
Sad 47%
Surprised 45.1%
Calm 45.3%
Angry 52.1%
Happy 45.1%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Confused 45.6%
Calm 46.6%
Happy 45.2%
Surprised 45.8%
Sad 50.8%
Angry 45.6%
Disgusted 45.3%

AWS Rekognition

Age 15-25
Gender Female, 53.6%
Calm 49.9%
Surprised 45.8%
Disgusted 45.3%
Confused 45.2%
Sad 48.1%
Happy 45.1%
Angry 45.6%

AWS Rekognition

Age 35-52
Gender Female, 51.7%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Calm 45.2%
Surprised 45.1%
Sad 54%
Angry 45.4%

AWS Rekognition

Age 4-9
Gender Female, 54.1%
Angry 45.8%
Disgusted 45.5%
Confused 45.6%
Calm 46.6%
Happy 45.8%
Surprised 46.7%
Sad 49.1%

AWS Rekognition

Age 6-13
Gender Female, 53.4%
Sad 45.8%
Disgusted 45.3%
Surprised 45.3%
Angry 45.3%
Happy 45.1%
Calm 53%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Female, 51.6%
Calm 48.4%
Sad 47.5%
Happy 45.1%
Angry 48%
Disgusted 45.2%
Confused 45.6%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.8%
Sad 50.2%
Confused 46.4%
Calm 46.4%
Disgusted 45.3%
Happy 45.1%
Angry 45.4%
Surprised 46.2%

AWS Rekognition

Age 1-5
Gender Female, 54.8%
Sad 47.4%
Angry 45.3%
Calm 46.1%
Happy 48.7%
Disgusted 45.7%
Confused 45.5%
Surprised 46.2%

AWS Rekognition

Age 35-53
Gender Female, 68.1%
Surprised 1.6%
Confused 1.8%
Sad 8.8%
Disgusted 3.5%
Calm 65.4%
Angry 18.3%
Happy 0.7%

AWS Rekognition

Age 6-13
Gender Female, 54.6%
Sad 47.9%
Angry 45.7%
Calm 48%
Confused 46%
Happy 45.8%
Surprised 45.9%
Disgusted 45.7%

AWS Rekognition

Age 23-38
Gender Female, 51.9%
Surprised 45.5%
Happy 46.1%
Sad 47.4%
Calm 49.1%
Confused 45.9%
Disgusted 45.3%
Angry 45.8%

AWS Rekognition

Age 26-43
Gender Female, 54.9%
Sad 45.9%
Disgusted 45.4%
Confused 46.4%
Angry 45.4%
Happy 46.6%
Surprised 48.2%
Calm 47.1%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 92.7%
Jacuzzi 62.3%

Categories

Imagga

interior objects 72.6%
paintings art 26.7%