Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg, Germany.: Picnic
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2669.1

Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg, Germany.: Picnic

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2669.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 96.2
Human 96.2
Person 95.3
Art 93.3
Painting 93.3
Person 92.6
Room 88.6
Indoors 88.6
Classroom 88.6
School 88.6
Person 88.6
Person 85.8
Person 85.2
Kindergarten 83.4
Person 82.4
People 78.9
Person 76.3
Person 75.6
Person 75.2
Person 73.2
Person 70.6
Person 64.3
Crowd 60.8
Urban 59.9
Person 59.5
Person 59.4
Audience 58.8
Person 49.1

Clarifai
created on 2019-06-05

people 98.9
many 98.2
group 96.9
adult 92
group together 90.7
man 90.1
no person 90.1
retro 86.3
texture 85.7
desktop 84.6
several 82.8
sepia 81
wear 80.4
leader 79
vintage 77.3
crowd 73.4
old 71.5
military 69.4
nature 68.7
art 68.7

Imagga
created on 2019-06-05

texture 41
pattern 40.3
textured 34.2
material 30.4
old 26.5
grunge 23.8
wall 23
surface 22.9
rough 21
aged 20.8
wallpaper 20.7
backgrounds 20.3
backdrop 19.8
vintage 19
dirty 19
paper 18.9
weathered 18
design 17.4
art 16.8
antique 14.9
brown 14.7
detail 14.5
retro 13.9
tile 13.9
close 13.7
ancient 13
metal 12.9
paint 12.7
gray 12.6
structure 12.4
canvas 12.3
closeup 12.1
chandelier 12.1
metallic 12
worn 11.5
grungy 11.4
damask 11.3
architecture 10.9
rust 10.6
stained 10.6
reflection 10.6
obsolete 10.5
damaged 10.5
stucco 10.3
mosaic 10.2
lighting fixture 9.7
motif 9.7
decay 9.6
stain 9.6
stone 9.6
construction 9.4
glass 9.2
flower 9.2
color 8.9
silver 8.8
fabric 8.7
burnt 8.7
crumpled 8.7
liquid 8.7
aging 8.6
block 8.6
seamless 8.6
grain 8.5
sheet 8.5
steel 8
shiny 7.9
torn 7.7
messy 7.7
floral 7.7
rusty 7.6
textile 7.6
clean 7.5
decorative 7.5
iron 7.5
crystal 7.4
light 7.4
note 7.3
effect 7.3
industrial 7.3
fixture 7.3
border 7.2
shape 7.2
building 7.2
wet 7.2

Google
created on 2019-06-05

People 94.1
Crowd 69.2

Microsoft
created on 2019-06-05

person 98.5
clothing 96.9
man 88.3
black 78.4
human face 70.8
old 67.5
white 62.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 52.4%
Disgusted 47.9%
Confused 45.4%
Surprised 45.2%
Calm 50%
Happy 45.6%
Angry 45.6%
Sad 45.3%

AWS Rekognition

Age 57-77
Gender Female, 52%
Disgusted 45.1%
Sad 52.8%
Calm 46.3%
Happy 45.2%
Confused 45.1%
Surprised 45.1%
Angry 45.4%

AWS Rekognition

Age 29-45
Gender Male, 50.9%
Confused 45.7%
Calm 49.2%
Happy 45.2%
Surprised 45.6%
Sad 47.4%
Angry 46.3%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Female, 50.9%
Disgusted 45.4%
Confused 45.2%
Happy 45.3%
Calm 51.7%
Surprised 45.2%
Sad 46.9%
Angry 45.3%

AWS Rekognition

Age 20-38
Gender Male, 53.6%
Happy 45%
Disgusted 45%
Confused 45.1%
Angry 46%
Surprised 45%
Sad 53.6%
Calm 45.1%

AWS Rekognition

Age 10-15
Gender Female, 50.7%
Angry 45.1%
Calm 54.6%
Sad 45.1%
Confused 45.1%
Disgusted 45.1%
Happy 45%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Female, 51.3%
Disgusted 45.5%
Happy 45.1%
Sad 53%
Angry 45.3%
Calm 45.4%
Confused 45.5%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.4%
Sad 53.2%
Confused 45.1%
Angry 45.8%
Happy 45.7%
Calm 45.1%
Surprised 45.1%
Disgusted 45%

AWS Rekognition

Age 17-27
Gender Female, 51.2%
Angry 47.9%
Calm 47.3%
Sad 48.3%
Disgusted 45.6%
Happy 45.1%
Confused 45.3%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.7%
Sad 46.7%
Surprised 45.1%
Angry 45.2%
Disgusted 45.2%
Confused 45.2%
Happy 46.6%
Calm 50.9%

AWS Rekognition

Age 27-44
Gender Female, 51.2%
Confused 45.2%
Sad 52.5%
Angry 46.5%
Disgusted 45.1%
Calm 45.5%
Surprised 45.1%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Male, 51.8%
Calm 45.8%
Sad 50.7%
Happy 45.1%
Angry 48%
Disgusted 45.1%
Confused 45.3%
Surprised 45.1%

AWS Rekognition

Age 45-63
Gender Male, 54%
Angry 45.6%
Happy 45.2%
Disgusted 45.3%
Confused 45.2%
Surprised 45.2%
Sad 47%
Calm 51.5%

AWS Rekognition

Age 26-43
Gender Female, 51.8%
Confused 45%
Sad 54.8%
Angry 45.1%
Disgusted 45%
Calm 45.1%
Surprised 45%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Confused 45.5%
Calm 46.5%
Angry 45.6%
Sad 47.5%
Happy 49.3%
Disgusted 45.3%
Surprised 45.3%

AWS Rekognition

Age 30-47
Gender Female, 50.7%
Disgusted 45.2%
Confused 45.1%
Angry 45.1%
Calm 54.2%
Surprised 45.2%
Happy 45.1%
Sad 45.1%

AWS Rekognition

Age 10-15
Gender Female, 50.5%
Surprised 45%
Confused 45.1%
Happy 45%
Angry 45.4%
Calm 45.2%
Sad 54.2%
Disgusted 45.1%

AWS Rekognition

Age 14-25
Gender Female, 52%
Disgusted 45.1%
Calm 45.2%
Surprised 45%
Angry 45.3%
Sad 54.4%
Confused 45%
Happy 45%

AWS Rekognition

Age 26-43
Gender Female, 52%
Calm 45%
Confused 45.1%
Sad 53.7%
Angry 46%
Happy 45%
Disgusted 45.1%
Surprised 45%

AWS Rekognition

Age 35-53
Gender Female, 51.2%
Sad 48.9%
Happy 45.6%
Calm 49.5%
Surprised 45.3%
Angry 45.5%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 50.2%
Angry 45.1%
Calm 54.4%
Sad 45.1%
Confused 45.1%
Disgusted 45.1%
Happy 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Female, 53.6%
Angry 45.2%
Surprised 45.2%
Disgusted 45.1%
Happy 52.7%
Calm 45.6%
Sad 46.1%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Male, 52.7%
Calm 52%
Disgusted 45%
Confused 45.1%
Happy 45.1%
Angry 45.1%
Surprised 45.1%
Sad 47.7%

AWS Rekognition

Age 12-22
Gender Female, 52.8%
Disgusted 45.1%
Calm 45.2%
Angry 45.3%
Sad 53.7%
Happy 45.1%
Surprised 45.2%
Confused 45.3%

AWS Rekognition

Age 19-36
Gender Female, 52.5%
Happy 45.3%
Surprised 45.2%
Angry 45.3%
Sad 48.7%
Confused 45.2%
Disgusted 45.1%
Calm 50.3%

AWS Rekognition

Age 15-25
Gender Female, 50.3%
Sad 45.8%
Confused 45.2%
Calm 50.7%
Disgusted 45.4%
Happy 45.1%
Angry 47.6%
Surprised 45.2%

AWS Rekognition

Age 35-53
Gender Male, 54.3%
Disgusted 45%
Sad 45.1%
Surprised 45.1%
Calm 54.5%
Angry 45.1%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 48-68
Gender Female, 54.7%
Confused 45.2%
Calm 50.5%
Disgusted 45.9%
Happy 46.8%
Angry 45.4%
Sad 46%
Surprised 45.2%

AWS Rekognition

Age 38-57
Gender Male, 50.6%
Disgusted 45.7%
Happy 50.6%
Confused 45.2%
Sad 45.8%
Angry 45.7%
Surprised 45.5%
Calm 46.5%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Calm 51%
Surprised 45.3%
Disgusted 46%
Confused 45.2%
Happy 45.2%
Angry 46.2%
Sad 46.2%

AWS Rekognition

Age 30-47
Gender Male, 52.6%
Confused 45.1%
Calm 53.5%
Angry 45.3%
Sad 45.4%
Happy 45.1%
Disgusted 45.3%
Surprised 45.2%

AWS Rekognition

Age 17-27
Gender Female, 54.8%
Surprised 45.2%
Calm 47.1%
Happy 45.2%
Sad 51.2%
Angry 45.6%
Confused 45.1%
Disgusted 45.6%

AWS Rekognition

Age 35-52
Gender Female, 53.3%
Calm 49.7%
Happy 45.9%
Surprised 45.3%
Sad 48.3%
Angry 45.4%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 15-25
Gender Male, 51.1%
Angry 45.2%
Happy 45.1%
Surprised 45.1%
Calm 49.1%
Confused 45.2%
Sad 50.3%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Sad 46.3%
Disgusted 45.3%
Angry 46.1%
Surprised 45.3%
Calm 51.5%
Confused 45.4%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Female, 52.6%
Sad 50.2%
Surprised 45.5%
Angry 45.8%
Disgusted 45.7%
Confused 45.3%
Happy 45.1%
Calm 47.3%

AWS Rekognition

Age 15-25
Gender Female, 54.6%
Surprised 45.3%
Happy 46%
Sad 50.5%
Calm 46.3%
Confused 45.2%
Disgusted 45.4%
Angry 46.2%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Angry 45.8%
Disgusted 45.4%
Confused 45.1%
Calm 45.2%
Happy 45.7%
Surprised 45.1%
Sad 52.7%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Sad 54.1%
Angry 45.1%
Calm 45.2%
Happy 45.3%
Disgusted 45%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 49-69
Gender Female, 54.6%
Calm 47%
Confused 45.7%
Happy 49%
Sad 46%
Surprised 45.9%
Disgusted 45.6%
Angry 45.8%

AWS Rekognition

Age 48-68
Gender Female, 51.8%
Happy 45.3%
Calm 45.2%
Confused 45.1%
Disgusted 46.3%
Surprised 45.2%
Angry 45.7%
Sad 52.2%

AWS Rekognition

Age 16-27
Gender Female, 54.1%
Angry 45.2%
Disgusted 45.1%
Sad 53.7%
Confused 45.1%
Happy 45.2%
Surprised 45.1%
Calm 45.7%

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Sad 54.1%
Calm 45.1%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Angry 45.4%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 45.1%
Disgusted 45%
Confused 45.1%
Calm 45%
Happy 53.6%
Surprised 45.1%
Sad 46.1%

AWS Rekognition

Age 20-38
Gender Female, 53.3%
Sad 46.7%
Happy 45.2%
Calm 51.6%
Surprised 45.3%
Angry 45.7%
Disgusted 45.2%
Confused 45.3%

AWS Rekognition

Age 26-44
Gender Female, 52.1%
Disgusted 45.3%
Sad 48.7%
Calm 45.2%
Happy 45.1%
Confused 45.1%
Surprised 45.1%
Angry 50.5%

AWS Rekognition

Age 12-22
Gender Female, 54.2%
Calm 45.4%
Angry 45.6%
Confused 45.2%
Sad 51.3%
Happy 47%
Disgusted 45.3%
Surprised 45.2%

AWS Rekognition

Age 19-36
Gender Female, 54.4%
Calm 45.1%
Disgusted 45.1%
Surprised 45.2%
Sad 53.8%
Happy 45.6%
Angry 45.2%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Female, 50.8%
Happy 45.5%
Surprised 45.2%
Angry 45.3%
Sad 52.1%
Confused 45.2%
Calm 46.6%
Disgusted 45.2%

AWS Rekognition

Age 57-77
Gender Female, 52.3%
Sad 45.1%
Confused 45.1%
Angry 45.5%
Surprised 45.2%
Happy 45.1%
Calm 46.7%
Disgusted 52.4%

AWS Rekognition

Age 35-52
Gender Female, 51%
Sad 45.1%
Surprised 45%
Calm 54.6%
Happy 45%
Disgusted 45%
Confused 45%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 52.7%
Disgusted 45.8%
Surprised 45.4%
Confused 45.4%
Sad 49.4%
Angry 47.2%
Calm 45.6%
Happy 46.2%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Disgusted 46%
Sad 50.3%
Surprised 45.5%
Calm 45.9%
Angry 46.1%
Happy 45.7%
Confused 45.5%

AWS Rekognition

Age 35-52
Gender Female, 51.1%
Happy 50.5%
Calm 45.6%
Confused 45.1%
Disgusted 45.1%
Surprised 45.2%
Angry 45.4%
Sad 48.2%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Sad 53%
Happy 45.1%
Surprised 45.1%
Disgusted 45.4%
Angry 45.3%
Calm 46%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 51%
Sad 48.7%
Disgusted 45.1%
Surprised 45.1%
Happy 45.1%
Confused 45.3%
Angry 45.4%
Calm 50.3%

AWS Rekognition

Age 26-44
Gender Female, 54.5%
Confused 45.1%
Angry 45.2%
Calm 45.1%
Disgusted 45.2%
Sad 53.7%
Happy 45.5%
Surprised 45.1%

AWS Rekognition

Age 45-66
Gender Female, 52.6%
Calm 45.8%
Disgusted 48.3%
Confused 45.3%
Angry 46.2%
Happy 45.4%
Sad 48.7%
Surprised 45.4%

AWS Rekognition

Age 4-9
Gender Female, 54.4%
Happy 46.4%
Disgusted 45.3%
Confused 45.9%
Angry 45.5%
Surprised 45.7%
Sad 48.4%
Calm 47.9%

AWS Rekognition

Age 29-45
Gender Female, 54.3%
Sad 48.2%
Surprised 45.6%
Angry 45.5%
Disgusted 45.7%
Confused 45.6%
Happy 48.8%
Calm 45.7%

AWS Rekognition

Age 11-18
Gender Male, 53.3%
Happy 45.1%
Angry 45.7%
Disgusted 48%
Confused 45.5%
Sad 47%
Calm 48.4%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54%
Calm 45.5%
Surprised 45.6%
Disgusted 47.2%
Confused 45.6%
Sad 47.8%
Happy 47.2%
Angry 46.1%

AWS Rekognition

Age 35-52
Gender Female, 54.3%
Disgusted 45.5%
Sad 49.8%
Surprised 45.3%
Calm 48.4%
Angry 45.6%
Happy 45.3%
Confused 45.2%

AWS Rekognition

Age 48-68
Gender Male, 54.3%
Surprised 45%
Confused 45.1%
Sad 45.7%
Disgusted 45.1%
Calm 53.3%
Angry 45.2%
Happy 45.7%

AWS Rekognition

Age 45-63
Gender Female, 54.3%
Surprised 45.3%
Happy 47.2%
Sad 48.3%
Calm 47.5%
Confused 45.3%
Disgusted 46%
Angry 45.4%

AWS Rekognition

Age 15-25
Gender Female, 54.6%
Sad 51.1%
Disgusted 45.2%
Angry 45.4%
Surprised 45.2%
Calm 47.4%
Confused 45.2%
Happy 45.6%

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Sad 49.7%
Disgusted 49.6%
Confused 49.6%
Angry 49.6%
Happy 49.8%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Female, 52.8%
Sad 50.2%
Confused 45.2%
Angry 46.6%
Surprised 45.5%
Happy 45.2%
Calm 46.4%
Disgusted 45.9%

AWS Rekognition

Age 35-55
Gender Female, 51.3%
Angry 45.8%
Disgusted 45.3%
Sad 46.4%
Confused 45.3%
Happy 45.4%
Surprised 45.5%
Calm 51.3%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 49.5%
Calm 49.6%
Disgusted 49.6%
Happy 50%
Confused 49.6%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Male, 52.6%
Disgusted 45.9%
Confused 45.6%
Angry 46.5%
Sad 49.3%
Surprised 45.8%
Happy 46.2%
Calm 45.7%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.8%
Confused 49.5%
Sad 50%
Disgusted 49.6%

AWS Rekognition

Age 26-43
Gender Male, 52.1%
Angry 46.5%
Disgusted 45.2%
Sad 53.2%
Confused 45.1%
Happy 45%
Surprised 45%
Calm 45%

AWS Rekognition

Age 48-68
Gender Male, 54.2%
Sad 46%
Happy 45.5%
Surprised 45.2%
Disgusted 45.2%
Angry 48.3%
Calm 49.8%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 50.1%
Disgusted 49.5%
Surprised 49.5%
Happy 49.6%
Confused 49.6%
Angry 49.6%
Calm 49.7%

AWS Rekognition

Age 60-80
Gender Female, 54.2%
Calm 45.5%
Disgusted 46.8%
Surprised 45.8%
Sad 48.5%
Happy 46.8%
Angry 46.3%
Confused 45.4%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Happy 49.6%
Surprised 49.5%
Angry 49.6%
Sad 50.1%
Confused 49.5%
Calm 49.6%
Disgusted 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Angry 46.3%
Calm 48.9%
Sad 49.1%
Confused 45.2%
Disgusted 45.2%
Happy 45.1%
Surprised 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.5%
Surprised 49.6%
Disgusted 49.7%
Calm 49.7%
Happy 49.8%
Confused 49.6%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Sad 49.6%
Calm 49.5%
Disgusted 50.1%
Happy 49.6%
Confused 49.6%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 48-68
Gender Female, 51.8%
Calm 50.9%
Disgusted 46.1%
Confused 45.3%
Happy 45.4%
Angry 46.8%
Surprised 45.2%
Sad 45.3%

AWS Rekognition

Age 19-36
Gender Female, 53.1%
Disgusted 45.6%
Calm 48.1%
Surprised 45.5%
Sad 48.5%
Confused 45.7%
Angry 46.1%
Happy 45.5%

AWS Rekognition

Age 26-43
Gender Female, 53.5%
Confused 45.7%
Calm 46.7%
Angry 46%
Sad 50.7%
Happy 45.2%
Disgusted 45.4%
Surprised 45.4%

AWS Rekognition

Age 20-38
Gender Male, 53.6%
Surprised 45.6%
Calm 48.6%
Happy 45.8%
Sad 48%
Angry 45.8%
Confused 45.7%
Disgusted 45.5%

AWS Rekognition

Age 35-53
Gender Female, 51.9%
Confused 45.7%
Angry 47.5%
Surprised 45.9%
Sad 46.5%
Disgusted 46.5%
Calm 47.4%
Happy 45.7%

AWS Rekognition

Age 57-77
Gender Female, 54.7%
Disgusted 47.8%
Calm 46.1%
Surprised 45.8%
Sad 46.6%
Confused 45.6%
Angry 46.8%
Happy 46.3%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Angry 45.8%
Happy 46.9%
Disgusted 46.6%
Sad 47.1%
Confused 45.5%
Calm 47.4%
Surprised 45.7%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.2%
Painting 93.3%

Categories

Imagga

food drinks 50.6%
paintings art 35.4%
interior objects 4.7%
beaches seaside 3.2%
nature landscape 3.1%
macro flowers 1.7%

Text analysis

Google

WAM
WAM