Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg; Germany.: Groups of Young Men's Clubs.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2665.4

Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg; Germany.: Groups of Young Men's Clubs.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2665.4

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.8
Human 99.8
Person 99.5
Person 99.3
Person 99.3
Person 99.2
Person 99.2
Person 99.1
Person 99
Person 98.5
Person 98.4
Person 97.7
Person 93.4
Apparel 90.4
Clothing 90.4
Person 89.4
People 76.7
Art 73.1
Painting 73.1
Dog 67.3
Animal 67.3
Pet 67.3
Canine 67.3
Mammal 67.3
Soil 66.6
Hunting 63.9
Wood 63.7
Standing 60.2
Duel 57.3
Ground 57.2

Clarifai
created on 2019-06-05

people 99.9
group together 99.5
group 99.2
many 98.9
adult 98.2
man 96.7
wear 96.5
several 94.8
leader 93.6
child 92.7
outfit 90.3
woman 89.7
administration 88.7
military 87.4
retro 86.7
war 85.7
five 80.1
four 79.9
uniform 79.3
soldier 77.3

Imagga
created on 2019-06-05

cemetery 35.7
grunge 23.8
old 20.9
landscape 18.6
vintage 18.2
texture 18.1
outdoors 15.7
antique 15.6
ancient 15.6
dirty 15.4
people 14.5
aged 14.5
travel 14.1
structure 14.1
sand 14
grain 12.9
sky 12.8
field 12.5
silhouette 12.4
decoration 12.3
rural 12.3
grungy 12.3
space 11.6
art 11.6
black 11.4
country 11.4
group 11.3
scene 11.2
wall 11.2
grass 11.1
paper 11
tree 10.8
park 10.7
obsolete 10.5
pattern 10.3
rough 10
outdoor 9.9
scenery 9.9
backgrounds 9.7
crowd 9.6
rock 9.6
earth 9.5
old fashioned 9.5
desert 9.4
design 9
summer 9
person 8.9
material 8.9
brown 8.8
grime 8.8
scenic 8.8
forest 8.7
stain 8.6
men 8.6
damaged 8.6
winter 8.5
animal 8.3
tourism 8.2
national 8.2
farm 8
fence 8
smudged 7.9
text 7.9
male 7.8
color 7.8
fracture 7.8
geology 7.8
crumpled 7.8
snow 7.7
dirt 7.6
worn 7.6
farming 7.6
picket fence 7.6
dark 7.5
graffito 7.5
life 7.5
city 7.5
man 7.4
stone 7.4
retro 7.4
rustic 7.4
light 7.3
graphic 7.3
business 7.3
sun 7.2
day 7.1
surface 7.1
architecture 7

Google
created on 2019-06-05

Photograph 94.8
Team 64.1
Crew 61.7
Family 54.3

Microsoft
created on 2019-06-05

clothing 96.8
old 96.3
outdoor 94.1
man 91.1
posing 89.1
person 87.9
group 82.6
smile 81.8
black 73.4
vintage 36

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 50.8%
Angry 45.2%
Happy 45.5%
Disgusted 45.1%
Surprised 45.1%
Calm 45.4%
Confused 45.1%
Sad 53.8%

AWS Rekognition

Age 35-53
Gender Female, 52%
Confused 45.1%
Surprised 45.2%
Calm 49.9%
Angry 45.3%
Disgusted 45.4%
Happy 45.2%
Sad 48.9%

AWS Rekognition

Age 20-38
Gender Female, 51.2%
Sad 53.5%
Happy 45%
Calm 45.9%
Surprised 45.1%
Angry 45.2%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Male, 50.3%
Calm 45%
Angry 45%
Confused 45%
Sad 45%
Happy 54.9%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 35-52
Gender Male, 52.2%
Sad 46.4%
Happy 48.2%
Calm 47.2%
Surprised 45.7%
Angry 45.9%
Disgusted 45.6%
Confused 46%

AWS Rekognition

Age 26-44
Gender Female, 52.3%
Disgusted 45.4%
Sad 49.4%
Calm 46.3%
Happy 47.7%
Confused 45.5%
Surprised 45.4%
Angry 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.4%
Sad 47.1%
Surprised 45.5%
Calm 49.8%
Happy 45.3%
Disgusted 46.4%
Confused 45.2%
Angry 45.6%

AWS Rekognition

Age 17-27
Gender Female, 54.1%
Disgusted 45%
Sad 54.9%
Calm 45%
Happy 45%
Confused 45%
Surprised 45%
Angry 45%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Disgusted 45.5%
Calm 45.7%
Surprised 45.3%
Angry 45.5%
Sad 51.1%
Confused 46%
Happy 46%

AWS Rekognition

Age 35-52
Gender Female, 51%
Calm 51.8%
Disgusted 45.5%
Confused 45.2%
Happy 46.1%
Angry 45.4%
Surprised 45.4%
Sad 45.6%

AWS Rekognition

Age 35-52
Gender Male, 54.1%
Confused 45.2%
Disgusted 45.1%
Happy 45%
Calm 45.3%
Surprised 45%
Sad 45.5%
Angry 53.8%

AWS Rekognition

Age 35-53
Gender Female, 54%
Disgusted 45.9%
Surprised 45.7%
Confused 45.9%
Sad 48.8%
Angry 46.8%
Calm 46.4%
Happy 45.4%

AWS Rekognition

Age 57-77
Gender Male, 53.6%
Angry 45.3%
Happy 45.2%
Disgusted 45%
Sad 53.8%
Confused 45.1%
Calm 45.5%
Surprised 45.1%

AWS Rekognition

Age 38-59
Gender Male, 54.7%
Calm 52.9%
Happy 45.1%
Angry 45.3%
Sad 45.2%
Surprised 45.2%
Confused 45.2%
Disgusted 46.1%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Disgusted 45.3%
Sad 46.1%
Surprised 45.4%
Calm 45.9%
Angry 45.3%
Happy 51.7%
Confused 45.2%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.1%
Happy 49.7%
Disgusted 49.6%
Surprised 49.5%

AWS Rekognition

Age 27-44
Gender Male, 50.2%
Calm 49.9%
Happy 49.6%
Angry 49.5%
Sad 49.6%
Surprised 49.6%
Confused 49.7%
Disgusted 49.5%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 73.1%
Dog 67.3%

Categories

Imagga

paintings art 96.4%
interior objects 1.4%

Text analysis

Amazon

S3