Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg; Germany.: A Ball Team.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2667.4

Human Generated Data

Title

Social Settlements: Germany. Hamburg. Volksheim: Volksheim, Hamburg; Germany.: A Ball Team.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.7
Person 99.7
Person 99.1
Person 99.1
Person 98.6
Person 98.2
Person 97.6
Food 96.3
Meal 96.3
Person 95.6
Vacation 95.3
Person 94.4
Person 92.4
Person 92.3
Person 92.1
Person 89.7
Person 88.7
Leisure Activities 83.3
Person 82.5
Apparel 81.2
Clothing 81.2
Picnic 79.4
Face 79.2
People 77.2
Crowd 68.9
Musician 56
Musical Instrument 56
Plant 55.6
Grass 55.6

Clarifai
created on 2019-06-05

people 99.8
group together 99.5
adult 97.7
wear 97.4
many 96.9
man 96.4
group 95.7
several 94.4
woman 93.9
outfit 91.4
five 88.6
child 88.5
four 87.3
recreation 87.1
position 85.7
retro 83.8
sports equipment 83.6
baseball 81.9
uniform 81.7
athlete 81.5

Imagga
created on 2019-06-05

grunge 31.5
sand 29.7
vintage 26.4
old 25.8
art 24.2
antique 23.7
texture 22.2
aged 19.9
retro 19.6
ancient 19
flower 18.4
structure 18
decoration 16.9
design 16.9
frame 16.6
old fashioned 16.2
floral 16.2
soil 15.8
wallpaper 15.3
paper 15.3
graphic 14.6
stucco 14.3
travel 13.4
pattern 13
grain 12.9
mottled 12.7
decorative 12.5
silhouette 12.4
space 12.4
earth 12.3
landscape 11.9
grime 11.7
history 11.6
material 11.6
decay 11.6
stain 11.5
ornament 11.2
empty 11.2
drawing 11
ornate 11
leaf 10.9
cemetery 10.8
fracture 10.7
water 10.7
surface 10.6
obsolete 10.5
textured 10.5
damaged 10.5
grungy 10.4
card 10.3
brown 10.3
culture 10.2
tree 10.2
sea 10.2
worn 9.5
architecture 9.5
beach 9.4
ocean 9.1
effect 9.1
dirty 9
vacation 9
summer 9
wall 8.9
sky 8.9
smudged 8.9
scenic 8.8
symbol 8.7
crumpled 8.7
text 8.7
artistic 8.7
stone 8.7
parchment 8.6
aging 8.6
rusty 8.6
rough 8.2
style 8.2
border 8.1
painterly 7.9
holiday 7.9
color 7.8
faded 7.8
crack 7.7
postcard 7.7
sketch 7.6
element 7.4
tourism 7.4
greeting 7.4
backdrop 7.4
plant 7.4
letter 7.3
historic 7.3
artwork 7.3
scenery 7.2
religion 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

person 99.9
outdoor 99.4
old 99
clothing 98.4
posing 97.5
grass 97
smile 92.7
group 92.2
woman 90.3
man 89.6
player 87.3
standing 85.3
human face 85.1
black 82.5
people 63.7
white 63.6
vintage 43.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Surprised 45%
Confused 45.1%
Happy 45%
Angry 45.2%
Calm 45.9%
Sad 53.7%
Disgusted 45%

AWS Rekognition

Age 35-52
Gender Male, 51.9%
Happy 45%
Surprised 45.1%
Angry 45.2%
Sad 47.4%
Confused 45.1%
Disgusted 45.1%
Calm 52.1%

AWS Rekognition

Age 26-43
Gender Male, 52.6%
Sad 46.1%
Angry 45.1%
Calm 53.3%
Happy 45.2%
Disgusted 45.1%
Confused 45%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Female, 50.9%
Sad 50.4%
Angry 45.2%
Calm 48.7%
Confused 45.1%
Happy 45.3%
Surprised 45.2%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 46.5%
Calm 47.4%
Disgusted 45.2%
Happy 45.3%
Surprised 45.2%
Sad 50.3%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Disgusted 45.2%
Calm 46.6%
Surprised 45.1%
Angry 45.2%
Sad 52.5%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 20-38
Gender Male, 51.6%
Calm 52.4%
Surprised 45.4%
Disgusted 45.1%
Confused 45.3%
Sad 46.1%
Happy 45.4%
Angry 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.1%
Angry 45.3%
Surprised 45.1%
Disgusted 45.1%
Happy 45.1%
Calm 51.9%
Sad 47.3%
Confused 45.2%

AWS Rekognition

Age 19-36
Gender Male, 52%
Angry 45.2%
Calm 53.6%
Sad 46%
Confused 45.1%
Disgusted 45.1%
Happy 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.9%
Disgusted 45.2%
Calm 46.6%
Surprised 45.3%
Sad 45.8%
Confused 45.2%
Angry 45.2%
Happy 51.7%

AWS Rekognition

Age 35-52
Gender Male, 51.4%
Calm 50.9%
Disgusted 45.1%
Confused 45.2%
Angry 45.2%
Happy 45.2%
Sad 48.3%
Surprised 45.1%

AWS Rekognition

Age 27-44
Gender Male, 54.8%
Calm 53.9%
Angry 45.2%
Disgusted 45%
Sad 45.6%
Surprised 45.1%
Happy 45.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Sad 46.6%
Happy 45.1%
Surprised 45.1%
Disgusted 46%
Angry 46.8%
Calm 50.2%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 51.3%
Sad 46.7%
Surprised 45.2%
Disgusted 45.2%
Calm 52%
Happy 45.6%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54.4%
Surprised 45.1%
Confused 45.1%
Sad 45.7%
Disgusted 45.1%
Calm 53.7%
Angry 45.1%
Happy 45.2%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.2%
a vintage photo of a group of people posing for a picture 97.1%
a black and white photo of a group of people posing for the camera 96.5%