Human Generated Data

Title

Social Settlements: Great Britain, England. London. "Bermondsey Settlement": Bermondsey Settlement, London, Eng.: Gymnastic Club.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2687.3

Human Generated Data

Title

Social Settlements: Great Britain, England. London. "Bermondsey Settlement": Bermondsey Settlement, London, Eng.: Gymnastic Club.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Person 99.2
Person 98.5
Person 98.1
Person 98
Person 97.9
Person 95.3
Person 93.3
People 93
Person 92.9
Boy 92.7
Person 88.8
Person 88
Person 85.1
Person 85.1
Person 82.2
Person 81.5
Person 78.2
Team 72.2
Person 68.7
Person 67.2
Person 67.1
Person 65.8
Person 65.3
Person 64.8
Team Sport 62.9
Sports 62.9
Sport 62.9
Indoors 61
Room 61
Person 58
School 57.2
Classroom 57.2
Apparel 56.1
Shorts 56.1
Clothing 56.1
Chair 55.4
Furniture 55.4
Sailor Suit 55.1
Person 48.2
Person 48

Clarifai
created on 2019-06-05

people 99.1
adult 94.2
man 92.5
group together 92.3
many 89
group 89
crowd 86.1
woman 85.5
audience 85.5
retro 84
desktop 76.4
spectator 74.6
vintage 70.3
boy 66.6
competition 65.2
child 64.4
league 63.1
portrait 62.6
baseball 61.7
music 61.4

Imagga
created on 2019-06-05

puzzle 38.6
jigsaw puzzle 34.1
grunge 34
old 27.2
graffito 25.8
vintage 25.7
texture 25.7
decoration 25.2
game 24.7
map 22
graphic 21.9
design 21.4
art 19.9
antique 19.9
pattern 19.8
wallpaper 19.1
paper 18.7
style 17.8
aged 17.2
floral 17
wall 15.9
geography 15.4
retro 14.7
business 14.6
decay 14.5
material 14.3
frame 14.1
border 13.6
grungy 13.3
flower 13.1
stain 12.5
aging 12.5
world 12.4
textured 12.3
backgrounds 12.2
atlas 12.1
brown 11.8
tile 11.7
decorative 11.7
element 11.6
backdrop 11.5
surface 11.5
drawing 11.4
canvas 11.4
structure 11.2
color 11.1
dirty 10.8
symbol 10.8
detailed 10.6
obsolete 10.5
freight car 10.4
shape 10.4
grain 10.1
connection 10.1
effect 10
paint 10
tray 9.9
painterly 9.9
smudged 9.8
grime 9.8
mottled 9.7
fracture 9.7
detail 9.6
car 9.6
nation 9.5
empty 9.4
elements 9.3
album 8.8
crack 8.7
artistic 8.7
edge 8.7
north 8.6
leaf 8.6
textures 8.5
piece 8.5
3d 8.5
outline 8.5
travel 8.4
many 8.3
plant 8.2
receptacle 8
container 7.9
country 7.9
jigsaw 7.9
space 7.8
pieces 7.8
modern 7.7
rust 7.7
solution 7.6
earth 7.4
artwork 7.3
ornate 7.3
global 7.3
group 7.3
success 7.2

Google
created on 2019-06-05

Photograph 95.6
Team 92.7
Crew 53.8

Microsoft
created on 2019-06-05

person 95.6
outdoor 93.5
old 90.7
baseball 90.4
clothing 68.5
group 61.2
posing 40.9
team 28.5

Face analysis

Amazon

Google

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Surprised 45%
Happy 45.1%
Confused 45.1%
Sad 45.8%
Calm 53.9%
Disgusted 45%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 53.5%
Confused 45%
Calm 45.3%
Happy 45%
Surprised 45%
Sad 54.2%
Angry 45.4%
Disgusted 45%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Disgusted 45.3%
Calm 51.4%
Surprised 45.2%
Sad 47.4%
Confused 45.1%
Angry 45.5%
Happy 45.2%

AWS Rekognition

Age 35-55
Gender Male, 54.6%
Disgusted 45%
Confused 45.1%
Angry 47.3%
Sad 46.2%
Surprised 45%
Happy 45%
Calm 51.3%

AWS Rekognition

Age 20-38
Gender Male, 54.6%
Confused 45.1%
Calm 51.6%
Happy 45%
Surprised 45.1%
Sad 46.7%
Angry 46.4%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 50.7%
Sad 50.4%
Happy 45.1%
Disgusted 45.2%
Calm 45.6%
Angry 48.4%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Confused 45.1%
Happy 45.2%
Angry 45.6%
Sad 45.4%
Calm 46.2%
Disgusted 52.4%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Male, 54.9%
Angry 46.7%
Happy 45.2%
Surprised 45.2%
Calm 46.3%
Confused 45.6%
Sad 51%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Angry 45.2%
Happy 45%
Disgusted 45%
Sad 48.3%
Confused 45.1%
Calm 51.3%
Surprised 45.1%

AWS Rekognition

Age 29-45
Gender Male, 54.5%
Happy 45.2%
Surprised 45.1%
Angry 45.2%
Sad 46%
Confused 45.1%
Disgusted 45.1%
Calm 53.4%

AWS Rekognition

Age 35-52
Gender Female, 53.3%
Sad 45.5%
Disgusted 46.3%
Surprised 45.5%
Angry 45.8%
Happy 45.1%
Calm 51.6%
Confused 45.1%

AWS Rekognition

Age 15-25
Gender Male, 53.7%
Sad 48.5%
Angry 46%
Calm 49.1%
Confused 45.4%
Happy 45.3%
Surprised 45.4%
Disgusted 45.3%

AWS Rekognition

Age 20-38
Gender Male, 52.1%
Sad 47.7%
Surprised 45.1%
Disgusted 45%
Calm 45.2%
Happy 45%
Confused 45.1%
Angry 51.8%

AWS Rekognition

Age 17-27
Gender Male, 53.2%
Sad 45.3%
Angry 45.3%
Calm 45%
Confused 45%
Happy 45%
Surprised 45%
Disgusted 54.3%

AWS Rekognition

Age 26-44
Gender Male, 54.4%
Sad 46.3%
Disgusted 45.1%
Surprised 45%
Angry 51.9%
Happy 45%
Calm 46.5%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Female, 54.2%
Disgusted 45.2%
Confused 45.4%
Angry 47.5%
Calm 45.8%
Surprised 45.2%
Happy 45.4%
Sad 50.6%

AWS Rekognition

Age 20-38
Gender Male, 53.7%
Calm 47.3%
Angry 45.4%
Disgusted 45%
Sad 52%
Surprised 45.1%
Happy 45%
Confused 45.2%

AWS Rekognition

Age 30-47
Gender Male, 54.4%
Surprised 45.3%
Happy 45.8%
Confused 45.8%
Sad 46.4%
Calm 47.3%
Disgusted 48.5%
Angry 45.8%

AWS Rekognition

Age 16-27
Gender Male, 50.1%
Disgusted 45.1%
Confused 45.1%
Angry 45.2%
Sad 46%
Surprised 45.1%
Happy 45.1%
Calm 53.6%

AWS Rekognition

Age 20-38
Gender Male, 52.9%
Disgusted 45.2%
Confused 45.4%
Surprised 45.1%
Calm 45.9%
Happy 45.1%
Angry 45.9%
Sad 52.4%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Surprised 45.4%
Calm 49.4%
Happy 45.2%
Sad 46.7%
Angry 45.8%
Confused 46%
Disgusted 46.5%

AWS Rekognition

Age 20-38
Gender Male, 52.6%
Disgusted 45%
Happy 45.1%
Sad 46.3%
Angry 50.6%
Calm 47.9%
Confused 45.1%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54%
Disgusted 45.3%
Confused 45.2%
Surprised 45.2%
Calm 53.1%
Happy 45.1%
Angry 45.5%
Sad 45.5%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 45%
Calm 45.1%
Happy 45%
Sad 54.3%
Angry 45.3%
Confused 45%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54%
Calm 51.6%
Disgusted 45.1%
Surprised 45.1%
Sad 46.9%
Happy 45%
Angry 46.1%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Confused 45%
Angry 45.2%
Surprised 45.1%
Sad 45.6%
Disgusted 45.1%
Calm 54%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Male, 52.2%
Sad 47.1%
Disgusted 45.1%
Angry 45.3%
Surprised 45%
Calm 52.4%
Confused 45%
Happy 45%

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Confused 45.4%
Angry 47.4%
Surprised 45.2%
Sad 48.2%
Disgusted 45.1%
Calm 48.5%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Angry 45.3%
Surprised 45%
Confused 45.2%
Sad 45.4%
Disgusted 45%
Happy 45%
Calm 54%

AWS Rekognition

Age 30-47
Gender Male, 54.4%
Happy 45.3%
Surprised 45.2%
Angry 45.7%
Sad 48.7%
Confused 45.1%
Disgusted 45.2%
Calm 49.8%

AWS Rekognition

Age 20-38
Gender Male, 54.1%
Happy 45.1%
Angry 47.4%
Calm 49%
Disgusted 45.6%
Sad 47.5%
Confused 45.2%
Surprised 45.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

an old photo of a group of people posing for the camera 81.5%
an old photo of a group of people posing for a picture 81.4%
a group of people posing for a photo 81.3%