Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.4

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.7
Person 99.7
Person 99.7
Person 99.5
Person 99.4
Person 99.3
Person 99.1
Person 88.9
People 85.6
Outdoors 84.3
Military 83.8
Military Uniform 82.3
Person 74.2
Apparel 74.1
Clothing 74.1
Armored 73.7
Troop 73.7
Army 73.7
Sailor Suit 63.8
Porch 63.3
Female 59.3
Shorts 59.1
Officer 57.5

Clarifai
created on 2019-06-06

people 100
group together 99.8
group 99.7
many 99.6
adult 98.2
man 96.6
military 95.4
woman 93.4
child 93.2
several 93.1
wear 92.7
war 92.4
administration 91.8
vehicle 91.5
recreation 90.6
crowd 90
outfit 88.9
soldier 88.3
spectator 88.3
leader 87.8

Imagga
created on 2019-06-06

people 22.3
athlete 21.2
ballplayer 20.3
man 20.2
person 19.3
statue 17.5
player 17.4
uniform 16.4
male 16.3
outdoor 16.1
outdoors 15.7
structure 15.3
sculpture 15.3
military uniform 15.2
sunset 14.4
world 14.1
helmet 13.8
horse 13.8
history 13.4
travel 13.4
silhouette 13.2
contestant 13.2
adult 13.1
child 12.9
old 12.5
tourism 12.4
sport 12.1
sky 10.8
lifestyle 10.8
obelisk 10.5
tank 10.5
clothing 10.3
culture 10.3
fountain 10.2
architecture 10.2
religion 9.9
private 9.8
column 9.8
art 9.8
military 9.7
innocent 9.6
boy 9.6
ancient 9.5
vehicle 9.4
monument 9.3
stone 9.3
animal 9.3
protection 9.1
dirty 9
summer 9
soldier 8.8
building 8.7
two 8.5
beach 8.4
weapon 8.4
city 8.3
danger 8.2
vaulting horse 8
grass 7.9
black 7.8
army 7.8
men 7.7
armor plate 7.7
historical 7.5
fun 7.5
evening 7.5
vacation 7.4
sand 7.2
body 7.2
rifle 7.2
portrait 7.1
love 7.1
day 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

tree 99.9
outdoor 99.5
person 97.4
clothing 96.7
man 84.8
posing 81.4
smile 67.2
old 58.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Female, 52%
Surprised 45.1%
Angry 45.2%
Sad 53.5%
Happy 45.3%
Disgusted 45.6%
Calm 45.2%
Confused 45.1%

AWS Rekognition

Age 9-14
Gender Male, 54.4%
Angry 45%
Confused 45%
Calm 45%
Disgusted 45%
Happy 55%
Surprised 45%
Sad 45%

AWS Rekognition

Age 19-36
Gender Female, 54.9%
Happy 54.3%
Sad 45.2%
Angry 45%
Surprised 45%
Calm 45.2%
Confused 45.1%
Disgusted 45.2%

AWS Rekognition

Age 10-15
Gender Male, 50.1%
Surprised 45%
Happy 45.1%
Confused 45%
Calm 45%
Disgusted 45.1%
Sad 54.7%
Angry 45.1%

AWS Rekognition

Age 35-55
Gender Male, 52.2%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%
Sad 45.2%
Happy 54.3%
Confused 45.1%
Calm 45%

AWS Rekognition

Age 16-27
Gender Female, 55%
Surprised 45.1%
Angry 45.2%
Sad 45.8%
Happy 51.3%
Disgusted 45.8%
Calm 46.5%
Confused 45.3%

AWS Rekognition

Age 10-15
Gender Male, 51.3%
Angry 45.4%
Calm 46.6%
Confused 45.5%
Happy 49.3%
Sad 47.2%
Disgusted 45.6%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Sad 46.5%
Confused 46.5%
Surprised 45.4%
Happy 45.7%
Angry 46.7%
Disgusted 47.8%
Calm 46.5%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 94.1%
a group of people posing for a picture 94%
an old photo of a group of people posing for the camera 92.1%