Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: En Route

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3043.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: En Route

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3043.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.8
Human 99.8
Person 99.7
Person 99.4
Person 99.3
Person 99.2
Person 99.1
People 95
Person 93.3
Person 92.4
Apparel 89
Clothing 89
Person 84.6
Military Uniform 80.2
Armored 80.2
Military 80.2
Troop 80.2
Army 80.2
Crowd 70.3
Team 68.9
Shorts 67.4
Sports 61
Ballplayer 61
Softball 61
Baseball 61
Athlete 61
Sport 61
Team Sport 61
Hat 60.7
Cap 60.7
Soldier 56.7
Poster 55.2
Advertisement 55.2
Officer 55.1

Clarifai
created on 2019-06-06

people 100
group together 98.6
uniform 98.2
adult 98
group 97.6
wear 97.6
many 97.4
outfit 96.1
military 94.5
man 94.5
child 93.1
portrait 92.5
woman 91.5
administration 88.4
war 86.2
soldier 86.1
several 86
retro 85.4
recreation 84.5
leader 84.3

Imagga
created on 2019-06-06

military uniform 63.4
uniform 55.3
stretcher 37.8
clothing 37.2
litter 30.2
consumer goods 25.4
man 24.8
conveyance 22.8
covering 22.6
male 21.4
people 21.2
person 21.2
outdoors 19.4
athlete 18.8
helmet 17.3
ballplayer 15.9
sport 15.3
walking 15.1
player 14.9
beach 14.3
child 14.1
travel 14.1
adult 13.6
outdoor 13
commodity 12.7
sunset 12.6
military 12.5
innocent 12.4
danger 11.8
soldier 11.7
family 11.6
mountain 11.6
hiking 11.5
contestant 11.5
sky 11.5
boy 11.3
love 11
protection 10.9
army 10.7
vacation 10.6
together 10.5
couple 10.4
men 10.3
summer 10.3
two 10.2
lifestyle 10.1
leisure 10
active 9.9
kin 9.7
outside 9.4
happiness 9.4
water 9.3
field 9.2
ocean 9.1
recreation 9
father 8.9
destruction 8.8
parent 8.8
day 8.6
adventure 8.5
old 8.4
silhouette 8.3
fun 8.2
happy 8.1
autumn 7.9
armor plate 7.9
hiker 7.9
sand 7.9
sea 7.8
life 7.8
rock 7.8
portrait 7.8
nuclear 7.8
war 7.7
rifle 7.7
risk 7.7
walk 7.6
mother 7.4
landscape 7.4
holding 7.4
girls 7.3
gun 7.2
activity 7.2
dad 7.1

Google
created on 2019-06-06

Photograph 96.3
People 94.9
Snapshot 82.9
Photography 62.4
Team 59.4
Family 55.3
Art 50.2

Microsoft
created on 2019-06-06

outdoor 98.5
clothing 98.2
person 97.5
man 91.9
posing 88.6
standing 86.1
player 81.3
old 76
white 72.8
black 69.5
footwear 68.6
group 63.9
smile 52.1
team 33.1
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 54.2%
Surprised 45.1%
Happy 45.1%
Sad 46.2%
Angry 46.5%
Disgusted 45.6%
Confused 45.2%
Calm 51.2%

AWS Rekognition

Age 20-38
Gender Male, 52.4%
Confused 45.1%
Disgusted 45.1%
Calm 45.1%
Sad 52.6%
Angry 45.1%
Happy 47.1%
Surprised 45.1%

AWS Rekognition

Age 57-77
Gender Female, 53.6%
Confused 45.1%
Calm 45.1%
Disgusted 45.4%
Sad 53.9%
Happy 45.1%
Angry 45.4%
Surprised 45.1%

AWS Rekognition

Age 17-27
Gender Female, 52.6%
Disgusted 49.3%
Confused 45.3%
Surprised 45.1%
Calm 45.3%
Happy 45.4%
Angry 45.6%
Sad 49.2%

AWS Rekognition

Age 12-22
Gender Male, 52.8%
Disgusted 45.3%
Confused 45.2%
Calm 52.1%
Surprised 45.3%
Happy 45.1%
Sad 46.4%
Angry 45.5%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Angry 48.6%
Calm 46.7%
Sad 48.3%
Surprised 45.3%
Disgusted 45.8%
Happy 45.1%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Surprised 45.2%
Happy 45.2%
Calm 45.4%
Disgusted 45.7%
Confused 45.3%
Sad 52.2%
Angry 45.9%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Angry 45.4%
Surprised 45%
Disgusted 45.1%
Calm 45.4%
Sad 53.9%
Happy 45%
Confused 45.1%

AWS Rekognition

Age 11-18
Gender Female, 54.1%
Sad 53.5%
Calm 45.5%
Happy 45.1%
Surprised 45.1%
Angry 45.8%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Surprised 45.1%
Happy 45.1%
Confused 45.1%
Calm 52.8%
Disgusted 46.1%
Sad 45.3%
Angry 45.4%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Poster 55.2%

Categories

Imagga

people portraits 89.4%
paintings art 8.8%

Text analysis

Amazon

Foute
En Foute
En

Google

En RoUte
En
RoUte