Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Frances E. Willard House: Frances E. Willard House, Boston, Mass.: Cobbling Class.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.411.2

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Frances E. Willard House: Frances E. Willard House, Boston, Mass.: Cobbling Class.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.5
Person 99.5
Person 99.3
Person 99
Person 98.7
Person 98.5
Person 98.2
Person 88.3
Furniture 79.8
Indoors 78.7
Room 78.7
People 71.8
Bench 70.1
Text 67
Clinic 65.4
Nature 65
Building 63.2
Urban 60.1
Housing 57
Apparel 57
Clothing 57

Clarifai
created on 2019-06-05

people 100
group 99.6
child 98.5
administration 97.6
adult 97.4
room 94.8
war 94
group together 93.5
man 93.4
military 92.9
furniture 92.4
several 91.3
many 91.3
leader 91.1
education 89.5
boy 88.2
chair 87.8
medical practitioner 86.2
sit 85.6
wear 85.4

Imagga
created on 2019-06-05

kin 41.9
man 27.5
people 23.4
male 22
person 19.1
adult 18.6
child 16.9
world 15.7
smiling 13.7
hospital 13.6
outdoors 13.4
family 13.3
happy 13.1
sitting 12.9
fun 12.7
couple 12.2
group 12.1
passenger 12
portrait 11.6
activity 11.6
together 11.4
two 11
playing 10.9
city 10.8
smile 10.7
men 10.3
leisure 10
dirty 9.9
human 9.7
boy 9.6
gun 9.4
friends 9.4
clothing 9.2
outdoor 9.2
vintage 9.1
spectator 9.1
park 9
old 9
life 9
kid 8.9
mother 8.8
soldier 8.8
military 8.7
happiness 8.6
laughing 8.5
friendship 8.4
girls 8.2
danger 8.2
home 8
urban 7.9
war 7.7
mask 7.7
senior 7.5
weapon 7.4
window 7.3
protection 7.3
industrial 7.3
father 7.2
black 7.2
vehicle 7.1
women 7.1
little 7.1
day 7.1

Google
created on 2019-06-05

Photograph 96.9
People 93.7
Snapshot 87.7
Room 71.4
Art 67.7
Adaptation 67
History 62.6
Photography 62.4
Stock photography 62.1
Family 57.7
Illustration 54.5
Gentleman 51.3

Microsoft
created on 2019-06-05

clothing 98.7
posing 92.7
man 92
group 91.5
old 91.1
outdoor 90.3
person 86
people 74.2
photograph 56.4
vintage 27.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-9
Gender Male, 52.9%
Sad 45.4%
Angry 45.1%
Happy 45.1%
Disgusted 45.1%
Calm 54%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 10-15
Gender Male, 54.6%
Angry 45.2%
Disgusted 45.1%
Confused 45.2%
Calm 48.5%
Happy 45%
Surprised 45.1%
Sad 50.9%

AWS Rekognition

Age 9-14
Gender Female, 54.7%
Disgusted 48%
Calm 47.4%
Confused 45.8%
Happy 46.1%
Surprised 46.2%
Angry 45.7%
Sad 45.9%

AWS Rekognition

Age 15-25
Gender Female, 51.8%
Angry 46%
Calm 49.8%
Confused 45.3%
Happy 45.5%
Sad 46.2%
Disgusted 46.7%
Surprised 45.4%

AWS Rekognition

Age 10-15
Gender Male, 52.2%
Surprised 45.1%
Happy 45%
Confused 45.2%
Calm 45.3%
Disgusted 45.3%
Sad 50.6%
Angry 48.5%

AWS Rekognition

Age 57-77
Gender Male, 50.3%
Disgusted 45.3%
Surprised 45.6%
Sad 49.6%
Angry 45.5%
Happy 46.1%
Confused 46%
Calm 46.9%

AWS Rekognition

Age 16-27
Gender Male, 54.3%
Surprised 45.7%
Angry 46%
Sad 47.4%
Happy 45.8%
Disgusted 46.6%
Calm 48%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Male, 50%
Disgusted 48%
Calm 48.1%
Confused 45.9%
Happy 45.4%
Surprised 45.3%
Angry 46.1%
Sad 46.2%

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Bench 70.1%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.3%
a vintage photo of a group of people posing for a picture 97.2%
a group of people posing for a photo 97.1%

Text analysis

Amazon

Cobbling
Cobbling Clerss.
Clerss.
ITL

Google

PLAV
Cobbling
M
PLAV M LTL Cobbling Class
LTL
Class