Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Class in Cooking.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3226.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Class in Cooking.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3226.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Person 98.9
Human 98.9
Person 98.8
Person 98.3
Person 98.1
Person 98.1
Person 97.8
Person 88.8
Building 84
Person 80.8
Clothing 76.4
Apparel 76.4
Art 72.9
Painting 72.9
Person 65.8
Person 63.5
People 63.1
Factory 60.5
Person 60.3
Crowd 57.2
Chef 55.4
Sailor Suit 55.2

Clarifai
created on 2019-06-07

people 100
group 99.4
group together 98.4
many 98.1
adult 97.6
administration 96.3
several 95.7
woman 95.6
man 93.9
leader 91.9
military 91.9
wear 91.5
room 89.6
war 86.4
five 86.1
uniform 82.4
outfit 81.7
medical practitioner 80.7
police 79.5
furniture 78.3

Imagga
created on 2019-06-07

man 30.9
people 25.6
person 23.6
male 21.3
home 19.1
room 18.9
couple 18.3
adult 17.3
old 16
family 14.2
uniform 14.1
barbershop 13.9
happy 13.8
dress 13.5
spectator 13.5
men 12.9
clothing 12.6
shop 12.3
military uniform 12.1
sitting 12
portrait 11.6
senior 11.2
groom 11.2
mature 11.2
love 11
two 11
chair 10.8
musical instrument 10.7
interior 10.6
indoors 10.5
happiness 10.2
lifestyle 10.1
city 10
office 9.7
together 9.6
bride 9.6
architecture 9.4
holiday 9.3
scholar 9.3
worker 9.3
window 9.2
indoor 9.1
world 9.1
fashion 9
mercantile establishment 9
history 8.9
new 8.9
romantic 8.9
husband 8.6
house 8.4
inside 8.3
vintage 8.3
historic 8.2
aged 8.1
lady 8.1
life 8
business 7.9
day 7.8
smile 7.8
kin 7.7
elderly 7.7
mother 7.6
marriage 7.6
wife 7.6
historical 7.5
intellectual 7.4
care 7.4
wedding 7.4
building 7.3
group 7.2
smiling 7.2
black 7.2
looking 7.2
celebration 7.2
religion 7.2

Google
created on 2019-06-07

Photograph 96.7
Snapshot 86.8
Room 71.4
Vintage clothing 66
Photography 62.4
History 54.1
Collection 54
Art 50.2
Family 50.2

Microsoft
created on 2019-06-07

person 96.2
clothing 87.4
group 71.2
people 67.5
man 61.4
posing 47.3
dressed 26.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 54.8%
Disgusted 46.4%
Sad 45.7%
Angry 49.1%
Calm 47.8%
Confused 45.3%
Surprised 45.5%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.7%
Happy 46.2%
Angry 45.5%
Surprised 45.5%
Disgusted 45.3%
Confused 45.3%
Calm 45.4%
Sad 51.8%

AWS Rekognition

Age 23-38
Gender Female, 51.4%
Sad 45.5%
Disgusted 45%
Confused 45.2%
Happy 45.1%
Angry 45.1%
Surprised 45.2%
Calm 53.9%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Angry 45.1%
Sad 47%
Happy 45.5%
Disgusted 45.1%
Calm 52%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Happy 45.2%
Surprised 45.3%
Confused 45.2%
Angry 45.4%
Sad 46.3%
Disgusted 45.2%
Calm 52.4%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Sad 54.9%
Calm 45%
Angry 45%
Disgusted 45%
Confused 45%
Surprised 45%
Happy 45%

AWS Rekognition

Age 45-63
Gender Male, 52.6%
Disgusted 45.4%
Angry 47.5%
Sad 47.9%
Happy 47.5%
Calm 45.6%
Surprised 45.6%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 53.1%
Surprised 45.1%
Calm 45.3%
Sad 53.8%
Happy 45.1%
Confused 45.2%
Angry 45.4%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.1%
Sad 45.6%
Surprised 50.4%
Disgusted 45.3%
Calm 46.8%
Angry 45.6%
Happy 45.8%
Confused 45.5%

AWS Rekognition

Age 15-25
Gender Male, 54.5%
Confused 45%
Sad 45.1%
Angry 45.1%
Disgusted 45%
Happy 45%
Surprised 45%
Calm 54.7%

AWS Rekognition

Age 30-47
Gender Female, 54.2%
Surprised 45%
Angry 45%
Sad 54.9%
Disgusted 45%
Happy 45%
Calm 45%
Confused 45%

AWS Rekognition

Age 29-45
Gender Female, 51.8%
Disgusted 45.1%
Surprised 45.1%
Angry 45.4%
Happy 45%
Sad 53.2%
Calm 46.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Calm 49.6%
Surprised 49.5%
Confused 49.6%
Angry 49.6%
Sad 50.2%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Sad 52.9%
Disgusted 45.6%
Happy 45.2%
Calm 45.5%
Surprised 45.2%
Confused 45.2%
Angry 45.4%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.5%
Angry 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.1%
Angry 49.9%
Confused 49.5%
Disgusted 49.8%
Surprised 49.6%
Calm 49.5%
Sad 49.7%
Happy 49.6%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Painting 72.9%

Categories

Text analysis

Amazon

in
cooking
C1ess in cooking
C1ess

Google

Class in Cooking
Class
in
Cooking