Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Cricket Club. Library of mens club house
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3229.1

Human Generated Data

Title

Social Settlements: United States. Pennsylvania. Philadelphia. "The Lighthouse": The Lighthouse, Philadelphia, Pa.: Cricket Club. Library of mens club house

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3229.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 98.7
Person 98.7
Clothing 98.7
Apparel 98.7
Person 97.6
Person 96.3
Person 96.2
Person 96
Person 94.8
Person 93.6
Person 93.2
Room 89.7
Indoors 89.7
Person 89.3
Person 89
Coat 87.7
Overcoat 87.7
Crowd 83.6
Person 82.7
Face 74.4
Person 73.6
Person 70.9
Hat 69.3
Sailor Suit 69.2
Tuxedo 65.8
People 65
Audience 64.2
Suit 62.7
Portrait 61.3
Photo 61.3
Photography 61.3
Military 58.3
Military Uniform 58.3
Officer 58.3

Clarifai
created on 2019-06-07

people 99.5
many 98.2
group 98.1
woman 93.5
adult 92.9
man 92.5
group together 92.3
administration 90.8
wear 90.4
leader 90.3
military 87.1
war 79.1
several 78.7
outfit 77.2
child 76.4
ceremony 76.1
crowd 72.6
offense 68.9
chair 68.7
music 66.8

Imagga
created on 2019-06-07

people 36.8
man 35.6
business 34
businessman 33.5
person 32.5
male 31.2
office 25.9
meeting 25.4
professional 25
group 25
corporate 24
men 24
team 22.4
happy 21.9
businesswoman 21.8
adult 21.8
businesspeople 20.9
work 19.6
teamwork 18.5
suit 18.5
executive 17.7
together 17.5
communication 16.8
planner 16.5
couple 16.5
colleagues 15.5
clothing 14.4
senior 14.1
sitting 13.7
businessmen 13.6
job 13.3
indoors 13.2
smiling 13
success 12.9
women 12.6
standing 12.2
smile 12.1
mature 12.1
portrait 11.6
worker 11.6
corporation 11.6
building 10.8
discussion 10.7
handsome 10.7
spectator 10.6
busy 10.6
old 10.4
career 10.4
manager 10.2
happiness 10.2
life 10.1
indoor 10
kin 10
aged 9.9
discussing 9.8
family 9.8
cheerful 9.7
working 9.7
30s 9.6
partnership 9.6
staff 9.6
student 9.5
entrepreneur 9.2
modern 9.1
associates 8.8
room 8.8
coworkers 8.8
conference 8.8
elderly 8.6
workplace 8.6
talking 8.5
face 8.5
teacher 8.4
mortarboard 8.3
silhouette 8.3
20s 8.2
occupation 8.2
confident 8.2
academic gown 8.2
black 8
interior 8
love 7.9
partner 7.7
diversity 7.7
leadership 7.7
hand 7.6
tie 7.6
desk 7.6
fashion 7.5
presentation 7.4
window 7.3
lifestyle 7.2
computer 7.2
looking 7.2

Google
created on 2019-06-07

Photograph 95.6
Gentleman 66.5
History 64.5
Team 64.1
Crew 52.6

Microsoft
created on 2019-06-07

clothing 97.7
posing 96.3
man 94.2
person 93.4
suit 91.5
smile 87.5
old 82.6
black 79.5
group 78.6
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-59
Gender Male, 54.8%
Surprised 45.1%
Confused 45.1%
Disgusted 45.1%
Angry 45.2%
Calm 54.2%
Happy 45%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Disgusted 45.1%
Happy 45.1%
Confused 45.1%
Sad 54.2%
Angry 45.1%
Surprised 45%
Calm 45.4%

AWS Rekognition

Age 45-63
Gender Male, 54.9%
Angry 46%
Surprised 46.1%
Confused 46.1%
Sad 46.3%
Disgusted 45.3%
Happy 45.6%
Calm 49.7%

AWS Rekognition

Age 35-55
Gender Male, 54.9%
Calm 48.7%
Surprised 45.2%
Confused 46.3%
Angry 45.5%
Sad 49.1%
Happy 45.1%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Happy 45.2%
Disgusted 45.3%
Sad 49.2%
Angry 47.1%
Confused 45.3%
Calm 47.6%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Angry 45.4%
Sad 45.6%
Surprised 45.4%
Confused 45.2%
Happy 45.4%
Calm 52.8%
Disgusted 45.2%

AWS Rekognition

Age 45-65
Gender Male, 55%
Confused 45.1%
Calm 53.3%
Happy 45.3%
Disgusted 45.1%
Sad 45.9%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Sad 47.9%
Confused 45.4%
Disgusted 46.1%
Calm 46.6%
Happy 45.4%
Angry 48.2%
Surprised 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Surprised 45.3%
Disgusted 45.1%
Happy 45.1%
Sad 45.2%
Angry 45.2%
Calm 54%
Confused 45.2%

AWS Rekognition

Age 35-53
Gender Male, 54.4%
Sad 51.8%
Surprised 45.3%
Disgusted 45.1%
Calm 45.9%
Angry 46.3%
Happy 45.2%
Confused 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Sad 50.9%
Disgusted 45.1%
Happy 45.1%
Calm 48%
Surprised 45.1%
Confused 45.3%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Sad 49.5%
Surprised 45.8%
Disgusted 45.2%
Confused 46.2%
Happy 45.1%
Calm 46.8%
Angry 46.4%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Angry 45.6%
Happy 45.9%
Disgusted 45.2%
Sad 50.8%
Confused 45.6%
Surprised 46.5%
Calm 45.5%

AWS Rekognition

Age 38-59
Gender Male, 55%
Calm 49.9%
Happy 45.9%
Surprised 46.2%
Disgusted 45.7%
Sad 45.2%
Angry 46.2%
Confused 45.8%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Happy 46.4%
Sad 49.6%
Surprised 45.6%
Angry 45.7%
Calm 46.7%
Disgusted 45.3%
Confused 45.7%

AWS Rekognition

Age 45-63
Gender Male, 54.6%
Sad 46.2%
Calm 45.7%
Angry 45.5%
Disgusted 45.1%
Confused 45.5%
Surprised 46.4%
Happy 50.6%

AWS Rekognition

Age 38-59
Gender Male, 55%
Disgusted 45.3%
Surprised 46.7%
Angry 45.2%
Happy 47.5%
Sad 45.1%
Calm 49.8%
Confused 45.4%

AWS Rekognition

Age 11-18
Gender Female, 50.1%
Happy 45%
Surprised 45%
Confused 45.1%
Angry 45.1%
Sad 54.6%
Disgusted 45%
Calm 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Sad 45.6%
Calm 46.1%
Disgusted 45.7%
Confused 45.4%
Surprised 45.1%
Happy 45.4%
Angry 51.6%

AWS Rekognition

Age 38-59
Gender Male, 54.9%
Calm 45.5%
Confused 45.2%
Happy 53.2%
Angry 45.3%
Surprised 45.1%
Disgusted 45%
Sad 45.6%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Disgusted 45.2%
Surprised 45.4%
Sad 46%
Confused 45.3%
Calm 46.2%
Happy 51.7%
Angry 45.2%

AWS Rekognition

Age 48-68
Gender Male, 55%
Disgusted 45.2%
Confused 45.9%
Surprised 45.3%
Calm 51.4%
Happy 45.1%
Angry 45.5%
Sad 46.6%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Suit 62.7%

Text analysis

Amazon

house
of
Cricket
club
Librory of men's club house
Librory
Cricket Cric Cluk.
Cluk.
men's
Cric
$s3

Google

SSS 10 Cricke Club. Library o7 men's club house
SSS
10
Cricke
Club.
Library
o7
men's
club
house