Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Base Ball Nine

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064.1

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "South End House": South End House, Boston, Mass.: Base Ball Nine

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3064.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.2
Person 98.9
Person 98.8
Person 97
Person 96.8
Person 91.5
People 88
Person 82.1
Fireman 78.2
Apparel 66.1
Clothing 66.1
Shoe 66.1
Footwear 66.1
Person 63.3
Crowd 60.3

Clarifai
created on 2019-06-06

people 99.9
group together 97.2
uniform 96.9
group 96.6
adult 95.4
many 95.2
outfit 93.2
several 91.7
man 91.6
child 91
wear 90.4
five 86.8
education 83.5
military 83.5
portrait 82.6
school 80.9
administration 79.2
war 79.1
baseball 79
soldier 78.6

Imagga
created on 2019-06-06

sketch 49.7
drawing 42.6
representation 27
art 20.7
decoration 18.9
old 18.8
ancient 16.4
man 16.1
grunge 14.5
person 14.4
vintage 14
retro 13.1
gymnasium 12.6
historical 12.2
money 11.9
facility 11.3
design 11.2
graffito 11.2
sculpture 10.9
antique 10.8
religion 10.7
history 10.7
black 10.2
architecture 10.1
athletic facility 10.1
people 10
currency 9.9
statue 9.5
paper 9.4
stone 9.3
building 9.3
male 9.2
travel 9.1
aged 9
business 8.5
finance 8.4
dollar 8.3
cash 8.2
detail 8
financial 8
violin 7.9
poster 7.5
pattern 7.5
symbol 7.4
church 7.4
banking 7.3
historic 7.3
brass 7.3
wealth 7.2
bowed stringed instrument 7.1
portrait 7.1

Google
created on 2019-06-06

Photograph 95
Team 64.1
Family 58
History 57.6

Microsoft
created on 2019-06-06

building 99.5
person 97.7
posing 97.3
old 95.5
clothing 95.2
text 89.9
group 81.5
black 79.3
footwear 52.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.5%
Angry 45.3%
Confused 45.6%
Calm 52.1%
Surprised 46.3%
Sad 45.4%
Happy 45.1%
Disgusted 45.3%

AWS Rekognition

Age 17-27
Gender Male, 52%
Calm 51.7%
Disgusted 45.2%
Happy 46.9%
Confused 45.2%
Surprised 45.2%
Sad 45.7%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54.2%
Disgusted 45.2%
Happy 45.5%
Angry 45.2%
Calm 52.5%
Surprised 45.1%
Confused 45.3%
Sad 46.1%

AWS Rekognition

Age 20-38
Gender Male, 51.5%
Calm 54.8%
Disgusted 45%
Surprised 45%
Confused 45%
Angry 45%
Sad 45%
Happy 45%

AWS Rekognition

Age 35-52
Gender Male, 51.4%
Sad 45.4%
Surprised 45.2%
Confused 45.1%
Angry 45.3%
Happy 45.2%
Calm 53.2%
Disgusted 45.5%

AWS Rekognition

Age 16-27
Gender Male, 53.7%
Confused 45.1%
Disgusted 45.1%
Surprised 45.1%
Sad 45.2%
Angry 45.2%
Happy 45.2%
Calm 54.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Calm 53.5%
Angry 45.2%
Happy 45.2%
Sad 45.6%
Surprised 45.1%
Confused 45.3%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Female, 53.7%
Surprised 45.3%
Sad 45.8%
Disgusted 45.3%
Calm 52.7%
Happy 45.3%
Angry 45.6%
Confused 45.1%

AWS Rekognition

Age 14-25
Gender Male, 54%
Angry 45.5%
Happy 46.2%
Calm 50.2%
Confused 45.8%
Sad 46%
Disgusted 45.8%
Surprised 45.5%

AWS Rekognition

Age 20-38
Gender Male, 53%
Happy 45.1%
Calm 50.6%
Sad 45.8%
Surprised 45.1%
Angry 48.1%
Confused 45.1%
Disgusted 45.2%

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 66.1%

Categories

Imagga

paintings art 97.5%
people portraits 1.2%

Text analysis

Amazon

Base
Ball
Base Ball Nine
B
Nine
5.B.U B B B
B 5 B.U. S. B
sB.ul
5
S.
5.B.U
B.U.
s000
6

Google

S00 sBU S.B .U. Base Bal Nine
S00
sBU
S.B
.U.
Base
Bal
Nine