Human Generated Data

Title

Social Settlements: United States. New Jersey. Jersey City. Whittier House: Washing Day at the Whittier.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.309.2

Human Generated Data

Title

Social Settlements: United States. New Jersey. Jersey City. Whittier House: Washing Day at the Whittier.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.309.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.8
Person 99.8
Person 99.5
Person 99.2
Person 99.2
Person 98.3
Person 98
Classroom 97.3
Indoors 97.3
School 97.3
Room 97.3
Person 94.3
Person 93.9
Person 92.5
Workshop 90.9
Furniture 79.3
Table 73.7
Person 73.5
Apparel 62.3
Clothing 62.3
Bedroom 57.7
Desk 56.6
Lab 56
Clinic 55.6

Clarifai
created on 2019-06-05

people 100
child 99.1
group 99.1
group together 97.2
adult 96.6
elementary school 96.4
education 96.4
administration 95.5
room 94.6
furniture 93.1
teacher 91.8
school 91.8
several 90.2
desk 90.2
classroom 90.2
many 90
man 89.3
sit 88.5
woman 88.1
war 88.1

Imagga
created on 2019-06-05

percussion instrument 56.6
marimba 53.8
musical instrument 43.8
piano 17.8
cart 16.4
horse cart 16.1
chair 15.4
table 15.1
room 15
grand piano 14.5
people 14.5
travel 14.1
interior 13.3
old 13.2
stringed instrument 13.1
male 12.8
house 12.5
keyboard instrument 12
wheeled vehicle 11.8
sitting 11.2
home 10.4
adult 10.3
wagon 10.3
balcony 10.1
man 10.1
wood 10
city 10
outdoors 9.7
restaurant 9.7
sun 9.6
couple 9.6
horse 9.5
architecture 9.4
building 9
furniture 8.9
family 8.9
women 8.7
decoration 8.7
scene 8.6
day 8.6
glass 8.5
outdoor 8.4
sky 8.3
vehicle 8.3
style 8.1
history 8
person 7.8
ancient 7.8
men 7.7
barrow 7.6
traditional 7.5
silhouette 7.4
vintage 7.4
floor 7.4
water 7.3
group 7.2
animal 7.2
smiling 7.2
color 7.2
dress 7.2
celebration 7.2
transportation 7.2
holiday 7.2
romance 7.1
antique 7.1
wooden 7
indoors 7

Google
created on 2019-06-05

Room 83.9
Table 75.7
Furniture 66
Child 64.5
History 54.1
Art 50.2

Microsoft
created on 2019-06-05

table 97.9
person 92.4
furniture 89.9
clothing 79.1
library 78.2
desk 77.4
old 59.8
computer 53.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 51.8%
Disgusted 45.2%
Confused 45.1%
Angry 45.3%
Happy 45.1%
Calm 45.3%
Surprised 45.1%
Sad 53.9%

AWS Rekognition

Age 20-38
Gender Male, 54.3%
Sad 45.2%
Surprised 45.1%
Happy 45.2%
Angry 45.1%
Confused 45.1%
Disgusted 45.1%
Calm 54.3%

AWS Rekognition

Age 10-15
Gender Female, 50.9%
Disgusted 45.2%
Angry 45.3%
Sad 48.5%
Surprised 45.2%
Happy 45.3%
Calm 50.4%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 55%
Calm 53%
Sad 45.9%
Confused 45.3%
Happy 45.1%
Angry 45.1%
Disgusted 45.1%
Surprised 45.4%

AWS Rekognition

Age 35-52
Gender Female, 53.7%
Confused 46.3%
Disgusted 45.2%
Surprised 45.9%
Sad 45.8%
Angry 45.6%
Calm 50%
Happy 46.2%

Microsoft Cognitive Services

Age 40
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Text analysis

Amazon

O