Human Generated Data

Title

Social Settlements: Hawaii. Honolulu. "Palama Settlement": Palama Settlement, Honolulu, H.T.: Chinese and Japanese

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2733.2

Human Generated Data

Title

Social Settlements: Hawaii. Honolulu. "Palama Settlement": Palama Settlement, Honolulu, H.T.: Chinese and Japanese

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2733.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.8
Person 99.8
Person 99.4
Person 98.5
Person 98
Person 97.9
Person 96.6
Person 94.8
People 89.6
Person 86.8
Person 84.1
Apparel 79.6
Clothing 79.6
Shorts 70.5
Suit 58.6
Coat 58.6
Overcoat 58.6
Porch 57.5
Family 57

Clarifai
created on 2019-06-05

people 100
group 99.6
many 99.2
group together 98.8
adult 98.4
administration 96.8
several 96.6
leader 94.9
man 92
woman 91.5
vehicle 91.5
military 91.3
wear 88.4
child 87.7
furniture 86
war 85.2
outfit 84.1
watercraft 83.2
recreation 83.2
medical practitioner 81.7

Imagga
created on 2019-06-05

barbershop 56.3
shop 49.3
mercantile establishment 34.6
wheelchair 28.1
man 26.2
people 24.5
place of business 23.1
chair 20.8
male 19.2
musical instrument 16.3
family 15.1
person 14.1
men 13.7
adult 12.6
seat 12.5
old 12.5
business 12.1
city 11.6
establishment 11.5
kin 11.3
senior 11.2
fashion 10.5
medical 9.7
couple 9.6
illness 9.5
women 9.5
room 9.2
street 9.2
clothing 9.2
worker 9
human 9
lifestyle 8.7
furniture 8.5
portrait 8.4
tradition 8.3
child 8.3
care 8.2
mother 8.2
outdoors 8.2
new 8.1
religion 8.1
group 8.1
to 8
disabled 7.9
urban 7.9
boy 7.8
black 7.8
architecture 7.8
scene 7.8
happy 7.5
religious 7.5
traditional 7.5
building 7.4
shopping 7.3
window 7.3
girls 7.3
smiling 7.2
home 7.2
interior 7.1
modern 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

clothing 98.5
person 96.8
human face 79.5
smile 72.4
footwear 67.8
boy 64.6
group 64.3
posing 64.1
old 51.6
man 51
dressed 26.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Female, 53.1%
Surprised 45%
Sad 54.7%
Calm 45.1%
Happy 45%
Disgusted 45.1%
Confused 45%
Angry 45.1%

AWS Rekognition

Age 2-5
Gender Female, 54.8%
Confused 45.1%
Disgusted 45.3%
Sad 50.5%
Surprised 45.2%
Calm 47.4%
Angry 46.4%
Happy 45.2%

AWS Rekognition

Age 14-25
Gender Female, 54.7%
Calm 52%
Angry 45.5%
Happy 45.4%
Sad 46.3%
Surprised 45.4%
Confused 45.2%
Disgusted 45.2%

AWS Rekognition

Age 11-18
Gender Female, 54.9%
Angry 47.9%
Calm 48%
Disgusted 45.9%
Happy 45.7%
Confused 45.3%
Sad 46.3%
Surprised 45.9%

AWS Rekognition

Age 14-23
Gender Female, 54.7%
Angry 47.6%
Sad 48.3%
Surprised 45.3%
Happy 45.3%
Calm 47.5%
Disgusted 45.8%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.1%
Calm 45.3%
Sad 51.8%
Angry 47.2%
Surprised 45.1%
Disgusted 45.3%
Confused 45.1%
Happy 45.2%

AWS Rekognition

Age 4-9
Gender Female, 53.4%
Calm 45.8%
Disgusted 45.2%
Sad 52.3%
Angry 45.9%
Happy 45.4%
Confused 45.2%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Female, 54%
Disgusted 45.4%
Calm 45.2%
Confused 45.1%
Happy 45.1%
Sad 45.2%
Angry 53.8%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Male, 50.3%
Angry 47.1%
Sad 47%
Calm 48.9%
Surprised 46.1%
Confused 45.3%
Disgusted 45.3%
Happy 45.2%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Categories

Text analysis

Amazon

3

Google

3
3