Human Generated Data

Title

Social Settlements: Hawaii. Honolulu. "Palama Settlement": Palama Settlement, Honolulu, H.T.: Victors in the Inter-Club Field Meet.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2733.1

Human Generated Data

Title

Social Settlements: Hawaii. Honolulu. "Palama Settlement": Palama Settlement, Honolulu, H.T.: Victors in the Inter-Club Field Meet.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Family 99.9
Human 99.9
People 99.9
Person 99.8
Person 99.6
Person 99.5
Person 99.3
Person 99.3
Person 97.6
Person 96.8
Person 96.1
Person 95.4
Person 88.4
Clothing 81.6
Overcoat 81.6
Coat 81.6
Apparel 81.6
Suit 81.6
Art 66.7
Painting 66.7

Clarifai
created on 2019-06-05

people 100
group 99.7
adult 98.9
group together 98.7
many 96.6
man 96.1
leader 95.9
several 95.2
wear 94.2
woman 93
five 92.9
outfit 91.8
uniform 91.3
four 91.2
retro 89.7
portrait 88.2
administration 87.4
child 85.9
sibling 84.8
sit 84.3

Imagga
created on 2019-06-05

person 43.4
player 35.7
kin 34.3
athlete 30.4
people 30.1
ballplayer 29.8
male 26.5
man 25.5
adult 22.5
contestant 22.4
men 20.6
group 18.5
black 17.4
happy 15.6
nurse 15.6
portrait 15.5
professional 15.4
world 15.3
team 15.2
sport 14.9
ball 14.7
business 14.6
businessman 14.1
teamwork 13.9
couple 13.1
standing 13
women 12.6
love 12.6
together 12.3
fashion 12
human 12
pose 11.8
clothing 11.2
smiling 10.8
silhouette 10.7
planner 10.7
hands 10.4
body 10.4
inside 10.1
girls 10
dress 9.9
suit 9.9
attractive 9.8
boy 9.6
happiness 9.4
guy 9.3
elegance 9.2
teen 9.2
style 8.9
family 8.9
worker 8.9
child 8.8
lifestyle 8.7
model 8.5
smile 8.5
friendship 8.4
room 8.3
one 8.2
uniform 8.2
basketball 8.2
boxer 8
sexy 8
looking 8
home 8
play 7.7
modern 7.7
mother 7.7
patient 7.6
combatant 7.5
good 7.5
occupation 7.3
businesswoman 7.3
exercise 7.3
success 7.2
office 7.2
posing 7.1
face 7.1
job 7.1
medical 7.1
indoors 7

Google
created on 2019-06-05

Photograph 95
Family 62.5
History 57.6
Gentleman 54.5
Sitting 54.1

Microsoft
created on 2019-06-05

person 100
wall 96.9
posing 95.6
clothing 92.1
man 90.2
group 86.1
player 80.2
standing 75.7
smile 72.5
old 58.3
team 31.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 54.3%
Happy 45%
Disgusted 45%
Sad 46.1%
Surprised 45.1%
Confused 45.1%
Calm 53.5%
Angry 45%

AWS Rekognition

Age 20-38
Gender Male, 54.9%
Angry 45.2%
Disgusted 45%
Calm 53.2%
Surprised 45.2%
Happy 45%
Sad 46.1%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 55%
Angry 45.1%
Calm 52.9%
Disgusted 45%
Happy 45.1%
Confused 45.1%
Sad 46.6%
Surprised 45.1%

AWS Rekognition

Age 17-27
Gender Male, 54.5%
Calm 46.1%
Disgusted 45%
Sad 53.7%
Angry 45%
Happy 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 15-25
Gender Male, 55%
Confused 45.1%
Angry 45%
Disgusted 45%
Calm 54.5%
Happy 45%
Surprised 45.1%
Sad 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Surprised 45%
Happy 45%
Confused 45.2%
Calm 45.6%
Disgusted 45%
Angry 45.3%
Sad 53.8%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Disgusted 45%
Happy 45%
Confused 45.2%
Sad 51.6%
Calm 48%
Angry 45.1%
Surprised 45.1%

AWS Rekognition

Age 15-25
Gender Male, 55%
Calm 53.6%
Happy 45.2%
Angry 45.1%
Disgusted 45.1%
Surprised 45.2%
Confused 45.3%
Sad 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Surprised 45.2%
Sad 47%
Calm 52.6%
Confused 45.1%
Disgusted 45%
Happy 45%
Angry 45.1%

AWS Rekognition

Age 45-63
Gender Male, 54.9%
Happy 45.1%
Angry 45.5%
Calm 53.1%
Sad 45.3%
Surprised 45.3%
Confused 45.8%
Disgusted 45%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 81.6%
Painting 66.7%

Captions

Microsoft

Marco Hofschneider, Bob Marley posing for a photo 98.4%
Marco Hofschneider, Bob Marley posing for the camera 98.3%
Marco Hofschneider, Bob Marley posing for a picture 98.2%

Text analysis

Amazon

p
ire
fid

Google

tre
tre