Human Generated Data

Title

Social Settlements: United States. Iowa. Des Moines. "Roadside Settlement House": Roadside Settlement House, Des Moines, Iowa.: Basket Ball Team

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2913.2

Human Generated Data

Title

Social Settlements: United States. Iowa. Des Moines. "Roadside Settlement House": Roadside Settlement House, Des Moines, Iowa.: Basket Ball Team

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2913.2

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.6
Person 99.5
Person 99.4
Apparel 98.4
Clothing 98.4
Shorts 98.4
Person 97.7
Footwear 96.6
Shoe 96.6
Shoe 95.6
Shoe 90.6
People 82.8
Shoe 76.6
Shoe 68.2
Sport 66.4
Sports 66.4
Shoe 59.8
Bib 58.1
Shoe 57.8
Team Sport 57
Team 57
Boy 56.5
Shoe 51.8

Clarifai
created on 2019-06-05

people 99.9
group together 98.8
portrait 98.4
adult 98.2
school 96.6
man 96.5
wear 96.5
group 94.8
woman 94.8
child 94.5
education 94.1
many 93.7
five 91.6
outfit 88.4
several 85.6
four 85.2
basketball player 83.7
facial expression 82.9
athlete 82.3
adolescent 80.8

Imagga
created on 2019-06-05

people 37.9
man 33.6
nurse 32.5
kin 32
male 30.6
group 29.8
person 29.2
adult 27.7
happy 27.6
smiling 24.6
men 23.2
team 22.4
women 22.1
portrait 22
uniform 20.4
military uniform 19.2
couple 19.2
clothing 18.7
sibling 18.6
standing 18.2
business 18.2
love 15.8
together 15.8
body 15.2
businessman 15
lifestyle 14.4
crowd 14.4
human 14.2
attractive 14
teamwork 13.9
fashion 13.6
smile 13.5
happiness 13.3
indoors 13.2
professional 12.9
mother 12.9
looking 12.8
businesswoman 12.7
health 12.5
model 12.4
silhouette 12.4
medical 12.4
sexy 12
child 11.8
covering 11.8
family 11.6
girls 10.9
black 10.9
consumer goods 10.7
pretty 10.5
success 10.5
doctor 10.3
senior 10.3
friendship 10.3
casual 10.2
lady 9.7
30s 9.6
boy 9.6
face 9.2
occupation 9.2
staff 9
fitness 9
worker 9
job 8.8
working 8.8
medicine 8.8
maillot 8.8
work 8.6
females 8.5
mature 8.4
inside 8.3
healthy 8.2
suit 8.1
hospital 8
office 8
home 8
husband 7.9
garment 7.8
athlete 7.8
thirties 7.8
life 7.8
buddy 7.7
youth 7.7
marriage 7.6
businesspeople 7.6
wife 7.6
attendant 7.5
swimsuit 7.5
holding 7.4
camera 7.4
parent 7.4
children 7.3
figure 7.3
handsome 7.1

Google
created on 2019-06-05

Team 97.3
Team sport 71.3
Crew 68.1

Microsoft
created on 2019-06-05

posing 99.9
person 99.6
group 99
basketball 97.4
wall 97.2
standing 96.8
sports uniform 96
clothing 95.2
man 80.1
sport 78.7
sports equipment 76.9
black 72.9
footwear 72.5
sportswear 65.9
white 60.1
ball 58.1
team 42.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 55%
Disgusted 45.1%
Confused 45.8%
Angry 46%
Sad 46.2%
Surprised 45.5%
Happy 45.1%
Calm 51.2%

AWS Rekognition

Age 26-44
Gender Male, 54.9%
Sad 45.6%
Confused 45.2%
Calm 53.4%
Disgusted 45.2%
Happy 45.2%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 23-38
Gender Male, 54.7%
Happy 45.3%
Disgusted 45.9%
Sad 47.2%
Confused 45.2%
Angry 46%
Surprised 45.2%
Calm 50.3%

AWS Rekognition

Age 23-38
Gender Male, 54.9%
Sad 46.6%
Happy 45.1%
Disgusted 45.1%
Calm 52.2%
Angry 45.3%
Confused 45.4%
Surprised 45.2%

AWS Rekognition

Age 17-27
Gender Male, 54.5%
Surprised 45.4%
Happy 45.3%
Confused 45.7%
Sad 47%
Calm 51%
Disgusted 45.3%
Angry 45.3%

AWS Rekognition

Age 23-38
Gender Male, 55%
Surprised 45.6%
Confused 45.7%
Sad 46%
Disgusted 45.6%
Calm 50.8%
Angry 45.8%
Happy 45.6%

AWS Rekognition

Age 26-44
Gender Male, 54.7%
Angry 47.1%
Happy 45.1%
Surprised 45.1%
Calm 49.1%
Confused 45.9%
Sad 47.4%
Disgusted 45.3%

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 96.6%

Categories

Imagga

people portraits 97.2%
paintings art 2.3%

Text analysis

Amazon

R
R R R R
Carlson
W
Lo
Sm W
esum
Sm
-mirder nlilims esum Lo
nlilims
-mirder

Google

R R RR R R R Carle on B
R
RR
Carle
on
B