Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.2

Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 99
Person 99
Person 98.3
Person 98.3
Person 98
Person 97.9
Person 97.8
Person 97.7
Person 97.5
Person 97.2
Person 97
Person 96.4
Person 95.8
Person 95.6
Person 94.8
Indoors 91.4
Room 91.4
Crowd 82.5
Overcoat 81.5
Coat 81.5
Clothing 81.5
Suit 81.5
Apparel 81.5
Audience 71.9
Court 71.6
Classroom 69.5
School 69.5
People 66.9
Suit 66.6
Suit 64.4
Furniture 57.1
Table 57.1

Clarifai
created on 2019-06-07

people 99.8
group 99.8
group together 99.5
leader 99.1
many 98.9
administration 98.1
adult 97.7
several 96.4
five 94.2
woman 93.6
man 93.1
chair 87.5
four 86.3
room 83.9
furniture 82.5
meeting 82.2
war 81.8
education 81.7
home 80.4
sit 76.9

Imagga
created on 2019-06-07

kin 54.8
people 30.1
couple 27.9
room 26.8
male 26.2
man 26.2
person 25.9
adult 25.7
happiness 21.1
men 18.9
happy 18.8
family 18.7
home 17.5
groom 17.4
love 17.3
indoors 16.7
women 16.6
teacher 16.4
bride 16.3
dress 16.2
cheerful 15.4
classroom 15
smiling 14.5
two 14.4
nurse 13.7
portrait 13.6
fashion 13.6
sitting 12.9
together 12.3
lady 12.2
business 12.1
sexy 12
professional 12
wedding 11.9
pretty 11.9
vintage 11.6
lifestyle 11.6
married 11.5
interior 11.5
bouquet 11.4
meeting 11.3
group 11.3
relationship 11.2
mother 11.2
elegance 10.9
holding 10.7
smile 10.7
businessman 10.6
office 10.4
style 10.4
indoor 10
retro 9.8
attractive 9.8
fun 9.7
husband 9.7
educator 9.6
togetherness 9.4
businesswoman 9.1
black 9
suit 9
romance 8.9
celebration 8.8
brunette 8.7
table 8.6
elegant 8.6
wife 8.5
life 8.5
senior 8.4
wine 8.3
new 8.1
team 8.1
romantic 8
job 8
grandfather 7.9
antique 7.8
color 7.8
engagement 7.7
loving 7.6
marriage 7.6
house 7.5
inside 7.4
clothing 7.3
face 7.1
to 7.1
work 7.1

Google
created on 2019-06-07

Event 62.7

Microsoft
created on 2019-06-07

person 100
group 99.3
table 98.8
people 98.6
wall 98.5
indoor 96.2
clothing 93.1
posing 88.7
man 87.5
human face 79.7
black 73.9
music 63.6
dinner 46.9
long 43.9
gathered 28.5
conference room 20.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.4%
Happy 1.7%
Angry 2.3%
Surprised 1.4%
Disgusted 0.5%
Confused 2.7%
Calm 85.2%
Sad 6.2%

AWS Rekognition

Age 35-52
Gender Male, 54%
Surprised 46.4%
Disgusted 45.1%
Sad 48.9%
Angry 45.5%
Confused 45.8%
Calm 48%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Confused 45.7%
Sad 49.9%
Disgusted 45.2%
Calm 47.8%
Happy 45.4%
Surprised 45.2%
Angry 45.8%

AWS Rekognition

Age 45-63
Gender Male, 54.8%
Calm 50.2%
Surprised 45.2%
Angry 45.9%
Disgusted 45.3%
Happy 45.3%
Confused 45.9%
Sad 47.2%

AWS Rekognition

Age 35-52
Gender Male, 99.6%
Disgusted 1.2%
Angry 3.2%
Surprised 1%
Sad 0.5%
Calm 88.4%
Confused 3.1%
Happy 2.6%

AWS Rekognition

Age 35-52
Gender Male, 53.6%
Disgusted 45.1%
Surprised 45.1%
Confused 45.1%
Sad 46.3%
Happy 45.1%
Calm 49.1%
Angry 49.3%

AWS Rekognition

Age 26-43
Gender Female, 51.4%
Surprised 45.1%
Angry 45.6%
Sad 49.7%
Disgusted 45.1%
Happy 45.1%
Calm 49.4%
Confused 45.1%

AWS Rekognition

Age 35-53
Gender Male, 54.8%
Disgusted 45%
Confused 45.5%
Happy 45.9%
Calm 49.2%
Surprised 45.2%
Angry 45.4%
Sad 48.7%

AWS Rekognition

Age 57-77
Gender Male, 53.6%
Confused 45.9%
Surprised 45.2%
Happy 45.2%
Sad 47.7%
Disgusted 45.2%
Angry 48.3%
Calm 47.6%

AWS Rekognition

Age 48-68
Gender Male, 93.5%
Angry 1.1%
Happy 0.2%
Confused 0.5%
Disgusted 0.9%
Sad 1.8%
Surprised 0.6%
Calm 94.9%

AWS Rekognition

Age 48-68
Gender Male, 54.2%
Angry 45.2%
Calm 54.1%
Happy 45.1%
Sad 45.2%
Disgusted 45.1%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 48-68
Gender Male, 53%
Calm 48.6%
Sad 48.7%
Surprised 45.5%
Disgusted 45.6%
Angry 45.6%
Confused 45.5%
Happy 45.5%

AWS Rekognition

Age 45-63
Gender Male, 98.6%
Sad 8.7%
Angry 0.8%
Calm 88.1%
Surprised 0.5%
Disgusted 0.2%
Happy 0.5%
Confused 1.2%

AWS Rekognition

Age 57-77
Gender Male, 54.4%
Surprised 45.5%
Angry 45.9%
Calm 47.1%
Sad 49.2%
Confused 46.3%
Disgusted 45.3%
Happy 45.7%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 81.5%

Categories

Imagga

interior objects 43.6%
events parties 22.7%
people portraits 21.6%
food drinks 9.9%