Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.1

Human Generated Data

Title

Charity, Organizations: United States. Missouri. St. Louis. Provident Association: St. Louis Provident Association, St. Louis, Mo.: Board of Directors

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.850.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 97.7
Person 97.7
Person 97.5
Person 97.2
Person 97.2
Room 96.8
Indoors 96.8
Person 94
Person 90.5
Person 86.7
Person 85
Person 81.4
Court 80.3
Person 78.2
Waiting Room 76.1
Crowd 75
Person 74.4
Person 73.4
Furniture 67.6
Art 66
Painting 66
Reception 65.7
Reception Room 65.7
Audience 64.9
Person 64.8
People 64
Jury 57.9
Pub 56.9
Person 49.2

Clarifai
created on 2019-06-07

people 100
group 99.7
many 99.3
administration 99.2
leader 98.9
group together 98.9
adult 98.5
military 97.3
chair 97.2
several 94.8
furniture 94.6
home 93.4
war 93.2
man 92.5
room 90.9
sit 90.5
uniform 89.1
five 88
woman 85.9
soldier 85.4

Imagga
created on 2019-06-07

room 28.7
man 25.5
piano 23.1
chair 22
stringed instrument 21.6
percussion instrument 21.4
musical instrument 21.2
male 20.5
people 20.1
sitting 19.7
keyboard instrument 19.2
interior 18.5
grand piano 18
indoors 17.5
person 16.9
classroom 15.1
lifestyle 14.4
home 14.3
women 14.2
old 13.9
men 13.7
light 13.3
device 13.3
adult 12.4
smiling 12.3
black 12.1
business 11.5
couple 11.3
happy 11.3
table 11.2
upright 11
style 10.4
fire 10.3
window 10.3
restaurant 10.2
architecture 10.1
inside 10.1
indoor 10
smile 10
fashion 9.8
luxury 9.4
friends 9.4
furniture 9.3
house 9.2
holding 9.1
office 8.9
cheerful 8.9
group 8.9
steel 8.8
fireplace 8.7
wall 8.7
work 8.6
industry 8.5
living 8.5
two 8.5
passion 8.5
senior 8.4
modern 8.4
portrait 8.4
relaxation 8.4
smoke 8.4
leisure 8.3
fun 8.2
relaxing 8.2
looking 8
happiness 7.8
lamp 7.8
color 7.8
glass 7.8
attractive 7.7
technology 7.4
industrial 7.3
decoration 7.2
dress 7.2
sexy 7.2
night 7.1

Google
created on 2019-06-07

Photograph 96.1
Snapshot 85.2
Room 65.7
Photography 62.4
Stock photography 62.1
Vintage clothing 52.1

Microsoft
created on 2019-06-07

person 99
clothing 98.5
sitting 96.3
man 95.7
black 78.4
people 76.5
old 62.9
white 61.7
group 61.7
smile 57.8
seated 30.3
older 22.1
family 20.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 54.6%
Disgusted 45.1%
Sad 45.5%
Angry 45.4%
Calm 52.6%
Confused 45.3%
Surprised 45.5%
Happy 45.6%

AWS Rekognition

Age 38-59
Gender Male, 54.1%
Angry 51.8%
Surprised 45.1%
Sad 45.8%
Confused 45.1%
Happy 45.1%
Calm 46.7%
Disgusted 45.3%

AWS Rekognition

Age 38-59
Gender Male, 54.6%
Confused 45.3%
Sad 49.3%
Disgusted 46.5%
Calm 47.8%
Happy 45.1%
Surprised 45.2%
Angry 45.9%

AWS Rekognition

Age 26-43
Gender Male, 52.5%
Disgusted 45.2%
Confused 45.4%
Happy 45.1%
Calm 49.9%
Surprised 45.3%
Angry 45.5%
Sad 48.6%

AWS Rekognition

Age 45-63
Gender Male, 54.1%
Surprised 45.3%
Disgusted 45.1%
Sad 49.1%
Angry 49.5%
Confused 45.2%
Calm 45.2%
Happy 45.6%

AWS Rekognition

Age 48-68
Gender Male, 54.8%
Calm 53.4%
Happy 45.1%
Disgusted 45.1%
Surprised 45.2%
Angry 45.3%
Sad 45.7%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Female, 53.4%
Disgusted 48.5%
Angry 45.4%
Surprised 45.6%
Sad 46.5%
Calm 47.9%
Confused 45.2%
Happy 45.8%

AWS Rekognition

Age 60-90
Gender Male, 50.3%
Disgusted 45.2%
Confused 45.2%
Surprised 45.2%
Calm 51.1%
Happy 45.1%
Angry 46%
Sad 47.1%

AWS Rekognition

Age 38-59
Gender Female, 51.1%
Disgusted 47%
Surprised 45.3%
Happy 45.4%
Calm 50.5%
Angry 45.4%
Sad 46.1%
Confused 45.2%

AWS Rekognition

Age 38-59
Gender Male, 54%
Disgusted 45.1%
Surprised 45.2%
Confused 45.2%
Calm 45.6%
Angry 47.9%
Happy 45.2%
Sad 50.9%

AWS Rekognition

Age 38-59
Gender Male, 52.2%
Confused 45.2%
Calm 48.4%
Happy 45.8%
Disgusted 45.1%
Sad 49.8%
Angry 45.3%
Surprised 45.2%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Sad 48.8%
Calm 46%
Angry 45.7%
Happy 48.1%
Disgusted 45.4%
Confused 45.5%
Surprised 45.4%

AWS Rekognition

Age 48-68
Gender Female, 50.7%
Disgusted 48.6%
Angry 47%
Surprised 45.4%
Sad 46.1%
Calm 46.9%
Confused 45.3%
Happy 45.6%

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 66%

Text analysis

Amazon

16