Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Carpentry.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3206.3

Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Carpentry.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3206.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.8
Crowd 99.8
Audience 99.8
Speech 99
Person 95.6
Person 94.9
Person 90.9
Lecture 84.5
Clothing 82.6
Apparel 82.6
Overcoat 77.3
Coat 77.3
Photo 61.8
Portrait 61.8
Photography 61.8
Face 61.8
Suit 60.6
Linen 57.5
Home Decor 57.5
Press Conference 57.2
Indoors 56.5

Clarifai
created on 2019-06-06

people 99.8
furniture 98.9
chair 98.8
administration 97.6
adult 97.4
leader 97
room 96.9
group 96.2
two 96.2
man 95
group together 93.4
woman 92.3
desk 91.3
wear 91.2
three 88.1
seat 87.1
four 87.1
one 86.7
indoors 86.6
several 85.6

Imagga
created on 2019-06-06

musical instrument 33.3
man 28.9
device 27.9
male 24.8
business 24.3
people 21.7
person 19.7
businessman 18.5
office 17.1
electronic instrument 15.5
sitting 15.4
adult 15.2
table 15.1
women 15
chair 13.3
wind instrument 13
men 12.9
worker 12.6
professional 12.6
interior 12.4
smiling 11.6
group 11.3
modern 11.2
percussion instrument 10.8
holding 10.7
washboard 10.7
indoors 10.5
couple 10.4
work 10.4
room 10.1
communication 10.1
indoor 10
technology 9.6
lifestyle 9.4
city 9.1
job 8.8
executive 8.8
happy 8.8
light 8.7
corporate 8.6
glass 8.6
career 8.5
equipment 8.4
phone 8.3
fashion 8.3
window 8.2
businesswoman 8.2
desk 8
day 7.8
color 7.8
gate 7.8
brass 7.7
talking 7.6
hand 7.6
meeting 7.5
one 7.5
silhouette 7.4
cheerful 7.3
portrait 7.1
telephone 7.1
working 7.1

Google
created on 2019-06-06

Photograph 96.7
Snapshot 87.4
Room 74.4
Vintage clothing 69.4
Photography 67.8
Family 58
Art 50.2

Microsoft
created on 2019-06-06

clothing 98.7
person 98.2
man 93.8
suit 92.9
black and white 64
old 45

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 92.4%
Surprised 0.6%
Happy 0.2%
Sad 1.7%
Angry 1.1%
Disgusted 0.3%
Confused 0.9%
Calm 95.4%

AWS Rekognition

Age 17-27
Gender Male, 54.6%
Surprised 45.1%
Angry 45.2%
Sad 48.2%
Happy 45.1%
Disgusted 45.1%
Calm 51.2%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Angry 5.2%
Sad 37.4%
Disgusted 0.3%
Calm 52.7%
Surprised 0.9%
Confused 3%
Happy 0.5%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 95.6%
Person 94.9%
Person 90.9%
Suit 60.6%

Text analysis

Amazon

S
S Sg
Sg

Google

Carpentry
Carpentry