Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.
Date

c. 1903
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Hale House": Hale House, Boston, Mass.: Lake and Woods.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3044.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Hand 99.6
Holding Hands 99.4
Human 99.4
Person 99.3
Person 99
People 87.7
Clothing 73.5
Apparel 73.5
Pants 58.9
Plant 58.5

Clarifai
created on 2019-06-06

people 99.9
child 99.3
two 97.2
boy 96
group 95.2
man 93.8
group together 92.6
family 92.2
sibling 90.1
adult 88.9
son 88.8
wear 88.4
three 85.4
affection 84.3
war 83.3
offspring 80.6
sepia 76.4
monochrome 76.3
four 75.7
portrait 74.8

Imagga
created on 2019-06-06

child 59.8
beach 52.1
sand 34
man 32.4
sea 32.1
mother 29.7
parent 29.6
male 29.6
people 27.4
vacation 26.2
happiness 24.3
sunset 24.3
summer 23.8
lifestyle 23.1
outdoors 22.9
happy 22.6
love 22.1
water 22
couple 21.8
ocean 21.8
family 21.4
person 20.7
adult 20.7
fun 20.2
together 20.2
walking 19.9
sky 19.8
father 19.6
kin 19.3
dad 18.9
silhouette 18.2
sibling 17
outdoor 16.8
juvenile 16.6
walk 16.2
two 16.1
shore 15.8
holiday 15.8
boy 15.7
active 15.3
coast 15.3
kid 15.1
joy 14.2
leisure 14.1
play 13.8
playing 13.7
brother 13.1
smiling 13
sun 12.9
outside 12.8
romance 12.5
running 12.5
son 12.3
relationship 12.2
relax 11.8
run 11.6
holding 11.6
hands 11.3
evening 11.2
youth 11.1
portrait 11
girls 10.9
sunlight 10.7
sport 10.4
sunny 10.3
relaxation 10.1
smile 10
travel 9.9
recreation 9.9
boyfriend 9.6
girlfriend 9.6
dusk 9.5
women 9.5
men 9.5
healthy 9.5
day 9.4
clothing 9.4
life 9.1
romantic 8.9
daughter 8.9
sexy 8.8
jump 8.6
kids 8.5
casual 8.5
coastline 8.5
attractive 8.4
pretty 8.4
health 8.3
children 8.2
exercise 8.2
autumn 7.9
grass 7.9
swimsuit 7.9
standing 7.8
black 7.8
sandy 7.8
jumping 7.7
loving 7.6
vacations 7.5
friends 7.5
free 7.5
sunshine 7.5
waves 7.4
cheerful 7.3
childhood 7.2
river 7.1
look 7

Google
created on 2019-06-06

Photograph 96.9
People 93.9
Snapshot 84.9
Photography 75.7
Picture frame 72.4
Stock photography 72.2
Tree 68.7
Gesture 62.4
Art 58.1
Black-and-white 56.4
Photographic paper 52.1
Family 51.8

Microsoft
created on 2019-06-06

outdoor 98.4
ground 96.9
clothing 96.2
child 86.8
person 86.3
athletic game 79.7
man 77.9
boy 77.4
white 72.3
player 69.8
black 68.5
old 53.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-66
Gender Male, 53.4%
Disgusted 45.5%
Confused 45.7%
Happy 46.4%
Sad 50.4%
Surprised 45.6%
Calm 45.9%
Angry 45.6%

AWS Rekognition

Age 60-90
Gender Male, 54%
Confused 45.2%
Sad 46.2%
Disgusted 45.3%
Angry 45.3%
Happy 46.2%
Calm 51.5%
Surprised 45.2%

Feature analysis

Amazon

Person 99.3%

Categories

Imagga

nature landscape 51.5%
pets animals 40.1%
beaches seaside 7.4%

Captions

Microsoft
created on 2019-06-06

a black and white photo of a man 93.2%
a vintage photo of a man 93.1%
a black and white photo of a boy 74.2%