Human Generated Data

Title

Walter Gropius (15 months old) with his father
Date

1884
People

Artist: Loescher & Petsch, German active 1860s-1890s
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Ati Johanssen, BRGA.1.21

Human Generated Data

Title

Walter Gropius (15 months old) with his father

People

Artist: Loescher & Petsch, German active 1860s-1890s

Date

1884

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-26

Human 97.7
Person 97.7
Apparel 97.1
Clothing 97.1
Face 96.3
Person 89.7
Door 81.9
Photo 73
Photography 73
Portrait 73
Coat 72.1
Overcoat 72.1
People 72.1
Suit 64.1
Art 62.4
Man 61.2
Floor 57.5
Text 55.4

Clarifai
created on 2019-03-26

people 99.6
portrait 98.8
one 97.7
art 97.2
adult 96.9
painting 96.6
retro 94.5
man 93.5
print 93.3
wear 92
music 88.7
woman 85.5
leader 84.7
nostalgia 84.1
vintage 83.3
illustration 82.6
writer 81
two 80.8
antique 77.2
old 73.5

Imagga
created on 2019-03-26

bow tie 47.9
necktie 39.3
suit 36.3
person 34.1
man 33.6
garment 32.8
male 29.2
people 29
clothing 28.5
portrait 27.8
adult 24.1
business 22.5
senior 21.6
home 20.7
looking 18.4
old 18.1
office 17.7
businessman 17.7
elderly 17.2
face 17.1
happy 16.9
mature 16.7
smiling 16.6
lifestyle 16.6
smile 16.4
lady 16.2
couple 15.7
alone 15.5
executive 15.2
tie 15.2
indoors 14.9
grandma 14.7
human 14.3
one 14.2
jacket 14
retired 13.6
casual 13.6
hair 13.5
standing 13
black 12.8
handsome 12.5
family 12.5
professional 12.4
fashion 12.1
sitting 12
expression 11.9
attractive 11.9
confident 11.8
desk 11.3
work 11
happiness 11
room 10.2
manager 10.2
color 10
holding 9.9
hand 9.9
corporate 9.5
elegant 9.4
blond 8.9
job 8.8
working 8.8
older 8.7
love 8.7
retirement 8.6
only 8.6
model 8.6
grandfather 8.5
shirt 8.4
health 8.3
vintage 8.3
covering 8.2
indoor 8.2
aged 8.1
guy 8.1
women 7.9
boy 7.8
husband 7.8
men 7.7
modern 7.7
pretty 7.7
businesspeople 7.6
house 7.5
mother 7.5
consumer goods 7.4
style 7.4
glasses 7.4
camera 7.4
pensioner 7.4
successful 7.3
success 7.2
dress 7.2
computer 7.2
posing 7.1
interior 7.1

Google
created on 2019-03-26

Photograph 96.1
Picture frame 88.8
Gentleman 82.8
Vintage clothing 82.5
Snapshot 82
Stock photography 66.6
Portrait 65.1
Photography 62.4
Art 58.1
Retro style 51.3

Microsoft
created on 2019-03-26

wall 96.9
indoor 89
old 62.5
museum 23.4
picture frame 23.4
art 9
victorian 5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 97.1%
Happy 4.3%
Surprised 2.4%
Angry 16.9%
Disgusted 1%
Sad 10.3%
Confused 8.5%
Calm 56.5%

AWS Rekognition

Age 4-7
Gender Female, 82.9%
Sad 3.3%
Angry 3.8%
Happy 0.6%
Disgusted 1.4%
Surprised 2.3%
Confused 2.1%
Calm 86.5%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft

an old photo of a person 80%
a person standing in front of a mirror 62.9%
old photo of a person 62.8%

Text analysis

Amazon

father
Walter
From
his
Gropius
months
Archive
Museum
Walter Gropius (15 months
From Gropius Archive at Busch-Reisinger Museum
at
with
Busch-Reisinger
(15
Old) with his father
-PHOTOGRAPHEN.
LOESCHER
KONIGL
PETSCH.
LOESCHER & PETSCH. KONIGL HOF -PHOTOGRAPHEN.
&
HOF
Old)

Google

LOESCHER &PETSCH, HONIGL HOF-PHOTOGRAPHEN Walter Gropius (15 months old) with his father From Gropius Archive at Busch-Reisinger Museum
&PETSCH,
his
(15
Archive
at
Busch-Reisinger
Museum
LOESCHER
Walter
months
with
HONIGL
HOF-PHOTOGRAPHEN
Gropius
old)
father
From