Human Generated Data

Title

Cafe on the Potsdamer Platz; Berlin
Date

c. 1910
People

Artist: Ernst Matthes, German 1878 - 1918
Classification

Drawings
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Frau Christiane Poppel and her daughter Mrs. Emily Blohm, BR76.9

Human Generated Data

Title

Cafe on the Potsdamer Platz; Berlin

People

Artist: Ernst Matthes, German 1878 - 1918

Date

c. 1910

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Person 98.1
Human 98.1
Person 97.4
Art 97.3
Person 97
Drawing 93.1
Person 93.1
Furniture 92.8
Chair 92.8
Person 89.3
Person 84
Person 80.6
Sketch 80
Painting 77.2
Person 76.9
Accessories 76.4
Accessory 76.4
Sunglasses 76.4
Chair 50.4

Clarifai
created on 2020-05-02

people 99.9
group 99
adult 98.8
woman 97.8
man 96.9
group together 96.6
furniture 95.6
many 94.1
several 93.3
wear 92.3
art 92.2
veil 90.3
recreation 88.9
child 86.4
street 86.3
home 85.7
two 85.2
administration 84.9
four 83.8
room 83.7

Imagga
created on 2020-05-02

stall 31.5
seller 24
painter 20.7
chair 20.3
people 18.9
house 17.5
adult 15.5
old 15.3
building 14.9
sitting 14.6
window 14
home 12.8
city 11.6
person 11.5
guillotine 11.5
man 11.4
furniture 11.3
seat 11.3
architecture 10.9
glass 10.9
table 10.7
stretcher 10.6
interior 10.6
urban 10.5
structure 9.9
portrait 9.7
patio 9.3
instrument of execution 9.3
lifestyle 8.7
industry 8.5
litter 8.5
brick 8.5
travel 8.4
black 8.4
wood 8.3
fashion 8.3
human 8.2
happy 8.1
transportation 8.1
day 7.8
smile 7.8
construction 7.7
relaxation 7.5
work 7.5
leisure 7.5
business 7.3
smiling 7.2
steel 7.1
modern 7

Google
created on 2020-05-02

Snapshot 82
Stock photography 77.2
Art 70.9
Photography 67.8
Painting 64.6
Black-and-white 56.4

Microsoft
created on 2020-05-02

drawing 99.6
sketch 99.3
text 99.2
painting 98.6
child art 93.1
table 75.1
illustration 74.9
furniture 71.6
clothing 70
person 67.2
cartoon 57

Face analysis

Amazon

Google

AWS Rekognition

Age 28-44
Gender Male, 54.6%
Fear 45.2%
Sad 45.6%
Disgusted 45.1%
Angry 48.8%
Surprised 47%
Calm 48.1%
Confused 45.2%
Happy 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Chair 92.8%
Painting 77.2%
Sunglasses 76.4%

Captions

Microsoft

a group of people standing next to a window 69.8%
a group of people standing in front of a window 68.5%
a group of people in a store window 58.4%