Human Generated Data

Title

Cafe Lafayette
Date

1928
People

Artist: Albert E. Henselmann, German 1890 - 1974
Classification

Paintings
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Mr. and Mrs. Roger Van Nest Powelson, BR71.59

Human Generated Data

Title

Cafe Lafayette

People

Artist: Albert E. Henselmann, German 1890 - 1974

Date

1928

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 98.9
Person 98.9
Audience 96.3
Crowd 96.3
Person 94.6
Person 87.6
Advertisement 86.7
Indoors 82.2
Interior Design 82.2
Person 81.9
Art 79.8
Person 76.7
Person 74.2
Person 74.1
Collage 71.6
Person 70.4
Person 69.5
Text 64.7
Room 64.1
Poster 57.2
Pedestrian 55.7
Person 50
Person 47.8
Person 46.8

Clarifai
created on 2020-04-24

people 100
many 99.9
group 99.9
adult 97.3
crowd 96
man 95.1
group together 92.9
woman 89.9
illustration 88.9
war 88.4
art 88.3
leader 88.2
administration 87.9
child 85.9
several 85.3
wear 81.9
military 81.3
recreation 81.1
uniform 81.1
audience 80.4

Imagga
created on 2020-04-24

decoration 23
freight car 20.5
shop 20.2
art 19.9
old 17.4
brass 17.3
architecture 17.2
building 17.1
car 16.2
graffito 15.9
ancient 14.7
shoe shop 14.2
balcony 13.8
mercantile establishment 13.8
sculpture 13.8
glass 13.5
wheeled vehicle 13
case 12.3
wind instrument 12.1
design 11.2
ornate 11
house 10.8
history 10.7
blackboard 10.5
antique 10.4
chandelier 10.3
famous 10.2
historic 10.1
vehicle 9.8
statue 9.5
culture 9.4
place of business 9.2
travel 9.1
party 8.6
grunge 8.5
black 8.4
church 8.3
city 8.3
structure 8.3
musical instrument 8.3
tourism 8.2
drawing 8.2
style 8.1
landmark 8.1
symbol 8.1
religion 8.1
home 8
interior 7.9
pattern 7.5
decorative 7.5
monument 7.5
rich 7.4
retro 7.4
object 7.3
decor 7.1
window 7

Google
created on 2020-04-24

Photograph 95.7
Art 78.6
Picture frame 78.1
Photography 75.7
Room 65.7
Stock photography 59.4
Team 59.4
Collection 57.1
Black-and-white 56.4
Crowd 50.7

Microsoft
created on 2020-04-24

text 98.7
cartoon 96.1
person 94.8
clothing 84.7
drawing 81.6
posing 79.1
human face 61.2
old 59.1
man 53.7
picture frame 9.7

Face analysis

Amazon

AWS Rekognition

Age 51-69
Gender Male, 54.9%
Happy 45%
Fear 45%
Calm 46.4%
Disgusted 45%
Confused 45.1%
Surprised 45%
Angry 45.1%
Sad 53.4%

AWS Rekognition

Age 31-47
Gender Male, 54.5%
Fear 45.4%
Disgusted 45%
Angry 45.4%
Happy 45%
Calm 46.7%
Surprised 45.1%
Sad 52.2%
Confused 45.1%

AWS Rekognition

Age 20-32
Gender Male, 54.8%
Happy 45%
Surprised 45%
Calm 51.9%
Fear 45.1%
Sad 46.9%
Disgusted 45%
Confused 45.1%
Angry 45.8%

AWS Rekognition

Age 22-34
Gender Female, 50.1%
Confused 45.1%
Calm 47.6%
Disgusted 45.2%
Surprised 45.1%
Sad 47.7%
Happy 48.7%
Angry 45.2%
Fear 45.3%

AWS Rekognition

Age 21-33
Gender Male, 54.7%
Angry 45.2%
Sad 48.7%
Happy 45.1%
Fear 45.3%
Confused 45.7%
Surprised 45.1%
Disgusted 45.1%
Calm 49.8%

AWS Rekognition

Age 20-32
Gender Male, 51.9%
Calm 52.6%
Angry 45.2%
Confused 45.1%
Fear 45.5%
Happy 45.1%
Surprised 46.4%
Sad 45.1%
Disgusted 45.1%

AWS Rekognition

Age 32-48
Gender Male, 51.8%
Surprised 45.6%
Disgusted 45.1%
Confused 45.1%
Calm 50.7%
Sad 45.4%
Happy 47.7%
Fear 45.2%
Angry 45.2%

AWS Rekognition

Age 2-8
Gender Female, 50.2%
Fear 49.6%
Surprised 49.5%
Calm 49.9%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.8%
Angry 49.7%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Surprised 49.5%
Confused 49.6%
Happy 49.5%
Angry 49.8%
Calm 49.6%
Fear 49.5%
Disgusted 49.5%
Sad 49.9%

AWS Rekognition

Age 38-56
Gender Male, 50.3%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Happy 49.7%
Calm 49.9%
Surprised 49.5%
Sad 49.8%

AWS Rekognition

Age 20-32
Gender Female, 53.1%
Calm 45.6%
Angry 45.3%
Disgusted 45.9%
Fear 47.4%
Surprised 45.3%
Sad 49.5%
Confused 45.8%
Happy 45.3%

AWS Rekognition

Age 28-44
Gender Male, 54%
Happy 45%
Angry 45%
Calm 54.8%
Disgusted 45%
Surprised 45%
Confused 45%
Fear 45%
Sad 45.1%

AWS Rekognition

Age 18-30
Gender Female, 52.9%
Angry 50.7%
Sad 48.1%
Happy 45%
Calm 45.7%
Surprised 45%
Fear 45.1%
Confused 45.4%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Male, 50.4%
Angry 49.5%
Surprised 49.5%
Fear 49.5%
Calm 49.7%
Sad 50.2%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 22-34
Gender Female, 51.5%
Calm 47.4%
Confused 46.6%
Happy 48.6%
Fear 45.1%
Disgusted 45.2%
Angry 45.1%
Sad 46.7%
Surprised 45.3%

AWS Rekognition

Age 22-34
Gender Male, 54.1%
Calm 47.1%
Happy 45%
Sad 49.1%
Angry 47.9%
Disgusted 45.2%
Confused 45.2%
Surprised 45.1%
Fear 45.5%

AWS Rekognition

Age 20-32
Gender Female, 52.4%
Calm 47.1%
Angry 51.7%
Happy 45.4%
Disgusted 45.2%
Fear 45%
Sad 45%
Confused 45.1%
Surprised 45.5%

AWS Rekognition

Age 31-47
Gender Male, 50.4%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Angry 49.5%
Calm 50.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.1%
Sad 45.2%
Disgusted 45.1%
Angry 45.2%
Fear 46.1%
Surprised 47.3%
Happy 45.2%
Calm 50.9%
Confused 45.1%

AWS Rekognition

Age 21-33
Gender Female, 50.3%
Sad 45.5%
Confused 45.2%
Happy 45.1%
Disgusted 45.2%
Calm 53.2%
Angry 45.3%
Surprised 45.3%
Fear 45.1%

AWS Rekognition

Age 21-33
Gender Male, 50.7%
Fear 45.1%
Sad 45.8%
Disgusted 45%
Happy 45%
Confused 45.2%
Calm 53.7%
Surprised 45.1%
Angry 45%

AWS Rekognition

Age 15-27
Gender Female, 50.4%
Fear 49.5%
Surprised 49.5%
Angry 49.6%
Sad 49.7%
Calm 50%
Happy 49.6%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 14-26
Gender Female, 50.2%
Surprised 49.5%
Calm 50.2%
Angry 49.5%
Disgusted 49.6%
Sad 49.7%
Happy 49.5%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 26-40
Gender Female, 50.4%
Confused 45%
Sad 45.1%
Calm 54.8%
Fear 45%
Happy 45%
Disgusted 45%
Angry 45%
Surprised 45%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Calm 50.5%
Sad 49.5%

AWS Rekognition

Age 48-66
Gender Male, 50.2%
Fear 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.5%
Surprised 49.5%
Confused 50.4%
Disgusted 49.5%
Calm 49.5%

AWS Rekognition

Age 19-31
Gender Male, 50.3%
Sad 49.7%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Calm 50.3%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 20-32
Gender Female, 50.4%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Calm 50.3%
Confused 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.7%

AWS Rekognition

Age 38-56
Gender Female, 50.9%
Angry 50.1%
Happy 45.2%
Disgusted 45.5%
Surprised 45.2%
Fear 45.2%
Sad 46.3%
Confused 45.4%
Calm 47.1%

AWS Rekognition

Age 13-23
Gender Male, 50.3%
Disgusted 49.5%
Angry 49.6%
Happy 49.8%
Sad 49.5%
Confused 49.5%
Calm 49.9%
Fear 49.5%
Surprised 49.6%

AWS Rekognition

Age 7-17
Gender Male, 50.2%
Surprised 49.5%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 50.3%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 41-59
Gender Female, 50%
Angry 50.4%
Disgusted 49.5%
Calm 49.5%
Fear 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.4%
Surprised 49.5%
Confused 49.5%
Happy 49.8%
Angry 49.5%
Calm 49.9%
Fear 49.5%
Disgusted 49.5%
Sad 49.6%

AWS Rekognition

Age 16-28
Gender Male, 53.7%
Surprised 45.1%
Sad 45.9%
Happy 45%
Calm 45%
Angry 45%
Fear 53.9%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 56-74
Gender Male, 50.2%
Sad 49.6%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Fear 50.3%

AWS Rekognition

Age 12-22
Gender Female, 52.1%
Fear 45.5%
Confused 45%
Angry 45%
Surprised 45%
Disgusted 45%
Calm 45.5%
Happy 45%
Sad 53.8%

AWS Rekognition

Age 38-56
Gender Male, 53.9%
Fear 45.4%
Confused 45.6%
Calm 47.6%
Sad 48.1%
Happy 45.1%
Angry 47.8%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 10-20
Gender Female, 50.4%
Angry 49.8%
Calm 49.8%
Disgusted 49.6%
Happy 49.8%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Sad 49.5%

AWS Rekognition

Age 14-26
Gender Female, 50.2%
Surprised 49.5%
Happy 49.5%
Calm 50.2%
Disgusted 49.5%
Angry 49.6%
Fear 49.5%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 28-44
Gender Female, 50.9%
Fear 45%
Disgusted 45.1%
Surprised 45%
Happy 45%
Angry 45%
Sad 54.1%
Confused 45.1%
Calm 45.5%

AWS Rekognition

Age 29-45
Gender Female, 50.3%
Confused 49.5%
Calm 49.7%
Angry 49.6%
Disgusted 49.6%
Fear 49.8%
Surprised 49.6%
Sad 49.7%
Happy 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.1%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Confused 49.6%
Happy 49.5%
Calm 49.6%
Surprised 49.5%
Sad 50.3%

Feature analysis

Amazon

Person 98.9%
Poster 57.2%

Captions

Microsoft

a group of people posing for a photo 83.1%
a group of people posing for the camera 83%
an old photo of a group of people posing for the camera 78.7%

Text analysis

Amazon

AMEN
BEXAGEARA
CET

Google

DAMEN
DAMEN ETAGEAR
ETAGEAR