Human Generated Data

Title

Interior of Cafe MacMahon, Geneva
Date

c. 1935
People

Artist: Erich Salomon, German 1886 - 1944
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.478

Human Generated Data

Title

Interior of Cafe MacMahon, Geneva

People

Artist: Erich Salomon, German 1886 - 1944

Date

c. 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.478

Machine Generated Data

Tags

Amazon
created on 2021-10-07

Person 98.2
Human 98.2
Person 98.1
Poster 96.7
Advertisement 96.7
Person 95.7
Restaurant 94.9
Indoors 86.2
Cafeteria 85.3
Person 83.7
Person 81.1
Room 75.4
Person 74.6
Person 70.8
Text 66.8
Person 64.1
Person 63.7
Person 63.7
Cafe 59.7
Person 57
Person 43.4
Person 43.4

Clarifai
created on 2023-10-14

many 99.8
people 99.7
group 99.1
group together 96.7
adult 96
man 95.3
chair 93.5
crowd 93
administration 92.4
furniture 91.8
meeting 91.2
audience 89.9
woman 89.6
leader 86.5
league 85.7
war 84.1
sit 83.4
education 83
desk 83
room 81.5

Imagga
created on 2021-10-07

classroom 63.6
room 55.6
business 23.7
architecture 22.6
city 21.6
building 21.2
people 20.1
office 20
businessman 18.5
man 17.5
meeting 16.9
center 16.7
male 15.6
old 15.3
history 15.2
group 14.5
travel 14.1
university 13.4
person 12.9
hall 12.8
desk 12.5
tourism 12.4
urban 12.2
work 11.8
church 11.1
musical instrument 11
communication 10.9
team 10.7
table 10.4
buildings 10.4
corporate 10.3
men 10.3
indoors 9.7
sky 9.6
percussion instrument 9.5
finance 9.3
town 9.3
house 9.2
businesswoman 9.1
design 9
success 8.8
job 8.8
conference 8.8
colleagues 8.7
cathedral 8.6
culture 8.5
businesspeople 8.5
cityscape 8.5
happy 8.1
computer 8.1
modern 7.7
chair 7.7
roof 7.6
capital 7.6
manager 7.4
presentation 7.4
teamwork 7.4
historic 7.3
tourist 7.2
board 7.2
marimba 7.1

Google
created on 2021-10-07

Table 95.3
Furniture 94.1
Chair 90.2
Building 86.1
Handwriting 75.6
Event 73.4
Rectangle 72.6
Font 71.7
Room 69.3
History 67.7
Monochrome 67.7
Suit 66.4
Monochrome photography 63
Hall 62.8
Sitting 62.5
Desk 61.9
Paper product 60.6
Art 59.2
Recreation 56.1
Photo caption 54.6

Microsoft
created on 2021-10-07

text 99.6
handwriting 82.4
people 76.7
black and white 61.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Female, 93.9%
Sad 58.9%
Calm 36.8%
Fear 1.5%
Confused 0.9%
Happy 0.8%
Surprised 0.7%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 70.7%
Calm 85.3%
Sad 6.4%
Angry 3.2%
Surprised 1.2%
Happy 1.1%
Fear 1.1%
Disgusted 1%
Confused 0.7%

AWS Rekognition

Age 45-63
Gender Female, 50.1%
Calm 63.4%
Sad 16.9%
Surprised 5.9%
Fear 4.7%
Happy 4.2%
Confused 2.5%
Angry 2%
Disgusted 0.5%

AWS Rekognition

Age 25-39
Gender Female, 66.7%
Calm 67.1%
Sad 21.5%
Confused 4.7%
Happy 4.3%
Angry 1.6%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 25-39
Gender Male, 80.9%
Calm 82.5%
Sad 9.7%
Angry 4.6%
Happy 1.1%
Confused 0.7%
Surprised 0.5%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 21-33
Gender Female, 64.5%
Calm 93.3%
Sad 3.7%
Disgusted 0.7%
Happy 0.7%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 65.5%
Surprised 59.7%
Fear 31.1%
Calm 3.4%
Sad 3.2%
Confused 1.4%
Angry 0.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 19-31
Gender Male, 94.4%
Surprised 68.1%
Angry 12%
Calm 9.1%
Fear 4.2%
Confused 3.8%
Sad 1.1%
Disgusted 1%
Happy 0.6%

AWS Rekognition

Age 13-25
Gender Female, 95.1%
Calm 23.2%
Fear 22.5%
Angry 18.7%
Surprised 17.5%
Sad 8.8%
Confused 5.1%
Happy 2.4%
Disgusted 1.7%

AWS Rekognition

Age 33-49
Gender Female, 67.3%
Sad 59.2%
Calm 40%
Happy 0.3%
Confused 0.3%
Angry 0.2%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 64.7%
Sad 75.3%
Calm 20.1%
Fear 1.9%
Confused 1.1%
Angry 0.8%
Surprised 0.4%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 23-37
Gender Male, 99.1%
Calm 96.9%
Sad 1.8%
Angry 0.5%
Confused 0.2%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Female, 66.7%
Happy 36.3%
Calm 23.4%
Sad 20.4%
Surprised 7.5%
Confused 6.4%
Fear 3.8%
Angry 1.4%
Disgusted 0.9%

AWS Rekognition

Age 23-37
Gender Male, 94.7%
Calm 91.4%
Sad 6.7%
Angry 0.9%
Confused 0.5%
Surprised 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Female, 86.8%
Happy 95.9%
Calm 3%
Angry 0.5%
Sad 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 40-58
Gender Male, 72.6%
Calm 70.5%
Sad 25.3%
Confused 2.2%
Surprised 0.7%
Angry 0.5%
Disgusted 0.4%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Male, 98.5%
Sad 31.8%
Calm 30.4%
Surprised 20.6%
Confused 8.5%
Fear 5.2%
Angry 1.8%
Disgusted 1%
Happy 0.7%

AWS Rekognition

Age 9-19
Gender Female, 72.2%
Angry 29.6%
Happy 24.5%
Calm 20.6%
Surprised 7.3%
Sad 6.2%
Fear 4.3%
Disgusted 3.8%
Confused 3.6%

AWS Rekognition

Age 21-33
Gender Male, 80%
Sad 60.5%
Calm 28.2%
Happy 5.6%
Confused 3.3%
Angry 1%
Surprised 0.8%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 24-38
Gender Male, 82.4%
Angry 39.6%
Calm 27.5%
Surprised 14.7%
Fear 7.1%
Happy 4.3%
Confused 3.3%
Sad 2.2%
Disgusted 1.2%

AWS Rekognition

Age 23-35
Gender Male, 76%
Calm 66.1%
Fear 7.8%
Sad 7.4%
Surprised 6.3%
Angry 4.9%
Confused 4.6%
Happy 1.6%
Disgusted 1.2%

AWS Rekognition

Age 23-35
Gender Female, 61.3%
Fear 91.9%
Surprised 4.1%
Happy 1.9%
Sad 0.8%
Confused 0.5%
Calm 0.4%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Male, 88.9%
Calm 72.2%
Confused 6.4%
Sad 5.6%
Angry 4.7%
Surprised 3.4%
Disgusted 3%
Happy 2.4%
Fear 2.3%

AWS Rekognition

Age 32-48
Gender Male, 95.7%
Sad 42.6%
Calm 31.1%
Fear 8.8%
Surprised 7.5%
Angry 5.8%
Confused 2.3%
Happy 1.4%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Female, 75.2%
Surprised 38.4%
Fear 36.9%
Sad 13.5%
Calm 7.1%
Confused 3.6%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 37-55
Gender Female, 57.1%
Calm 60%
Happy 12.6%
Angry 9.3%
Fear 7.5%
Sad 6.2%
Surprised 1.8%
Confused 1.8%
Disgusted 0.6%

AWS Rekognition

Age 31-47
Gender Female, 57.4%
Sad 63.3%
Happy 19.4%
Calm 14.2%
Angry 2.1%
Fear 0.5%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 89.2%
Sad 48.7%
Happy 15.8%
Fear 15.6%
Calm 8.4%
Surprised 3.4%
Confused 3.3%
Angry 3.1%
Disgusted 1.7%

AWS Rekognition

Age 21-33
Gender Female, 54%
Fear 31.7%
Sad 28.5%
Calm 12.2%
Confused 11.2%
Surprised 9.9%
Angry 3.6%
Disgusted 2.1%
Happy 0.7%

AWS Rekognition

Age 20-32
Gender Male, 66%
Calm 58.4%
Happy 15.7%
Sad 11.2%
Confused 5.8%
Surprised 4.8%
Angry 2%
Fear 1.5%
Disgusted 0.6%

AWS Rekognition

Age 30-46
Gender Male, 81%
Calm 73%
Sad 12.7%
Angry 5.6%
Confused 2.6%
Disgusted 2.3%
Surprised 2.2%
Fear 1%
Happy 0.6%

AWS Rekognition

Age 13-25
Gender Male, 77.5%
Calm 62.4%
Sad 32.7%
Angry 1.6%
Confused 1.6%
Happy 0.6%
Fear 0.5%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 40-58
Gender Female, 61.8%
Calm 63.9%
Happy 27.4%
Surprised 2.4%
Sad 2%
Disgusted 1.5%
Fear 1.1%
Confused 1%
Angry 0.7%

AWS Rekognition

Age 22-34
Gender Male, 81.6%
Calm 37.8%
Sad 30.5%
Surprised 20.3%
Confused 4.5%
Fear 3.6%
Angry 1.7%
Happy 1%
Disgusted 0.7%

AWS Rekognition

Age 28-44
Gender Male, 90.1%
Calm 63.4%
Sad 34.6%
Happy 1%
Angry 0.4%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 8-18
Gender Male, 53.1%
Happy 27%
Sad 24.4%
Calm 23.7%
Fear 15.3%
Surprised 3.7%
Angry 2.8%
Confused 2.7%
Disgusted 0.4%

AWS Rekognition

Age 26-42
Gender Female, 81.3%
Fear 69.9%
Sad 22.7%
Calm 2.1%
Angry 1.9%
Surprised 1.7%
Confused 0.8%
Happy 0.7%
Disgusted 0.2%

AWS Rekognition

Age 31-47
Gender Male, 87.6%
Calm 50.1%
Happy 39.4%
Sad 7.2%
Angry 1.7%
Confused 0.5%
Fear 0.4%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-37
Gender Female, 76.4%
Calm 61.9%
Sad 25%
Happy 5.2%
Angry 4%
Fear 1.5%
Confused 1.4%
Surprised 0.7%
Disgusted 0.2%

AWS Rekognition

Age 26-42
Gender Female, 56.5%
Sad 55%
Calm 41.9%
Confused 1.2%
Happy 0.7%
Angry 0.5%
Fear 0.5%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 56.9%
Happy 60.2%
Calm 16.9%
Confused 7.1%
Sad 4.6%
Angry 4.6%
Surprised 3%
Fear 2.2%
Disgusted 1.3%

AWS Rekognition

Age 26-42
Gender Male, 78%
Sad 85.4%
Calm 12.5%
Confused 0.9%
Happy 0.8%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 36-54
Gender Female, 81.2%
Calm 41.3%
Happy 26.6%
Sad 22.9%
Confused 3.5%
Fear 2.1%
Angry 1.9%
Disgusted 0.8%
Surprised 0.8%

AWS Rekognition

Age 29-45
Gender Male, 70.6%
Sad 87.8%
Calm 6.9%
Happy 3.1%
Fear 1%
Angry 0.5%
Confused 0.5%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 40-58
Gender Male, 67.8%
Sad 69.4%
Calm 28.9%
Happy 0.7%
Confused 0.4%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-54
Gender Female, 59.8%
Sad 79.9%
Surprised 9.7%
Fear 4.6%
Confused 2.4%
Calm 2.4%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Poster 96.7%

Text analysis

Amazon

12.)
M
(the
a
3
of
ahon
Mai
m.
12.) Cafe Mai M ahon (the Daning ) of 3 a m.
Cafe
144
)
Daning

Google

12.) Caft MarMahon (the Damiing ,at 3 a 34
12.)
Caft
MarMahon
(the
Damiing
,at
3
a
34