Human Generated Data

Title

Untitled (men at banquet with men standing along wall)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5823

Human Generated Data

Title

Untitled (men at banquet with men standing along wall)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5823

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Tablecloth 99.4
Furniture 98.9
Person 98.7
Human 98.7
Person 98.7
Person 96.9
Person 96.8
Person 96.5
Person 96.4
Person 96.2
Person 96
Chair 96
Dining Table 95.7
Table 95.7
Person 95.5
Restaurant 95.4
Chair 93.6
Chair 92.6
Home Decor 85.3
Linen 85.3
Person 79.6
Person 79.4
Food 75.5
Meal 75.5
Indoors 70.3
Room 70.3
Reception 65.5
Person 65.1
Person 64.4
Waiting Room 63.1
Person 61.3
Reception Room 61.1
Person 60.2
Dish 58.1
Chair 55.9
Food Court 55.9

Clarifai
created on 2019-11-16

people 99.7
group together 99.4
group 99.1
many 98.8
adult 92.8
chair 92.8
crowd 92.4
furniture 91.9
administration 91.5
woman 91.2
man 91.2
leader 90.8
military 90.2
audience 88.3
vehicle 87
spectator 82.8
war 78.5
room 75.1
several 71.8
seat 67.4

Imagga
created on 2019-11-16

hall 32.6
urban 24.4
interior 23
city 21.6
station 20.3
business 19.4
table 19
room 18.8
restaurant 18.4
people 17.8
chair 17.6
building 17.5
transportation 17
transport 16.4
travel 16.2
train 14.9
modern 14.7
empty 14.6
architecture 14.1
center 13.9
inside 13.8
glass 13.3
office 12.9
metro 12.8
crowd 12.5
passenger 12.3
classroom 12.1
window 12.1
subway 11.8
structure 11.8
airport 11.2
group 10.5
wall 10.2
indoor 10
steel 9.7
public 9.7
cafeteria 9.6
walking 9.5
motion 9.4
man 9.4
light 9.3
seat 9.3
floor 9.3
dinner 9.3
new 8.9
tables 8.9
metal 8.8
corridor 8.8
railway 8.8
work 8.8
scene 8.6
move 8.6
industry 8.5
gymnasium 8.4
furniture 8.4
facility 7.9
underground 7.9
rush 7.9
chairs 7.8
roof 7.6
fast 7.5
reflection 7.5
row 7.4
technology 7.4
vacation 7.4
design 7.3
vehicle 7.1
equipment 7

Google
created on 2019-11-16

Photograph 95.1
Snapshot 82
Event 62.7
Black-and-white 56.4

Microsoft
created on 2019-11-16

table 97.6
text 87.7
person 85.1
chair 77
furniture 74.7
black and white 67.1
people 63.6
clothing 53.3
old 48.8
posing 38.4
dining table 7.4
dining room 6.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-55
Gender Male, 52.4%
Angry 46.6%
Happy 45.9%
Disgusted 45.5%
Fear 45.3%
Confused 45.5%
Surprised 45.3%
Calm 49.1%
Sad 46.8%

AWS Rekognition

Age 30-46
Gender Male, 54.9%
Sad 45%
Disgusted 45%
Confused 45%
Surprised 45%
Happy 54.8%
Fear 45%
Angry 45%
Calm 45.1%

AWS Rekognition

Age 23-35
Gender Male, 54%
Angry 45.2%
Happy 45.1%
Disgusted 45.1%
Calm 53.7%
Fear 45%
Surprised 45%
Sad 45.6%
Confused 45.1%

AWS Rekognition

Age 31-47
Gender Male, 53.8%
Sad 50.4%
Calm 49.5%
Angry 45%
Fear 45%
Happy 45%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Male, 54.4%
Surprised 45%
Angry 45%
Fear 45%
Calm 54.7%
Confused 45.1%
Sad 45.1%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 31-47
Gender Male, 54%
Happy 54%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 45.8%
Angry 45%

AWS Rekognition

Age 34-50
Gender Male, 54.6%
Surprised 45.1%
Calm 47.1%
Fear 45.1%
Disgusted 46%
Happy 45.1%
Angry 45.4%
Sad 50.7%
Confused 45.5%

AWS Rekognition

Age 28-44
Gender Male, 54.8%
Fear 45.1%
Surprised 45.2%
Angry 45.8%
Calm 50.8%
Sad 45.3%
Happy 47.5%
Disgusted 45.2%
Confused 45.2%

AWS Rekognition

Age 52-70
Gender Male, 54.9%
Angry 46.4%
Happy 45.2%
Disgusted 46.1%
Calm 51.6%
Fear 45.1%
Surprised 45.2%
Sad 45.2%
Confused 45.3%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Calm 45.6%
Angry 45.1%
Disgusted 45.1%
Happy 53.8%
Sad 45.1%
Confused 45.1%
Fear 45.1%
Surprised 45.3%

AWS Rekognition

Age 30-46
Gender Male, 53.6%
Happy 45%
Fear 45.4%
Angry 46.2%
Confused 49.2%
Calm 46.9%
Disgusted 45.3%
Surprised 45.2%
Sad 46.8%

AWS Rekognition

Age 32-48
Gender Male, 54.3%
Fear 45.2%
Calm 49.2%
Surprised 45.1%
Confused 45.5%
Disgusted 45.8%
Happy 45.4%
Sad 48.5%
Angry 45.3%

AWS Rekognition

Age 25-39
Gender Male, 55%
Sad 45.7%
Disgusted 45.1%
Fear 45%
Angry 45.6%
Happy 45%
Surprised 45%
Calm 53.5%
Confused 45.1%

AWS Rekognition

Age 29-45
Gender Male, 50.5%
Calm 50.1%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Happy 49.5%
Fear 49.5%
Sad 49.7%
Disgusted 49.6%

AWS Rekognition

Age 48-66
Gender Male, 54.8%
Surprised 45.2%
Fear 45.2%
Happy 45.5%
Sad 45.3%
Calm 50.8%
Disgusted 47.3%
Angry 45.3%
Confused 45.4%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Fear 45%
Calm 54.8%
Angry 45%
Happy 45%
Confused 45%
Disgusted 45%
Sad 45.1%
Surprised 45.1%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Fear 49.5%
Disgusted 49.5%
Calm 50.1%
Angry 49.5%
Sad 49.8%
Surprised 49.5%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 39-57
Gender Male, 54.3%
Happy 45%
Disgusted 45.1%
Sad 52.5%
Angry 45.6%
Surprised 45%
Fear 45%
Calm 46.5%
Confused 45.1%

AWS Rekognition

Age 36-54
Gender Male, 54.6%
Disgusted 45.2%
Fear 45.1%
Surprised 45.3%
Angry 45.3%
Calm 51.6%
Happy 45.1%
Confused 45.7%
Sad 46.9%

AWS Rekognition

Age 24-38
Gender Male, 50.1%
Sad 49.8%
Fear 49.8%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.6%
Calm 49.7%
Surprised 49.6%

AWS Rekognition

Age 30-46
Gender Male, 50.2%
Fear 49.6%
Angry 49.6%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.8%
Sad 50%
Disgusted 49.5%

AWS Rekognition

Age 46-64
Gender Male, 50.5%
Angry 49.9%
Sad 49.6%
Calm 49.7%
Fear 49.5%
Happy 49.5%
Surprised 49.6%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 51-69
Gender Male, 54.8%
Angry 45.3%
Sad 45.4%
Confused 45.2%
Calm 53.9%
Surprised 45.1%
Happy 45%
Disgusted 45.2%
Fear 45%

AWS Rekognition

Age 26-40
Gender Male, 54.8%
Calm 50.8%
Confused 45.3%
Happy 45.4%
Disgusted 45.8%
Surprised 45.2%
Sad 46.9%
Fear 45.1%
Angry 45.5%

AWS Rekognition

Age 46-64
Gender Male, 50.4%
Fear 49.5%
Surprised 49.5%
Confused 49.7%
Sad 49.9%
Disgusted 49.5%
Happy 49.5%
Calm 49.7%
Angry 49.6%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Calm 50%
Surprised 49.6%
Angry 49.6%
Confused 49.5%
Happy 49.5%
Fear 49.6%
Sad 49.6%
Disgusted 49.5%

AWS Rekognition

Age 39-57
Gender Male, 50.5%
Sad 49.6%
Angry 49.5%
Calm 50%
Happy 49.6%
Surprised 49.7%
Confused 49.6%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.5%
Disgusted 49.5%
Fear 49.5%
Calm 49.8%
Surprised 49.6%
Angry 49.8%
Confused 49.6%
Happy 49.5%
Sad 49.6%

AWS Rekognition

Age 40-58
Gender Male, 50.5%
Sad 49.7%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Fear 49.5%
Confused 49.5%
Calm 50.2%

AWS Rekognition

Age 51-69
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.7%
Fear 49.5%
Sad 50.2%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50.5%
Happy 49.5%
Sad 49.5%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Surprised 50.1%
Fear 49.5%
Confused 49.7%

AWS Rekognition

Age 39-57
Gender Male, 54.5%
Sad 54.1%
Surprised 45%
Angry 45.1%
Calm 45.1%
Happy 45%
Fear 45%
Disgusted 45.6%
Confused 45.1%

AWS Rekognition

Age 32-48
Gender Male, 50.5%
Calm 50.1%
Sad 49.6%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Surprised 49.5%
Confused 49.6%
Disgusted 49.5%

AWS Rekognition

Age 48-66
Gender Male, 50.5%
Confused 49.6%
Surprised 49.7%
Sad 49.7%
Calm 50%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Angry 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.5%
Confused 49.6%
Angry 49.6%
Surprised 49.6%
Calm 50%
Disgusted 49.5%
Fear 49.5%
Sad 49.6%
Happy 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.5%
Fear 49.5%
Calm 50.2%
Disgusted 49.5%
Angry 49.5%
Surprised 49.6%
Happy 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 50-68
Gender Male, 50.5%
Sad 49.6%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Confused 49.5%
Calm 50.3%

AWS Rekognition

Age 47-65
Gender Male, 50.4%
Fear 49.5%
Sad 49.7%
Angry 49.5%
Calm 49.7%
Confused 50%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Calm 49.6%
Fear 49.6%
Happy 49.5%
Angry 49.6%
Surprised 49.9%
Disgusted 49.6%
Sad 49.6%
Confused 49.7%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Fear 49.5%
Happy 49.5%
Confused 49.7%
Calm 50%
Disgusted 49.6%
Sad 49.6%
Angry 49.5%
Surprised 49.6%

AWS Rekognition

Age 28-44
Gender Male, 50.5%
Angry 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.6%
Sad 49.8%
Fear 49.5%
Calm 50%
Surprised 49.5%

AWS Rekognition

Age 39-57
Gender Male, 50.4%
Happy 49.5%
Confused 49.6%
Calm 49.5%
Angry 50.1%
Fear 49.5%
Disgusted 49.6%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 45-63
Gender Male, 50.5%
Fear 49.5%
Angry 49.5%
Calm 50.2%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.7%
Disgusted 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.4%
Happy 49.5%
Sad 49.8%
Disgusted 49.5%
Fear 49.5%
Calm 50.1%
Angry 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 40-58
Gender Male, 50.4%
Surprised 49.5%
Confused 49.5%
Calm 49.9%
Happy 49.5%
Sad 49.6%
Angry 49.8%
Disgusted 49.6%
Fear 49.5%

AWS Rekognition

Age 42-60
Gender Male, 50.5%
Calm 49.6%
Angry 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.6%
Happy 49.5%
Sad 50.2%
Fear 49.5%

AWS Rekognition

Age 39-57
Gender Male, 50.5%
Sad 49.8%
Happy 49.5%
Fear 49.5%
Calm 49.6%
Angry 49.6%
Disgusted 49.9%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 32-48
Gender Male, 50.5%
Angry 49.5%
Calm 50%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50%
Fear 49.5%

AWS Rekognition

Age 29-45
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.5%
Calm 49.6%
Sad 49.5%
Surprised 50.2%
Confused 49.5%
Fear 49.6%
Angry 49.6%

AWS Rekognition

Age 45-63
Gender Male, 50.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Fear 49.5%
Calm 50.1%
Happy 49.5%
Sad 49.9%

AWS Rekognition

Age 24-38
Gender Male, 50%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Calm 49.7%
Angry 49.5%
Sad 50.2%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Sad 49.7%
Surprised 49.6%
Angry 49.6%
Calm 50%
Happy 49.5%
Fear 49.5%
Disgusted 49.6%
Confused 49.6%

AWS Rekognition

Age 26-42
Gender Male, 50.5%
Happy 49.5%
Surprised 49.5%
Angry 49.5%
Fear 49.5%
Sad 50.5%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.5%
Happy 49.5%
Sad 49.6%
Confused 49.5%
Disgusted 49.5%
Angry 49.6%
Surprised 49.7%
Calm 49.9%
Fear 49.6%

AWS Rekognition

Age 31-47
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.5%
Fear 50.3%
Calm 49.5%
Angry 49.5%
Confused 49.5%
Sad 49.6%
Surprised 49.6%

AWS Rekognition

Age 26-40
Gender Male, 50.4%
Angry 49.5%
Sad 49.8%
Calm 49.9%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Fear 49.6%
Happy 49.6%

AWS Rekognition

Age 50-68
Gender Male, 50.5%
Happy 49.5%
Angry 49.5%
Fear 49.5%
Surprised 49.5%
Calm 49.5%
Sad 49.7%
Disgusted 50.3%
Confused 49.5%

AWS Rekognition

Age 43-61
Gender Male, 54.3%
Angry 45.3%
Happy 45.7%
Disgusted 45.2%
Confused 47.3%
Surprised 48%
Calm 45.9%
Fear 45.4%
Sad 47.3%

AWS Rekognition

Age 17-29
Gender Male, 50.2%
Angry 49.5%
Calm 49.5%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.4%
Fear 49.5%

AWS Rekognition

Age 42-60
Gender Male, 50.5%
Calm 50%
Sad 49.5%
Happy 49.5%
Angry 49.8%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 3-11
Gender Male, 50.4%
Surprised 49.6%
Fear 49.6%
Angry 49.7%
Disgusted 49.5%
Sad 49.9%
Calm 49.6%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 49-67
Gender Male, 50.2%
Happy 49.5%
Sad 49.5%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Surprised 49.7%
Disgusted 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Chair 96%

Text analysis

Amazon

Q39080