Human Generated Data

Title

Untitled (copy of painting depicting man speaking at banquet in grove)

Date

c. 1938, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5749

Human Generated Data

Title

Untitled (copy of painting depicting man speaking at banquet in grove)

People

Artist: Durette Studio, American 20th century

Date

c. 1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.2
Person 99.2
Person 97.3
Person 97.1
Person 96
Crowd 96
Audience 96
Person 95.1
Person 94.4
Person 86.9
Person 86.9
Person 86.7
Person 85.8
Person 84.2
Art 83.1
Speech 83.1
Funeral 82.6
Lecture 76.8
Person 65.4
Photography 62.2
Photo 62.2
Painting 57.1
Suit 55.4
Apparel 55.4
Coat 55.4
Overcoat 55.4
Clothing 55.4

Clarifai
created on 2019-11-16

picture frame 99.5
exhibition 98.6
people 98.6
museum 98.4
group 97.9
blank 96.6
woman 96.3
art 96.1
bill 95.6
illustration 95.5
painting 95.1
portrait 94.6
adult 94.6
retro 94.6
man 94.1
desktop 93.8
landscape 93.5
decoration 93.2
vector 93
tree 91.8

Imagga
created on 2019-11-16

television 36.7
computer 25.1
frame 22.4
blackboard 22.1
film 20.4
monitor 18.9
man 18.8
telecommunication system 17.2
screen 17.2
office 16.9
technology 16.3
people 16.2
business 15.8
laptop 15.6
old 14.6
adult 14.2
male 14.2
businessman 14.1
grunge 13.6
light-emitting diode 13.2
happy 13.1
space 12.4
person 12.2
corporate 12
home 12
design 11.8
smiling 11.6
black 11.4
art 11
retro 10.6
working 10.6
diode 10.6
aquarium 10.5
broadcasting 10.2
border 9.9
vintage 9.9
equipment 9.8
texture 9.7
antique 9.5
grungy 9.5
indoor 9.1
portrait 9.1
color 8.9
vessel 8.8
looking 8.8
slide 8.8
paper 8.6
wall 8.5
smile 8.5
photograph 8.5
room 8.4
communication 8.4
display 8.3
executive 8.3
pattern 8.2
aged 8.1
dirty 8.1
indoors 7.9
window 7.8
negative 7.8
blank 7.7
modern 7.7
attractive 7.7
sky 7.6
telecommunication 7.6
hand 7.6
professional 7.6
desk 7.5
holding 7.4
camera 7.4
graphic 7.3
digital 7.3
face 7.1
interior 7.1
happiness 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

room 99.4
gallery 99.4
scene 98.9
wall 98.6
indoor 95.5
person 89.8
clothing 80.8
funeral 67.9
text 65.8
white 64.7
tree 62.1
man 60.5
old 58.7
black and white 56.4
painting 22.6
picture frame 7.8

Face analysis

Amazon

AWS Rekognition

Age 23-37
Gender Male, 50.5%
Calm 45.1%
Sad 52.3%
Happy 45%
Angry 47%
Surprised 45%
Confused 45.1%
Disgusted 45.4%
Fear 45%

AWS Rekognition

Age 29-45
Gender Female, 50.6%
Sad 54.1%
Angry 45.1%
Calm 45.8%
Happy 45%
Surprised 45%
Confused 45%
Disgusted 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Male, 52.9%
Angry 45.6%
Disgusted 45.1%
Surprised 45.1%
Sad 46.3%
Confused 45.7%
Calm 52.2%
Fear 45%
Happy 45%

AWS Rekognition

Age 17-29
Gender Male, 54.5%
Calm 45.5%
Fear 47.9%
Angry 45.8%
Disgusted 45.2%
Sad 50.4%
Happy 45%
Surprised 45.2%
Confused 45.1%

AWS Rekognition

Age 47-65
Gender Male, 54.3%
Calm 49.1%
Fear 45%
Sad 50.6%
Happy 45%
Disgusted 45%
Surprised 45%
Confused 45.1%
Angry 45.1%

AWS Rekognition

Age 38-56
Gender Male, 54.9%
Happy 45%
Sad 45.1%
Disgusted 45%
Calm 54.8%
Angry 45.1%
Surprised 45%
Fear 45%
Confused 45%

AWS Rekognition

Age 23-35
Gender Male, 52.3%
Confused 45%
Surprised 45%
Sad 52.4%
Disgusted 45%
Calm 47%
Fear 45.4%
Angry 45.1%
Happy 45%

AWS Rekognition

Age 32-48
Gender Female, 53%
Angry 47.9%
Sad 47%
Confused 45.4%
Calm 47.5%
Surprised 45.3%
Happy 45.2%
Disgusted 46.2%
Fear 45.5%

AWS Rekognition

Age 21-33
Gender Female, 50.5%
Confused 49.5%
Surprised 49.5%
Sad 50.3%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.6%
Angry 49.5%

AWS Rekognition

Age 23-35
Gender Female, 53.4%
Calm 45.1%
Disgusted 45%
Happy 45%
Fear 45.1%
Confused 45%
Angry 45%
Surprised 45%
Sad 54.7%

AWS Rekognition

Age 16-28
Gender Male, 50.3%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.1%
Calm 49.7%
Happy 49.6%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.2%
Disgusted 49.5%
Calm 49.6%
Surprised 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.7%
Angry 50.2%

AWS Rekognition

Age 23-37
Gender Male, 50.5%
Happy 49.5%
Angry 49.5%
Fear 49.9%
Surprised 49.5%
Calm 49.5%
Sad 50%
Disgusted 49.5%
Confused 49.5%

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a painting of a person in a white room 71.8%
a painting of a person 71.7%
a painting of a person in a white room 71.6%