Human Generated Data

Title

Untitled (photograph of Naval funeral: speaker and group of men around coffins on ship deck)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3102

Human Generated Data

Title

Untitled (photograph of Naval funeral: speaker and group of men around coffins on ship deck)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.8
Human 99.8
Person 99.6
Person 98.2
Person 97.1
Person 94.4
Person 89.3
Person 88.3
Architecture 87
Church 87
Building 87
Person 86
Person 85.1
Person 82.4
Symbol 81.8
Apparel 80.2
Clothing 80.2
Person 79.6
Advertisement 77.3
Poster 77.3
Person 76.9
Shorts 66
Text 64.1
Photo 64
Portrait 64
Face 64
Photography 64
Person 62
People 61.5
Altar 59.2
Screen 57.1
Electronics 57.1

Imagga
created on 2022-01-21

television 46.9
blackboard 44.5
architecture 23.4
telecommunication system 19.4
broadcasting 18.9
building 18.4
old 18.1
structure 17.3
menorah 15.4
black 15
city 14.1
telecommunication 14.1
sky 14
construction 13.7
history 13.4
art 13.1
candelabrum 12.3
house 11.7
vintage 11.6
night 11.5
light 11.4
church 11.1
travel 10.6
business 10.3
grunge 10.2
religion 9.9
tower 9.8
urban 9.6
antique 9.5
medium 9.4
finance 9.3
candlestick 9.2
outdoor 9.2
historic 9.2
retro 9
window 9
symbol 8.7
design 8.4
texture 8.3
street 8.3
technology 8.2
dirty 8.1
decoration 8.1
water 8
paper 7.8
winter 7.7
historical 7.5
work 7.5
tourism 7.4
exterior 7.4
equipment 7.4
landmark 7.2
modern 7

Google
created on 2022-01-21

Microsoft
created on 2022-01-21

text 98.2
gallery 96.6
wall 95.1
room 91.2
television 90.2
ship 82.4
old 74.4
scene 72.1
black and white 70.8
black 66.2
image 37.5
picture frame 18.2

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Female, 80.4%
Fear 51.5%
Happy 31.9%
Sad 8.3%
Calm 2.8%
Surprised 2.4%
Angry 1.1%
Confused 1.1%
Disgusted 1%

AWS Rekognition

Age 26-36
Gender Male, 88.9%
Calm 68.1%
Happy 18.3%
Sad 10%
Fear 1.1%
Angry 0.8%
Surprised 0.6%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 45.7%
Sad 19.4%
Calm 13.4%
Confused 8.3%
Angry 5.9%
Disgusted 4.4%
Surprised 1.8%
Fear 1.2%

AWS Rekognition

Age 20-28
Gender Male, 94.5%
Calm 40.8%
Happy 30.2%
Sad 15.8%
Angry 6.2%
Surprised 2.8%
Fear 1.8%
Disgusted 1.3%
Confused 1.2%

AWS Rekognition

Age 11-19
Gender Male, 91.7%
Calm 65.6%
Sad 20.4%
Confused 7.2%
Happy 1.8%
Angry 1.5%
Fear 1.3%
Surprised 1.2%
Disgusted 0.9%

AWS Rekognition

Age 30-40
Gender Male, 99.3%
Sad 91.7%
Calm 2.1%
Happy 2.1%
Confused 1.6%
Angry 1.2%
Fear 0.5%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.4%
Happy 86.3%
Fear 6.6%
Sad 4.4%
Angry 0.7%
Calm 0.7%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-24
Gender Female, 70.4%
Calm 77.3%
Happy 20.3%
Sad 0.8%
Fear 0.6%
Disgusted 0.4%
Surprised 0.3%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 97.2%
Calm 51.2%
Happy 34.8%
Sad 8%
Confused 2.1%
Angry 1.9%
Disgusted 1%
Surprised 0.7%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 87.3%
Calm 68.3%
Happy 13%
Sad 6.9%
Angry 3.7%
Confused 2.3%
Surprised 2.1%
Fear 2%
Disgusted 1.7%

AWS Rekognition

Age 29-39
Gender Male, 82.7%
Calm 70.1%
Happy 21.9%
Sad 4%
Confused 1.7%
Angry 0.9%
Disgusted 0.5%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 31-41
Gender Male, 68.9%
Calm 91.2%
Sad 5.3%
Happy 2%
Angry 0.9%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 88.4%
Happy 94.6%
Calm 2.8%
Angry 0.5%
Fear 0.5%
Confused 0.5%
Surprised 0.4%
Sad 0.3%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 99.1%
Happy 0.4%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 9-17
Gender Female, 52.5%
Sad 97.2%
Calm 1.8%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Female, 53.3%
Calm 95.7%
Surprised 1.9%
Confused 0.6%
Fear 0.5%
Sad 0.4%
Happy 0.4%
Disgusted 0.3%
Angry 0.3%

Feature analysis

Amazon

Person 99.8%
Poster 77.3%

Captions

Microsoft

a person standing in front of a television 65.6%
a group of people standing in front of a television 59.3%
a person standing in front of a television screen 59.2%

Text analysis

Amazon

8