Human Generated Data

Title

Untitled (photograph of Old Christian Church Group gathered outside church)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3097

Human Generated Data

Title

Untitled (photograph of Old Christian Church Group gathered outside church)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3097

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Art 95.3
Poster 93.2
Advertisement 93.2
Human 87.3
Person 87.1
Art Gallery 80.6
Drawing 77
Person 74.5
Person 72.4
Person 72.3
Person 72.2
Person 71.4
Person 63.9
Collage 62.8
Photo 57.2
Portrait 57.2
Photography 57.2
Face 57.2
Text 55.6
Flyer 55.4
Brochure 55.4
Paper 55.4
Person 53.1
Person 46.7

Clarifai
created on 2023-10-26

people 99.8
group 98
adult 97.8
leader 95.9
one 95.3
man 95
no person 94.4
room 93.6
art 93.3
education 93.2
painting 91.4
many 89.7
wear 89.1
furniture 88.9
indoors 88.8
woman 88
print 87.5
science 87.3
home 84.4
illustration 83.8

Imagga
created on 2022-01-21

blackboard 91.3
vintage 42.2
grunge 39.2
old 36.9
texture 32
antique 30.3
material 29.5
retro 27
frame 26.6
damaged 25.8
structure 25.4
paper 23.5
design 23.1
border 22.6
aged 21.7
dirty 20.8
art 19.9
pattern 19.2
ancient 19
graphic 18.2
wall 18.2
rusty 18.1
money 17.9
finance 16.9
brass 16.5
memorial 16.5
rough 16.4
currency 15.3
empty 14.6
drawing 14.6
messy 14.5
grungy 14.2
backdrop 14
wallpaper 13.8
edge 13.5
business 13.4
bill 13.3
weathered 13.3
black 13.2
textured 13.2
text 13.1
grain 12.9
historic 12.8
screen 12.7
grime 12.7
paint 12.7
fracture 12.7
crumpled 12.6
decay 12.5
detail 12.1
dollar 12.1
cash 11.9
mottled 11.7
stains 11.7
bank 11.6
space 11.6
sketch 11.6
financial 11.6
rust 11.6
parchment 11.5
surface 11.5
decoration 11.1
collage 10.6
detailed 10.6
backgrounds 10.5
computer 10.5
dirt 10.5
old fashioned 10.5
textures 10.4
blank 10.3
close 10.3
rich 10.2
banking 10.1
nobody 10.1
designed 9.8
photographic 9.8
frames 9.8
noise 9.8
ragged 9.8
crack 9.7
your 9.7
style 9.6
spot 9.6
obsolete 9.6
note 9.2
element 9.1
noisy 8.9
layered 8.8
mess 8.8
scratch 8.8
faded 8.8
layer 8.7
us 8.7
mask 8.6
architecture 8.6
savings 8.4
letter 8.3
building 8.1
gray 8.1
digital 8.1
brown 8.1
interior 8
tracery 7.9
overlay 7.9
highly 7.9
scratches 7.9
broad 7.9
color 7.8
succulent 7.8
bills 7.8
hundred 7.7
aging 7.7
representation 7.6
symbol 7.4
film 7.4
message 7.3
wealth 7.2
history 7.2
stamp 7

Google
created on 2022-01-21

Rectangle 87.8
Picture frame 87.7
Wood 84.8
Art 84
Font 80.7
Creative arts 78.4
Visual arts 69.6
Monochrome 67.5
Event 65.9
Room 65.7
Monochrome photography 65.5
Painting 64.5
Stock photography 62.6
Drawing 61.4
Artwork 61.1
History 60.9
Pattern 60.6
Illustration 58.3
Modern art 55.4
Metal 54.5

Microsoft
created on 2022-01-21

drawing 99.8
wall 99.7
gallery 97.9
room 96.2
scene 95.1
sketch 94.9
indoor 93.9
white 86.1
black 79.5
text 78.5
picture frame 74
handwriting 73.4
cartoon 70.8
painting 15.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 79.6%
Calm 91.8%
Confused 3.8%
Sad 1.5%
Happy 0.9%
Fear 0.7%
Disgusted 0.7%
Angry 0.5%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Female, 51.5%
Calm 91%
Happy 6.5%
Angry 0.7%
Fear 0.6%
Confused 0.5%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%

AWS Rekognition

Age 18-26
Gender Male, 97.5%
Calm 86.3%
Happy 7.4%
Fear 4.3%
Disgusted 0.6%
Sad 0.5%
Angry 0.4%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Female, 63.3%
Happy 50.8%
Calm 45.3%
Fear 2.3%
Angry 0.6%
Sad 0.4%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 39-47
Gender Male, 88.8%
Calm 66%
Happy 30.9%
Sad 1%
Angry 0.7%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 98.8%
Happy 99%
Calm 0.5%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 59.3%
Calm 94.7%
Fear 1.9%
Angry 1.3%
Happy 0.7%
Sad 0.5%
Confused 0.3%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Calm 94.5%
Confused 2.4%
Happy 1%
Surprised 0.8%
Sad 0.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 94.1%
Calm 94.8%
Happy 2.8%
Angry 0.7%
Sad 0.6%
Disgusted 0.5%
Confused 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Female, 57.1%
Happy 91.4%
Calm 7.2%
Surprised 0.4%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 14-22
Gender Male, 96.3%
Calm 29.4%
Happy 21.5%
Angry 12.4%
Sad 11.8%
Disgusted 9.9%
Fear 6.7%
Surprised 6.4%
Confused 2%

AWS Rekognition

Age 34-42
Gender Male, 78.5%
Calm 88.2%
Happy 8.4%
Surprised 1.9%
Disgusted 0.4%
Fear 0.3%
Confused 0.3%
Sad 0.3%
Angry 0.2%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Calm 61.6%
Happy 29.3%
Fear 7.1%
Sad 1%
Disgusted 0.3%
Angry 0.3%
Surprised 0.3%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Happy 97.6%
Calm 2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Calm 49.8%
Fear 34.9%
Happy 10.9%
Disgusted 1.2%
Angry 1%
Sad 0.9%
Confused 0.8%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 90.2%
Calm 50.8%
Happy 48.7%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 20-28
Gender Male, 97.5%
Calm 98.3%
Angry 0.6%
Happy 0.3%
Sad 0.3%
Fear 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 34-42
Gender Male, 96.2%
Happy 97.1%
Calm 2.1%
Fear 0.3%
Confused 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 13-21
Gender Female, 99.7%
Happy 73.4%
Calm 18.3%
Fear 2.8%
Sad 2.3%
Surprised 1%
Confused 1%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 20-28
Gender Female, 61.1%
Happy 90.7%
Calm 5.6%
Sad 1.4%
Confused 1%
Fear 0.6%
Disgusted 0.4%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Male, 72.6%
Calm 65.1%
Happy 10.3%
Angry 7.2%
Sad 4.8%
Surprised 4.2%
Fear 4.1%
Disgusted 2.4%
Confused 1.9%

AWS Rekognition

Age 23-33
Gender Male, 57.6%
Happy 59.1%
Fear 32.7%
Calm 6.5%
Disgusted 0.6%
Sad 0.6%
Angry 0.2%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Female, 51.9%
Calm 87.7%
Happy 7.7%
Sad 1.7%
Angry 1.3%
Confused 0.8%
Disgusted 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Sad 43.7%
Calm 32.1%
Happy 11%
Angry 9.3%
Fear 1.3%
Surprised 1%
Disgusted 0.9%
Confused 0.8%

AWS Rekognition

Age 23-31
Gender Male, 97.7%
Calm 87.4%
Fear 5.4%
Angry 2.5%
Sad 1.9%
Confused 0.8%
Disgusted 0.8%
Surprised 0.7%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Male, 98.4%
Calm 70.9%
Sad 15.9%
Fear 5.7%
Disgusted 2.4%
Happy 2.1%
Confused 1.3%
Angry 1.2%
Surprised 0.5%

AWS Rekognition

Age 2-8
Gender Female, 59.3%
Calm 82.9%
Happy 16.4%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 79.8%
Calm 84.3%
Happy 14.1%
Angry 0.5%
Sad 0.4%
Surprised 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99%
Calm 97.2%
Happy 1.4%
Sad 0.4%
Fear 0.3%
Confused 0.2%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 98.9%
Happy 76.6%
Calm 22.1%
Fear 0.3%
Sad 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 55.4%
Calm 29.3%
Fear 6.1%
Sad 4.7%
Angry 2%
Disgusted 1.3%
Surprised 0.6%
Confused 0.6%

AWS Rekognition

Age 10-18
Gender Male, 97.9%
Calm 82%
Happy 14.4%
Sad 1%
Fear 0.9%
Surprised 0.6%
Angry 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Female, 96.7%
Happy 80.3%
Calm 17.3%
Fear 0.9%
Disgusted 0.7%
Sad 0.4%
Surprised 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Happy 72.1%
Calm 22%
Fear 1.4%
Sad 1.2%
Angry 1.2%
Confused 0.8%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 96%
Happy 92.9%
Calm 5.9%
Disgusted 0.4%
Surprised 0.2%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Happy 62.3%
Calm 28.1%
Fear 6.4%
Angry 1.6%
Sad 1.1%
Surprised 0.4%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Male, 96%
Calm 93.7%
Sad 2.5%
Happy 1.9%
Angry 0.8%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 30-40
Gender Male, 69.7%
Calm 97.1%
Sad 0.7%
Fear 0.6%
Disgusted 0.6%
Surprised 0.4%
Happy 0.4%
Angry 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 93.2%
Person 87.1%

Captions

Microsoft
created on 2022-01-21

an old photo of a person in a room 82.1%
an old photo of a room 82%
an old photo of a person 70.1%

Text analysis

Amazon

ST