Human Generated Data

Title

Untitled (large family portrait for Blackwell reunion)
Date

1941
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3399

Human Generated Data

Title

Untitled (large family portrait for Blackwell reunion)

People

Artist: Harry Annas, American 1897 - 1980

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3399

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 90.5
Human 90.5
Art 88.5
Monitor 77.1
Electronics 77.1
Screen 77.1
Display 77.1
Text 73.5
Canvas 72
Painting 67.4
Person 65.8
Nature 58.6
Collage 58.1
Poster 58.1
Advertisement 58.1
People 57.7
Outdoors 57.2

Clarifai
created on 2023-10-26

painting 97.6
art 96.8
people 96.7
desktop 96.4
illustration 95.9
picture frame 95.8
group 95.8
margin 92.5
antique 92.4
wear 92.3
scraping 91.5
vintage 90.9
many 88.2
soil 87.8
image 87
retro 87
screen 86.6
tree 85.7
landscape 85.3
blank 84

Imagga
created on 2022-01-22

screen 100
window screen 100
protective covering 80.7
grunge 59.6
covering 53.4
texture 48.7
old 44.6
aged 40.7
vintage 39.7
antique 39
rough 34.7
grungy 34.2
pattern 33.5
dirty 33.5
weathered 32.3
frame 30.8
retro 30.3
wall 30.1
paint 28.1
damaged 27.7
wallpaper 26.8
material 26.8
border 26.2
textured 24.6
design 23.7
space 22.5
messy 22.3
rust 22.2
rusty 21.9
text 21.8
surface 21.2
backdrop 20.6
stain 20.2
art 20.2
graphic 19.7
negative 19.3
black 19.3
structure 18.9
paper 18.8
decay 18.3
ancient 18.2
film 17.4
stained 16.4
aging 16.3
digital 16.2
brown 16.2
backgrounds 15.4
edge 15.4
detail 15.3
empty 14.6
detailed 14.4
obsolete 14.4
dirt 14.3
canvas 14.2
grain 13.8
scratch 13.7
spot 13.4
worn 13.4
decoration 13.2
blank 12.9
grime 12.7
textures 12.3
color 12.2
noisy 11.8
noise 11.7
windowsill 11.1
snow 10.9
collage 10.6
parchment 10.6
metal 10.5
dark 10
designed 9.8
stains 9.7
movie 9.7
crack 9.7
torn 9.7
your 9.7
urban 9.6
artistic 9.6
sill 8.9
scratches 8.9
layered 8.9
computer 8.8
mess 8.8
burned 8.8
photographic 8.8
frames 8.8
slide 8.8
mottled 8.8
fracture 8.8
burnt 8.7
layer 8.7
mask 8.6
great 8.6
close 8.6
old fashioned 8.6
iron 8.4
element 8.3
effect 8.2
steel 8
highly 7.9
corrosion 7.9
scratched 7.8
architecture 7.8
industry 7.7
winter 7.7
concrete 7.7
sheet 7.5
camera 7.4
metallic 7.4
entertainment 7.4
industrial 7.3
gray 7.2

Google
created on 2022-01-22

Picture frame 94.1
Plant 90
Painting 85.7
Art 83.6
Rectangle 82
Adaptation 79.2
Font 76.7
Tree 76.5
Landscape 74.3
Monochrome photography 74
Tints and shades 73.5
Monochrome 72.5
Drawing 70.6
Visual arts 69.7
Natural landscape 68.1
Printmaking 65.9
Illustration 65.6
History 63
Grass 61.7
Room 60.5

Microsoft
created on 2022-01-22

text 97.2
picture frame 90.5
gallery 87.5
window 86.7
black and white 81
drawing 78.2
room 64.1
old 59.5
display 38.2
painting 16.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 42-50
Gender Female, 97.6%
Happy 46.6%
Fear 33.5%
Calm 11.6%
Angry 2.4%
Surprised 2.2%
Sad 2.1%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 78.8%
Sad 13.6%
Disgusted 2.5%
Happy 2.2%
Angry 1.2%
Fear 0.8%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 22-30
Gender Male, 91.2%
Calm 50.9%
Happy 18.1%
Disgusted 13.9%
Fear 6.2%
Sad 3.1%
Angry 2.9%
Surprised 2.8%
Confused 2.1%

AWS Rekognition

Age 23-33
Gender Male, 99.3%
Calm 91.6%
Sad 2.9%
Angry 2.8%
Happy 1.5%
Confused 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 97.2%
Fear 69.9%
Calm 9.6%
Sad 8.6%
Angry 4.5%
Happy 3.4%
Disgusted 1.9%
Surprised 1.5%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Male, 91.8%
Calm 38.5%
Happy 21.3%
Angry 11.8%
Sad 11.2%
Disgusted 9.9%
Fear 4.7%
Confused 1.7%
Surprised 1%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 97%
Happy 2.5%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 62.9%
Disgusted 45.6%
Happy 28.4%
Sad 12.7%
Angry 4.7%
Fear 4.6%
Confused 1.7%
Calm 1.2%
Surprised 1.2%

AWS Rekognition

Age 42-50
Gender Male, 95.8%
Happy 82.5%
Calm 12.5%
Disgusted 1.9%
Fear 1.1%
Sad 0.7%
Angry 0.6%
Surprised 0.5%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 96.3%
Sad 96.7%
Fear 0.9%
Angry 0.8%
Disgusted 0.6%
Happy 0.5%
Surprised 0.2%
Calm 0.1%
Confused 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.4%
Calm 72.8%
Happy 19.1%
Disgusted 3.3%
Sad 1.7%
Surprised 1.2%
Angry 0.8%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 24-34
Gender Male, 59.8%
Surprised 25.3%
Disgusted 19.4%
Calm 14.7%
Happy 11.8%
Angry 11.2%
Sad 8.3%
Fear 5.9%
Confused 3.4%

AWS Rekognition

Age 22-30
Gender Male, 89.5%
Happy 43.1%
Sad 22.2%
Calm 16.5%
Disgusted 10.9%
Angry 3.9%
Fear 2.6%
Surprised 0.5%
Confused 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 91%
Happy 4.8%
Fear 2.1%
Sad 1.6%
Angry 0.3%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 21-29
Gender Male, 83.6%
Calm 99.3%
Sad 0.4%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 98.5%
Calm 55.1%
Happy 40.1%
Fear 1.3%
Surprised 1%
Sad 0.8%
Disgusted 0.8%
Angry 0.6%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Female, 71.6%
Calm 95.7%
Sad 3%
Angry 0.4%
Happy 0.3%
Fear 0.3%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-30
Gender Male, 79.4%
Happy 41.8%
Calm 27.1%
Surprised 17.2%
Fear 6.2%
Angry 3.4%
Sad 1.9%
Disgusted 1.5%
Confused 0.9%

AWS Rekognition

Age 23-33
Gender Male, 96.2%
Happy 89.8%
Calm 4%
Sad 3.2%
Angry 1%
Fear 0.7%
Disgusted 0.5%
Confused 0.4%
Surprised 0.4%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Disgusted 51.6%
Sad 15.5%
Calm 14%
Happy 9.5%
Angry 3.3%
Confused 3.1%
Fear 1.8%
Surprised 1%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Sad 55.9%
Disgusted 20.3%
Calm 7.8%
Fear 7.2%
Happy 5%
Angry 1.9%
Confused 1.1%
Surprised 0.9%

AWS Rekognition

Age 29-39
Gender Female, 51.4%
Calm 98.7%
Sad 0.6%
Angry 0.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 18-24
Gender Male, 50.8%
Happy 98.3%
Calm 0.7%
Sad 0.5%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 23-33
Gender Male, 94.1%
Calm 96.6%
Fear 1.1%
Surprised 0.7%
Sad 0.5%
Angry 0.4%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 99%
Happy 0.6%
Sad 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Female, 52.8%
Happy 68.8%
Calm 24.2%
Sad 1.6%
Fear 1.5%
Surprised 1.4%
Angry 1.2%
Disgusted 1.1%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 83%
Happy 37.9%
Calm 28.9%
Disgusted 13.4%
Angry 6.5%
Sad 6.2%
Fear 3.2%
Confused 2.1%
Surprised 1.8%

AWS Rekognition

Age 23-31
Gender Female, 91.1%
Sad 34.8%
Calm 28.6%
Fear 19.7%
Happy 5.1%
Angry 3.6%
Confused 3.1%
Disgusted 2.7%
Surprised 2.3%

AWS Rekognition

Age 24-34
Gender Female, 95.3%
Calm 52.4%
Sad 16.3%
Fear 10.8%
Happy 9.1%
Angry 4.9%
Disgusted 3.6%
Surprised 2.2%
Confused 0.6%

AWS Rekognition

Age 39-47
Gender Male, 99%
Calm 59%
Happy 37.3%
Disgusted 0.9%
Surprised 0.8%
Sad 0.8%
Angry 0.8%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Calm 83.2%
Happy 12.6%
Surprised 1.2%
Sad 1%
Angry 1%
Disgusted 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 11-19
Gender Male, 98.7%
Calm 44%
Sad 32.3%
Happy 7.3%
Fear 6.6%
Angry 5.8%
Confused 1.9%
Disgusted 1.4%
Surprised 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 76.2%
Calm 7.8%
Fear 5.5%
Surprised 4.7%
Sad 1.9%
Disgusted 1.6%
Angry 1.5%
Confused 0.8%

AWS Rekognition

Age 23-33
Gender Male, 80.2%
Calm 83.2%
Sad 7.2%
Happy 3.3%
Disgusted 2%
Angry 2%
Fear 1.4%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 52.7%
Sad 24.6%
Happy 14.6%
Angry 2.3%
Fear 2%
Confused 1.7%
Disgusted 1.1%
Surprised 1%

AWS Rekognition

Age 31-41
Gender Male, 99.2%
Sad 42.2%
Happy 18.9%
Calm 17.1%
Angry 10.3%
Disgusted 4.4%
Confused 3.5%
Fear 1.9%
Surprised 1.9%

AWS Rekognition

Age 24-34
Gender Male, 96.4%
Happy 35.5%
Sad 18.6%
Calm 13.1%
Disgusted 11.4%
Confused 8%
Fear 6.8%
Surprised 5.2%
Angry 1.3%

AWS Rekognition

Age 24-34
Gender Male, 93.9%
Calm 70.4%
Happy 15.7%
Fear 6.1%
Angry 3.4%
Sad 2%
Surprised 1.4%
Disgusted 0.9%
Confused 0.3%

AWS Rekognition

Age 39-47
Gender Male, 97.5%
Calm 96.7%
Happy 0.8%
Sad 0.8%
Angry 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 31-41
Gender Female, 90.6%
Calm 97.8%
Surprised 1%
Sad 0.5%
Fear 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Female, 88.7%
Happy 85.7%
Disgusted 8.5%
Sad 2.2%
Angry 1.2%
Calm 1.1%
Fear 0.6%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Male, 68.7%
Sad 42.7%
Calm 34.6%
Angry 8.5%
Fear 6.4%
Happy 3.2%
Disgusted 2.1%
Confused 1.8%
Surprised 0.7%

AWS Rekognition

Age 31-41
Gender Male, 82.1%
Happy 40.9%
Sad 33.1%
Calm 13.2%
Fear 4.3%
Surprised 3.6%
Confused 2.2%
Angry 1.8%
Disgusted 0.8%

AWS Rekognition

Age 29-39
Gender Male, 94.8%
Happy 61.8%
Calm 29.4%
Angry 2.1%
Sad 2%
Surprised 1.9%
Fear 1.5%
Disgusted 0.8%
Confused 0.5%

AWS Rekognition

Age 31-41
Gender Male, 92.4%
Calm 87.1%
Sad 3.7%
Happy 2.8%
Fear 2.7%
Angry 1.4%
Surprised 1.2%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 23-33
Gender Male, 93.3%
Calm 90.6%
Happy 4.9%
Sad 2.9%
Angry 0.7%
Disgusted 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 97.8%
Calm 67.7%
Happy 11.4%
Sad 11%
Disgusted 3.5%
Angry 2.9%
Confused 1.4%
Fear 1.1%
Surprised 1%

AWS Rekognition

Age 45-53
Gender Male, 94.2%
Calm 28.5%
Sad 23.6%
Angry 12.1%
Happy 11.2%
Fear 10.1%
Disgusted 8.5%
Confused 4%
Surprised 1.9%

AWS Rekognition

Age 22-30
Gender Male, 97.9%
Calm 92.8%
Sad 5.1%
Angry 0.8%
Disgusted 0.6%
Happy 0.3%
Surprised 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 77.5%
Calm 90.9%
Happy 4.4%
Fear 1.4%
Sad 1.4%
Disgusted 0.8%
Angry 0.5%
Surprised 0.4%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 81.5%
Happy 7%
Sad 5.5%
Angry 2.9%
Fear 1.3%
Disgusted 1%
Surprised 0.6%
Confused 0.2%

AWS Rekognition

Age 6-14
Gender Male, 51%
Calm 65.6%
Happy 10.5%
Fear 9.9%
Surprised 6.7%
Confused 2.2%
Disgusted 2.1%
Sad 1.8%
Angry 1.1%

AWS Rekognition

Age 25-35
Gender Male, 72.9%
Calm 99.4%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Female, 76.8%
Happy 48.5%
Calm 27.1%
Confused 7.3%
Fear 6.9%
Surprised 4.1%
Sad 3.4%
Angry 1.6%
Disgusted 1%

Feature analysis

Amazon

Person 90.5%
Monitor 77.1%
Painting 67.4%

Captions

Microsoft
created on 2022-01-22

an old photo of a large window 55.4%
an old photo of a large screen 55.3%
an old photo of a person 51%

Text analysis

Amazon

1