Human Generated Data

Title

Untitled (large group portrait at Cardwell family reunion)
Date

1940
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3398

Human Generated Data

Title

Untitled (large group portrait at Cardwell family reunion)

People

Artist: Harry Annas, American 1897 - 1980

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Art 90.2
Interior Design 89.9
Indoors 89.9
Painting 80.7
Person 78.9
Human 78.9
Screen 77.7
Electronics 77.7
Person 77.4
Monitor 73.9
Display 73.9
Advertisement 71.6
LCD Screen 70.8
Person 67.5
Person 64.7
Collage 58.6
Text 56.1
Poster 55.2

Imagga
created on 2022-01-22

grunge 57.9
vintage 46.3
old 44.6
texture 42.4
antique 40.7
grungy 34.2
retro 33.6
frame 33.3
aged 32.6
pattern 32.1
rough 31
dirty 30.7
negative 30.2
windowsill 28.8
border 28.1
damaged 27.7
film 27.2
structure 26.7
wall 26.7
material 25.9
weathered 25.7
screen 23.8
blackboard 23.8
television 23.7
text 23.6
space 23.3
sill 23
paint 22.6
design 22.5
ancient 22.5
paper 21.2
textured 21
black 20.4
rust 20.2
graphic 19.7
messy 19.4
art 19
structural member 17.3
empty 17.2
rusty 17.2
blank 17.1
edge 16.4
obsolete 16.3
dirt 16.2
dark 15.9
telecommunication system 15.8
decoration 15.5
stain 15.4
aging 15.3
wallpaper 15.3
snow 15
noise 14.7
scratch 14.6
your 14.5
collage 14.5
old fashioned 14.3
window screen 14.2
surface 14.1
grain 13.8
noisy 13.8
digital 13.8
designed 13.8
decay 13.5
stained 13.5
parchment 13.4
detailed 12.5
worn 12.4
backdrop 12.4
support 12.3
highly 11.8
scratches 11.8
frames 11.7
torn 11.6
canvas 11.4
photographic paper 11.4
protective covering 11.2
layered 10.8
mess 10.8
fountain 10.7
crumpled 10.7
movie 10.7
layer 10.6
color 10.6
mask 10.6
backgrounds 10.5
stone 10.5
concrete 10.5
computer 10.4
brown 10.3
decorative 10
gray 9.9
photographic 9.8
slide 9.8
grime 9.8
fracture 9.7
burnt 9.7
crack 9.7
overlay 8.9
detail 8.9
distressed 8.8
burned 8.8
scratched 8.8
mottled 8.8
stains 8.8
forest 8.7
artistic 8.7
building 8.6
nobody 8.6
camera 8.3
entertainment 8.3
element 8.3
projects 7.9
architecture 7.8
faded 7.8
cracked 7.8
cement 7.8
strip 7.8
winter 7.7
photography 7.6
monitor 7.6
textures 7.6
photographic equipment 7.6
poster 7.6
covering 7.5
landscape 7.4
close 7.4

Google
created on 2022-01-22

Rectangle 87.9
Tree 83.8
Black-and-white 82.4
Art 81.1
Font 80.6
Tints and shades 77.1
Plant 76.2
Grass 71.6
Twig 71.5
Landscape 71.5
Painting 71.5
Monochrome 70.8
Monochrome photography 70.5
Wood 70.1
Visual arts 69.8
Room 69.1
Illustration 62.2
History 59.9
Modern art 57.7
Photographic paper 57.1

Microsoft
created on 2022-01-22

text 97.4
black and white 75.9
tree 74.4
white 63.8
painting 54.2
gallery 53.4
drawing 51.3
picture frame 49.3
image 46.5

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Male, 66.5%
Calm 53.2%
Happy 39.3%
Sad 2.6%
Fear 1.5%
Confused 1.1%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%

AWS Rekognition

Age 23-31
Gender Male, 50.4%
Calm 94.5%
Happy 2.4%
Disgusted 0.8%
Surprised 0.8%
Angry 0.6%
Sad 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 92.3%
Happy 95.5%
Calm 3%
Sad 0.4%
Confused 0.3%
Disgusted 0.3%
Angry 0.3%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Female, 89.1%
Happy 61.3%
Calm 30.8%
Sad 3.7%
Angry 1.8%
Confused 0.9%
Disgusted 0.6%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 14-22
Gender Female, 94.7%
Happy 87.2%
Calm 6.1%
Fear 2.9%
Sad 1.6%
Angry 0.6%
Disgusted 0.6%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 39-47
Gender Male, 88%
Sad 32.9%
Confused 19.2%
Happy 14.2%
Angry 14.1%
Calm 8.2%
Fear 5.1%
Disgusted 4.3%
Surprised 2.1%

AWS Rekognition

Age 24-34
Gender Male, 95.6%
Happy 60.9%
Sad 14.8%
Fear 13.6%
Calm 4.7%
Angry 2.1%
Disgusted 1.7%
Surprised 1.1%
Confused 1.1%

AWS Rekognition

Age 16-24
Gender Female, 56.9%
Calm 97.4%
Sad 0.7%
Happy 0.6%
Angry 0.5%
Fear 0.3%
Disgusted 0.2%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Female, 99.5%
Happy 90.4%
Sad 2.5%
Calm 2.1%
Angry 1.9%
Fear 1.1%
Surprised 0.7%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 25-35
Gender Male, 98.3%
Happy 81.9%
Disgusted 10.6%
Angry 2.6%
Sad 1.4%
Calm 1.1%
Confused 0.9%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 16-24
Gender Male, 93%
Calm 87.4%
Happy 5.2%
Fear 3.2%
Sad 1.9%
Angry 1.1%
Disgusted 0.6%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Happy 91.5%
Calm 6.8%
Sad 0.4%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%
Fear 0.3%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 62.7%
Calm 49%
Fear 37.8%
Sad 4.7%
Happy 4.7%
Angry 2.3%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 21-29
Gender Male, 94.1%
Happy 53.7%
Calm 22.1%
Sad 10.3%
Angry 5.3%
Fear 3.5%
Disgusted 3%
Surprised 1.2%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Female, 78.5%
Happy 87%
Calm 9.3%
Fear 1.6%
Sad 0.6%
Disgusted 0.6%
Angry 0.5%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 30-40
Gender Female, 54.5%
Confused 41%
Calm 12.1%
Sad 11.7%
Disgusted 11.2%
Happy 9.8%
Surprised 5.8%
Angry 5%
Fear 3.5%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Happy 78.4%
Sad 12.5%
Angry 2.3%
Disgusted 1.8%
Fear 1.6%
Surprised 1.4%
Calm 1.1%
Confused 0.9%

AWS Rekognition

Age 28-38
Gender Female, 75.8%
Happy 87.2%
Calm 4.7%
Disgusted 2.6%
Sad 1.8%
Surprised 1.2%
Fear 1.1%
Angry 0.9%
Confused 0.5%

AWS Rekognition

Age 11-19
Gender Male, 87.9%
Confused 21.7%
Calm 19.2%
Disgusted 19%
Sad 14.7%
Angry 9.6%
Happy 9.5%
Surprised 3.8%
Fear 2.4%

AWS Rekognition

Age 16-24
Gender Male, 63.5%
Calm 87.9%
Surprised 4%
Sad 2.4%
Happy 1.9%
Confused 1.2%
Angry 1.2%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 25-35
Gender Female, 62.9%
Calm 37.3%
Happy 18.7%
Disgusted 13.4%
Fear 12.5%
Sad 8.2%
Confused 5.6%
Angry 2.8%
Surprised 1.5%

AWS Rekognition

Age 26-36
Gender Male, 99%
Happy 49.5%
Sad 40.4%
Calm 7.5%
Angry 0.6%
Fear 0.5%
Disgusted 0.5%
Confused 0.5%
Surprised 0.4%

AWS Rekognition

Age 21-29
Gender Male, 98.1%
Happy 43.2%
Fear 22.5%
Sad 18%
Calm 8.2%
Angry 4.5%
Disgusted 1.3%
Surprised 1.3%
Confused 1%

AWS Rekognition

Age 22-30
Gender Male, 78.6%
Calm 70.2%
Happy 10.7%
Surprised 8.6%
Disgusted 4%
Fear 2.5%
Confused 2.3%
Sad 1.2%
Angry 0.5%

AWS Rekognition

Age 20-28
Gender Female, 59.7%
Fear 49.6%
Happy 35.3%
Angry 7.2%
Sad 2.6%
Disgusted 2.5%
Calm 1.3%
Surprised 1%
Confused 0.5%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 76.9%
Happy 15.7%
Sad 5%
Angry 0.9%
Surprised 0.5%
Confused 0.3%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 69.7%
Happy 98.1%
Disgusted 0.5%
Confused 0.4%
Surprised 0.3%
Angry 0.2%
Calm 0.2%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 23-31
Gender Male, 95.9%
Happy 63.8%
Calm 19.8%
Sad 8.6%
Fear 5.2%
Angry 1.2%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 23-33
Gender Male, 60.5%
Calm 97.5%
Happy 1.3%
Sad 0.7%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 72.3%
Happy 31.6%
Calm 30%
Sad 21.2%
Angry 8.3%
Disgusted 5.5%
Surprised 2%
Confused 0.8%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 96.7%
Calm 48.5%
Happy 33.8%
Sad 11.1%
Confused 2.2%
Angry 1.7%
Surprised 1.3%
Fear 0.8%
Disgusted 0.7%

AWS Rekognition

Age 26-36
Gender Male, 98.6%
Sad 45.7%
Confused 18.6%
Calm 12.3%
Disgusted 11%
Angry 4.5%
Surprised 2.9%
Fear 2.4%
Happy 2.4%

AWS Rekognition

Age 31-41
Gender Male, 80.2%
Calm 94.4%
Sad 1.9%
Happy 1.3%
Angry 1.1%
Fear 0.5%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 71.3%
Happy 26.2%
Fear 1%
Sad 0.5%
Disgusted 0.4%
Angry 0.4%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 68.9%
Sad 10.7%
Confused 6.8%
Disgusted 4.9%
Happy 3.4%
Angry 2.7%
Fear 1.4%
Surprised 1.2%

AWS Rekognition

Age 19-27
Gender Female, 93.3%
Happy 42%
Calm 39.7%
Fear 14.4%
Sad 1.5%
Angry 1.4%
Disgusted 0.5%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Female, 51.1%
Fear 87.9%
Happy 7.3%
Calm 2.5%
Sad 0.6%
Confused 0.5%
Angry 0.5%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 25-35
Gender Male, 96.9%
Calm 66.9%
Happy 15.4%
Sad 14.1%
Fear 1.2%
Confused 1.1%
Angry 0.7%
Disgusted 0.4%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Happy 73.4%
Fear 11.8%
Calm 5.3%
Sad 4.1%
Confused 2.6%
Disgusted 1.1%
Angry 1%
Surprised 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98.6%
Happy 83.6%
Calm 7.9%
Sad 4.2%
Angry 1.2%
Confused 1.1%
Disgusted 0.8%
Fear 0.7%
Surprised 0.5%

AWS Rekognition

Age 21-29
Gender Male, 90.3%
Calm 94.6%
Disgusted 2.4%
Sad 0.8%
Happy 0.6%
Fear 0.6%
Angry 0.4%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Female, 95.9%
Happy 98.9%
Sad 0.3%
Confused 0.2%
Calm 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

Feature analysis

Amazon

Person 78.9%
Poster 55.2%

Captions

Microsoft

an old photo of a person 51.6%
an old photo of a person 51.5%
a group of people standing in front of a window 29.6%

Text analysis

Amazon

10
60P2

Google

10
10