Human Generated Data

Title

Untitled (group portrait of 141st Infantry)
Date

c. 1940
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2216

Human Generated Data

Title

Untitled (group portrait of 141st Infantry)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99
Human 99
Person 98.6
Person 98.6
Person 98.1
Person 97.1
Person 96.9
Person 96.8
Person 94.4
People 93.2
Person 92.7
Clothing 90.3
Apparel 90.3
Crowd 82.8
Robe 82.1
Fashion 82.1
Gown 79.9
Wedding 79.2
Wedding Gown 67.5
Person 65.3
Sailor Suit 58.4
Person 43

Imagga
created on 2021-12-14

picket fence 100
fence 96
barrier 70.2
obstruction 47.1
negative 45.8
structure 36.4
film 35.5
photographic paper 26.7
architecture 21.9
snow 20.4
old 19.5
winter 17.9
photographic equipment 17.8
cold 16.4
city 15.8
grunge 15.3
urban 14.8
scene 14.7
building 14.3
fountain 14.2
texture 13.9
sky 13.4
vintage 13.2
history 12.5
light 12
black 12
wall 12
design 11.8
backdrop 11.5
backgrounds 11.4
art 11.1
pattern 10.9
wallpaper 10.7
textured 10.5
group 10.5
business 10.3
tree 10
outdoor 9.9
ice 9.9
park 9.9
crowd 9.6
frozen 9.5
antique 9.5
ancient 9.5
people 9.5
men 9.4
season 9.3
water 9.3
space 9.3
wood 9.2
paint 9.1
aged 9
retro 9
stone 8.9
landscape 8.9
color 8.9
trees 8.9
surface 8.8
decoration 8.7
frost 8.6
motion 8.6
weathered 8.5
silhouette 8.3
outdoors 8.2
rough 8.2
dirty 8.1
scenery 8.1
symbol 8.1
material 8
close 8
column 8
crystal 7.9
seasonal 7.9
day 7.8
wet 7.2
cool 7.1
travel 7

Google
created on 2021-12-14

Rectangle 87.2
Black-and-white 82.1
Font 82
Chair 82
Art 78.9
Event 73.8
Monochrome photography 72.5
Monochrome 71.1
Team 65.6
Room 65.1
Symmetry 64.5
Crowd 60.3
Metal 57.5
History 57.1
Visual arts 56
Illustration 55.2
Glass 53.7

Microsoft
created on 2021-12-14

text 98.9
black and white 80.3
posing 73.9
black 71.9
white 62.3
old 53.6

Face analysis

Amazon

AWS Rekognition

Age 9-19
Gender Male, 73.4%
Calm 38.4%
Happy 38%
Sad 8.7%
Angry 5.2%
Confused 5.2%
Surprised 3%
Disgusted 0.7%
Fear 0.7%

AWS Rekognition

Age 10-20
Gender Female, 76.3%
Calm 84.8%
Sad 7.4%
Happy 2.3%
Angry 1.9%
Fear 1.2%
Surprised 1%
Confused 0.7%
Disgusted 0.7%

AWS Rekognition

Age 23-37
Gender Male, 94%
Calm 70.9%
Angry 13.5%
Surprised 5%
Happy 3.2%
Fear 2.2%
Confused 2.1%
Sad 2%
Disgusted 1.2%

AWS Rekognition

Age 17-29
Gender Male, 76.7%
Calm 50.7%
Happy 33.6%
Confused 8.8%
Surprised 3.3%
Sad 1.7%
Disgusted 0.9%
Angry 0.9%
Fear 0.4%

AWS Rekognition

Age 16-28
Gender Female, 73.2%
Calm 45.9%
Happy 44.7%
Angry 4.1%
Sad 2.3%
Surprised 1.6%
Fear 0.8%
Confused 0.5%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Male, 92.7%
Confused 47.8%
Happy 32.8%
Sad 6.7%
Calm 6.7%
Disgusted 2.5%
Angry 2.4%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 23-35
Gender Female, 85.8%
Calm 59.4%
Sad 14%
Happy 9.6%
Surprised 6.7%
Confused 4.7%
Fear 2.7%
Angry 2.3%
Disgusted 0.6%

AWS Rekognition

Age 6-16
Gender Male, 62.2%
Sad 76.3%
Fear 13.5%
Calm 5.4%
Angry 2.9%
Happy 1.3%
Confused 0.4%
Surprised 0.2%
Disgusted 0%

AWS Rekognition

Age 36-52
Gender Male, 93.7%
Calm 33.4%
Sad 32.2%
Fear 12.8%
Confused 7.7%
Angry 5.5%
Happy 5.5%
Surprised 1.6%
Disgusted 1.3%

AWS Rekognition

Age 18-30
Gender Female, 54.8%
Calm 83.9%
Sad 7.8%
Angry 2.5%
Confused 1.5%
Fear 1.4%
Surprised 1.2%
Happy 1.2%
Disgusted 0.5%

AWS Rekognition

Age 42-60
Gender Female, 54.1%
Calm 66.3%
Angry 14.3%
Happy 13.7%
Sad 2.9%
Confused 0.8%
Surprised 0.7%
Fear 0.7%
Disgusted 0.6%

AWS Rekognition

Age 6-16
Gender Male, 64.3%
Calm 81.8%
Sad 5.3%
Angry 4.8%
Happy 4.5%
Confused 1.5%
Surprised 1.2%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 52-70
Gender Male, 64.7%
Calm 42.6%
Sad 35.8%
Happy 10.7%
Confused 7.8%
Angry 1.5%
Surprised 0.7%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 13-25
Gender Female, 54.4%
Confused 30%
Happy 28.3%
Calm 19.9%
Angry 6.2%
Surprised 5.1%
Sad 4.2%
Disgusted 3.8%
Fear 2.4%

AWS Rekognition

Age 9-19
Gender Female, 70.9%
Calm 76.5%
Happy 9.7%
Sad 9.3%
Angry 1.8%
Fear 1.2%
Confused 0.9%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 46-64
Gender Male, 64.6%
Confused 30%
Disgusted 19.1%
Calm 10.9%
Fear 10.7%
Surprised 9.5%
Sad 8.6%
Angry 5.6%
Happy 5.5%

AWS Rekognition

Age 5-15
Gender Male, 53.6%
Calm 57.9%
Sad 26.5%
Happy 9.3%
Angry 2.7%
Confused 1.6%
Fear 1.3%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 77.8%
Calm 78.9%
Happy 16.3%
Sad 4.3%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 72.6%
Calm 75.4%
Happy 14.3%
Sad 3.8%
Confused 3.7%
Surprised 1.5%
Angry 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 17-29
Gender Female, 65%
Calm 46.1%
Sad 19.8%
Happy 19.5%
Angry 5.5%
Disgusted 3.3%
Surprised 2.9%
Fear 1.8%
Confused 1%

AWS Rekognition

Age 6-16
Gender Female, 73.1%
Happy 89.6%
Calm 7%
Sad 3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 31-47
Gender Male, 86.7%
Calm 40.3%
Happy 39.9%
Sad 17.4%
Disgusted 0.9%
Confused 0.8%
Angry 0.5%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 14-26
Gender Female, 80.9%
Calm 75.2%
Happy 14%
Angry 5%
Sad 4.4%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%
Surprised 0.2%

AWS Rekognition

Age 33-49
Gender Female, 66.3%
Calm 45.1%
Confused 31.5%
Happy 11.7%
Sad 4.3%
Angry 2.3%
Surprised 1.9%
Disgusted 1.9%
Fear 1.3%

AWS Rekognition

Age 54-72
Gender Male, 88.3%
Calm 85%
Sad 4.9%
Confused 4.5%
Happy 2.6%
Surprised 1%
Disgusted 1%
Angry 0.8%
Fear 0.3%

AWS Rekognition

Age 6-16
Gender Female, 63.6%
Calm 93.2%
Sad 4.2%
Happy 1%
Angry 0.9%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 42-60
Gender Male, 65.9%
Calm 63.9%
Confused 9.8%
Sad 7.5%
Happy 7.1%
Fear 4.2%
Surprised 3.1%
Disgusted 2.8%
Angry 1.6%

AWS Rekognition

Age 34-50
Gender Male, 89%
Calm 89.6%
Happy 5.3%
Confused 1.6%
Surprised 1.3%
Sad 1.2%
Angry 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 13-23
Gender Male, 75.1%
Calm 83.3%
Sad 7.2%
Angry 5.1%
Happy 1.4%
Confused 1.2%
Disgusted 0.8%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 32-48
Gender Female, 72.9%
Happy 51.6%
Calm 37.9%
Sad 2.9%
Disgusted 2.1%
Surprised 1.9%
Angry 1.8%
Confused 1.2%
Fear 0.5%

AWS Rekognition

Age 16-28
Gender Male, 86.3%
Calm 61%
Sad 13.4%
Confused 10%
Disgusted 4.7%
Happy 4.6%
Surprised 3%
Fear 1.7%
Angry 1.6%

AWS Rekognition

Age 8-18
Gender Female, 65.8%
Calm 44.2%
Happy 30.1%
Sad 12%
Fear 7.9%
Angry 5.2%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 6-16
Gender Female, 64.6%
Calm 47.9%
Happy 44%
Sad 3.9%
Confused 1.3%
Angry 1%
Disgusted 1%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 15-27
Gender Male, 72.6%
Calm 40.5%
Sad 20.1%
Confused 17.2%
Angry 13.3%
Happy 3.9%
Surprised 2.2%
Disgusted 1.6%
Fear 1.2%

AWS Rekognition

Age 16-28
Gender Female, 62.5%
Calm 77.6%
Sad 13.6%
Happy 8.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 27-43
Gender Female, 52.5%
Calm 59.4%
Sad 35.2%
Angry 1.8%
Fear 1.3%
Confused 0.7%
Happy 0.7%
Surprised 0.6%
Disgusted 0.2%

AWS Rekognition

Age 37-55
Gender Male, 81.2%
Happy 62.1%
Calm 30.2%
Sad 3.4%
Confused 1.8%
Angry 0.7%
Disgusted 0.7%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 6-16
Gender Female, 70.4%
Sad 45.5%
Calm 32.7%
Fear 10.5%
Happy 6.4%
Angry 1.7%
Confused 1.6%
Surprised 1.2%
Disgusted 0.4%

AWS Rekognition

Age 18-30
Gender Female, 72.9%
Sad 65.3%
Disgusted 11.7%
Happy 9.6%
Calm 8.7%
Fear 2.1%
Confused 1.3%
Angry 1.2%
Surprised 0.2%

AWS Rekognition

Age 3-11
Gender Male, 93.6%
Calm 81.4%
Happy 6%
Confused 5%
Surprised 2.9%
Sad 2.8%
Disgusted 0.9%
Angry 0.7%
Fear 0.2%

AWS Rekognition

Age 10-20
Gender Female, 69.5%
Calm 58.2%
Happy 23%
Sad 17.5%
Fear 0.4%
Angry 0.4%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-30
Gender Female, 59.5%
Happy 79.8%
Calm 15.5%
Sad 1.5%
Confused 1.5%
Disgusted 0.7%
Angry 0.4%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 24-38
Gender Female, 91.6%
Sad 41.3%
Fear 33.6%
Happy 11.7%
Calm 6.9%
Surprised 3.1%
Angry 2.5%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 6-16
Gender Female, 83.1%
Happy 60.5%
Calm 29.2%
Sad 5%
Angry 2.5%
Confused 0.9%
Disgusted 0.7%
Fear 0.6%
Surprised 0.6%

AWS Rekognition

Age 33-49
Gender Female, 54.8%
Fear 45%
Sad 18.5%
Calm 18.2%
Happy 7.7%
Surprised 6.2%
Confused 1.6%
Angry 1.6%
Disgusted 1.1%

AWS Rekognition

Age 23-35
Gender Female, 62.6%
Calm 38.8%
Happy 28.9%
Sad 21.5%
Angry 5.8%
Confused 1.9%
Fear 1.6%
Disgusted 1%
Surprised 0.5%

AWS Rekognition

Age 19-31
Gender Male, 76.9%
Calm 68.8%
Happy 28.3%
Sad 1.3%
Confused 0.6%
Disgusted 0.4%
Angry 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 16-28
Gender Female, 87.9%
Sad 95.3%
Calm 2.7%
Happy 0.9%
Disgusted 0.3%
Confused 0.3%
Angry 0.2%
Fear 0.2%
Surprised 0%

AWS Rekognition

Age 12-22
Gender Female, 66.6%
Calm 64.6%
Happy 26%
Sad 4.9%
Angry 2.6%
Confused 0.7%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 5-15
Gender Female, 75.5%
Happy 55.9%
Calm 29%
Sad 11.3%
Angry 1.6%
Fear 0.8%
Confused 0.6%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 9-19
Gender Female, 72.2%
Calm 74.3%
Happy 10.4%
Sad 7.2%
Angry 3.7%
Fear 2.6%
Confused 0.9%
Surprised 0.6%
Disgusted 0.3%

AWS Rekognition

Age 3-9
Gender Female, 60.4%
Calm 55.8%
Happy 38.4%
Angry 1.9%
Sad 1.2%
Confused 0.9%
Surprised 0.8%
Disgusted 0.7%
Fear 0.2%

AWS Rekognition

Age 26-40
Gender Female, 59.8%
Fear 36.2%
Happy 23.8%
Calm 15%
Angry 8.5%
Sad 7.2%
Disgusted 3.5%
Confused 3.3%
Surprised 2.5%

AWS Rekognition

Age 14-26
Gender Male, 61.7%
Happy 75.9%
Calm 20.8%
Disgusted 1.4%
Sad 0.8%
Confused 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 9-19
Gender Male, 77.2%
Sad 66.1%
Happy 12.9%
Fear 9.1%
Calm 6.9%
Surprised 2.8%
Angry 1.6%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 8-18
Gender Male, 85.7%
Calm 49.8%
Happy 31.6%
Sad 7%
Confused 6.4%
Angry 2.2%
Surprised 1.3%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 19-31
Gender Male, 89.3%
Fear 69%
Surprised 13.6%
Confused 4.2%
Calm 4%
Happy 3.4%
Sad 2.6%
Angry 2.4%
Disgusted 0.6%

AWS Rekognition

Age 16-28
Gender Female, 58.6%
Happy 86%
Calm 11%
Sad 1.5%
Confused 0.5%
Disgusted 0.4%
Angry 0.4%
Surprised 0.1%
Fear 0.1%

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people posing for a photo 91.3%
a group of people posing for the camera 91.2%
a group of people posing for a picture 91.1%