Human Generated Data

Title

Untitled (large group family portrait on lawn outside house, patriarch seated at center)
Date

c. 1945
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6977

Human Generated Data

Title

Untitled (large group family portrait on lawn outside house, patriarch seated at center)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6977

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.2
Person 98.8
Person 98.4
People 97.9
Person 97
Person 96.5
Person 92.1
Family 91.1
Person 90.3
Person 86
Person 84.1
Person 75.2
Clothing 70.4
Apparel 70.4
Military Uniform 67.2
Military 67.2
Person 66.8
Person 64.2
Outdoors 60.5
Troop 60.1
Armored 60.1
Army 60.1
Person 60
Person 44.8

Clarifai
created on 2023-10-27

people 100
child 99.9
group 99.4
street 99
monochrome 98.9
boy 98.8
man 98
group together 97.7
documentary 97.3
woman 96.3
school 96.1
family 95.7
sepia 95
son 94.8
girl 94.6
adult 94.1
many 92.3
war 90.3
education 90.3
home 89.8

Imagga
created on 2022-01-23

snow 54.4
kin 38.5
winter 34.9
cold 26.7
weather 22.7
old 20.2
landscape 20.1
tree 20
snowy 18.5
forest 17.4
helmet 17.3
people 17.3
park 15.6
season 14.8
man 14.8
building 14.5
outdoor 14.5
trees 14.2
scene 13
travel 12.7
armor plate 12.6
snowing 11.8
wood 11.7
city 11.6
frost 11.5
tourist 11.5
light 11.4
clothing 11
sky 10.8
history 10.7
sepia 10.7
frozen 10.5
outdoors 10.4
ancient 10.4
architecture 10.1
ice 10.1
street 10.1
blizzard 9.9
urban 9.6
couple 9.6
walking 9.5
house 9.4
person 9.4
holiday 9.3
historic 9.2
child 9
night 8.9
together 8.8
seasonal 8.7
freeze 8.7
storm 8.6
outside 8.5
male 8.5
portrait 8.4
vintage 8.3
scenery 8.1
mountain 8
new england 7.9
mother 7.8
wall 7.7
residential 7.7
uniform 7.5
town 7.4
military uniform 7.3
new 7.3
plate 7.2
religion 7.2
day 7.1
rural 7

Google
created on 2022-01-23

Photograph 94.2
Tree 88.6
Plant 85.5
Adaptation 79.3
Tints and shades 77.2
House 74.8
Building 72.8
Monochrome 72.5
Family reunion 72.1
Vintage clothing 72
Event 69.8
History 68
Rectangle 66.1
Pole 64.8
Plantation 64.4
Stock photography 63.2
Room 62.4
Art 61.8
Visual arts 61.5
Suit 59.9

Microsoft
created on 2022-01-23

tree 99.4
outdoor 98
person 96.2
text 93
clothing 86.7
group 79.5
people 57.4
posing 52.3
old 40.3
crowd 1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 77.9%
Sad 6.4%
Angry 5.1%
Surprised 4.1%
Happy 3.3%
Disgusted 1.4%
Fear 1%
Confused 1%

AWS Rekognition

Age 41-49
Gender Female, 99.9%
Calm 97.3%
Sad 1.3%
Angry 0.5%
Confused 0.3%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 9-17
Gender Female, 94.6%
Calm 86.1%
Angry 6%
Sad 4.4%
Surprised 1.1%
Confused 0.8%
Disgusted 0.6%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 97.2%
Calm 1.2%
Surprised 0.5%
Disgusted 0.3%
Fear 0.3%
Sad 0.2%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 6-12
Gender Female, 99.7%
Sad 96.8%
Happy 1.2%
Angry 1.1%
Calm 0.4%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 59.3%
Fear 15.9%
Happy 13.9%
Sad 5.8%
Angry 3.2%
Surprised 0.8%
Confused 0.7%
Disgusted 0.5%

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 67%
Surprised 12.3%
Sad 5%
Confused 4.7%
Happy 3.8%
Angry 3%
Fear 2.6%
Disgusted 1.6%

AWS Rekognition

Age 28-38
Gender Female, 100%
Calm 43.4%
Sad 38%
Confused 8.9%
Fear 4.8%
Surprised 2%
Happy 1.2%
Angry 1.1%
Disgusted 0.7%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Happy 64.7%
Calm 28%
Sad 3.7%
Disgusted 1.2%
Angry 1%
Surprised 0.7%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.5%
Calm 97.9%
Happy 0.7%
Surprised 0.4%
Fear 0.3%
Sad 0.2%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 69-79
Gender Female, 99.7%
Sad 87.1%
Calm 11.8%
Happy 0.6%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 12-20
Gender Female, 92.6%
Calm 97.5%
Disgusted 0.5%
Sad 0.5%
Confused 0.4%
Fear 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 50.8%
Sad 86.2%
Calm 10.7%
Angry 0.9%
Surprised 0.6%
Confused 0.4%
Fear 0.4%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 34-42
Gender Female, 68.3%
Calm 46.5%
Happy 30.4%
Sad 6.4%
Angry 5.7%
Disgusted 4.4%
Fear 3.7%
Surprised 1.6%
Confused 1.5%

AWS Rekognition

Age 38-46
Gender Female, 78.9%
Happy 99.1%
Surprised 0.2%
Angry 0.2%
Calm 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.5%
Happy 100%
Calm 0%
Sad 0%
Surprised 0%
Fear 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 0-4
Gender Female, 100%
Calm 98.9%
Sad 0.5%
Happy 0.2%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 39-47
Gender Female, 100%
Disgusted 61.5%
Sad 18.9%
Angry 6.8%
Calm 4.3%
Confused 3.9%
Surprised 2%
Happy 1.6%
Fear 1%

AWS Rekognition

Age 47-53
Gender Female, 100%
Sad 80.5%
Calm 9.6%
Fear 7.5%
Angry 0.9%
Surprised 0.7%
Disgusted 0.3%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 35-43
Gender Female, 100%
Happy 90.6%
Surprised 2.3%
Fear 2.2%
Disgusted 1.5%
Angry 1.2%
Calm 1%
Sad 0.8%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 50.6%
Happy 30%
Surprised 9.7%
Angry 3.1%
Sad 3.1%
Fear 1.3%
Confused 1.2%
Disgusted 1%

AWS Rekognition

Age 33-41
Gender Female, 100%
Happy 98.4%
Calm 1.1%
Sad 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 45-51
Gender Female, 97.7%
Calm 68.9%
Sad 15.2%
Fear 8.3%
Confused 2.5%
Surprised 2.1%
Happy 1.3%
Angry 1.1%
Disgusted 0.6%

AWS Rekognition

Age 2-8
Gender Female, 100%
Sad 85.9%
Calm 9.3%
Angry 1.6%
Disgusted 1.3%
Happy 0.6%
Fear 0.5%
Surprised 0.5%
Confused 0.3%

AWS Rekognition

Age 49-57
Gender Male, 77.9%
Calm 81.8%
Happy 17.9%
Surprised 0.1%
Sad 0.1%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 6-12
Gender Female, 98.9%
Sad 65.3%
Calm 24.1%
Happy 3.6%
Angry 2.6%
Confused 1.2%
Disgusted 1.1%
Surprised 1.1%
Fear 1%

AWS Rekognition

Age 18-26
Gender Male, 54.8%
Angry 100%
Calm 0%
Confused 0%
Sad 0%
Disgusted 0%
Surprised 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 36-44
Gender Female, 99.7%
Angry 92.6%
Calm 6.3%
Sad 0.4%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 99.2%
Sad 75.1%
Calm 16.6%
Happy 2.7%
Disgusted 1.8%
Angry 1.3%
Fear 1.3%
Confused 0.9%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Sad 52.5%
Calm 37.8%
Angry 5.7%
Confused 1.8%
Surprised 0.8%
Fear 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 23-33
Gender Female, 72.6%
Sad 99.7%
Fear 0.1%
Calm 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 51-59
Gender Male, 84.2%
Happy 91.1%
Sad 4.1%
Calm 2.4%
Disgusted 1%
Fear 0.9%
Surprised 0.2%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Sad 73.8%
Calm 21.5%
Confused 2%
Disgusted 0.8%
Angry 0.8%
Surprised 0.4%
Happy 0.4%
Fear 0.3%

AWS Rekognition

Age 6-14
Gender Female, 95.8%
Sad 62.8%
Calm 25.4%
Confused 3.5%
Angry 2.8%
Disgusted 2.4%
Surprised 1.2%
Happy 0.9%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 98.2%
Calm 72.7%
Sad 11.7%
Surprised 5.7%
Happy 4.4%
Fear 2.6%
Angry 1.2%
Disgusted 1.2%
Confused 0.7%

AWS Rekognition

Age 18-24
Gender Male, 74.9%
Calm 97.1%
Sad 0.7%
Fear 0.7%
Disgusted 0.4%
Angry 0.4%
Happy 0.3%
Confused 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 99.2%
Person 98.8%
Person 98.4%
Person 97%
Person 96.5%
Person 92.1%
Person 90.3%
Person 86%
Person 84.1%
Person 75.2%
Person 66.8%
Person 64.2%
Person 60%
Person 44.8%