Human Generated Data

Title

Untitled (large family portrait outside home)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2852

Human Generated Data

Title

Untitled (large family portrait outside home)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2852

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.1
Human 99.1
People 95.3
Clothing 94.9
Apparel 94.9
Person 93.6
Person 93.5
Person 93
Person 90.9
Housing 89.3
Building 89.3
Person 88.9
Person 86.5
Person 85.1
Person 81.3
Person 80
Porch 78.1
Person 77
Outdoors 75.9
Person 74.7
Kid 72.5
Child 72.5
Person 71.3
Person 71.1
Shorts 70.2
Door 67.6
Person 67.2
House 65.8
Nature 63.7
Person 62.9
Family 62.2
Person 60.2
Face 60.2
Person 59.9
Military Uniform 59.3
Military 59.3
Dress 58
Female 57
Person 56.7
Portrait 56.3
Photography 56.3
Photo 56.3
Soldier 55.6

Clarifai
created on 2023-10-26

people 99.9
child 99.7
group 99.1
group together 98.7
many 98.3
family 98
boy 97.8
education 97
adult 96.3
man 95.2
school 95
wear 90.6
home 89.9
woman 89.2
several 88.7
outfit 87.7
room 85.5
son 83.2
administration 80.9
elementary school 78.6

Imagga
created on 2022-01-16

people 18.4
room 18.1
classroom 16.8
stage 16
travel 14.8
man 14.1
platform 13
outdoors 12.8
old 12.5
building 11.7
person 11.1
male 10.6
tourist 10.1
tree 10
city 10
history 9.8
crowd 9.6
kin 9.5
school 9.5
adult 9.4
beach 9.3
outdoor 9.2
sport 9
group 8.9
teacher 8.7
architecture 8.6
winter 8.5
world 8.4
tourism 8.2
farm 8
country 7.9
business 7.9
sand 7.8
summer 7.7
sky 7.6
structure 7.6
walking 7.6
house 7.6
ocean 7.5
park 7.4
vacation 7.4
water 7.3
lifestyle 7.2
transportation 7.2
educator 7.1
mountain 7.1
night 7.1
sea 7

Google
created on 2022-01-16

Window 93
House 83.5
Art 81.3
Picture frame 80
People 79.4
Adaptation 79.2
Door 76.5
Vintage clothing 75.9
Painting 74.5
Building 72.8
Child 72.6
Illustration 71.1
Monochrome 71
Room 68.6
History 67.4
Cottage 65.3
Monochrome photography 63.5
Home 63.2
Facade 63
Visual arts 62.9

Microsoft
created on 2022-01-16

building 99.4
outdoor 99.2
house 93.7
person 88.9
player 85.6
black 84.3
old 82.5
white 80.8
group 79.6
standing 76.5
text 72.4
posing 65
clothing 62.9
people 57.9
team 45

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 53.8%
Calm 73%
Sad 13.2%
Happy 7.2%
Confused 4.6%
Disgusted 0.6%
Angry 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Male, 52%
Happy 52.8%
Calm 26.6%
Sad 6.8%
Fear 3.2%
Confused 3.2%
Angry 3.1%
Disgusted 2.4%
Surprised 1.9%

AWS Rekognition

Age 34-42
Gender Male, 82.5%
Happy 67.8%
Calm 25.7%
Sad 1.8%
Disgusted 1.4%
Fear 1.3%
Angry 0.8%
Confused 0.7%
Surprised 0.6%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 97%
Happy 1.5%
Fear 0.5%
Sad 0.4%
Surprised 0.3%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 90.9%
Sad 56.2%
Happy 12.5%
Calm 12.1%
Disgusted 10.9%
Angry 3.2%
Confused 1.8%
Surprised 1.7%
Fear 1.5%

AWS Rekognition

Age 41-49
Gender Male, 77.3%
Happy 74.3%
Calm 20.2%
Sad 1.9%
Confused 1.6%
Fear 0.7%
Surprised 0.5%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 31-41
Gender Male, 93%
Calm 55%
Happy 30.6%
Sad 10.9%
Surprised 0.9%
Disgusted 0.7%
Angry 0.7%
Confused 0.7%
Fear 0.5%

AWS Rekognition

Age 36-44
Gender Male, 96.7%
Calm 47.9%
Happy 45.2%
Sad 1.9%
Surprised 1.2%
Confused 1.1%
Disgusted 1.1%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 30-40
Gender Female, 64.6%
Happy 74.1%
Calm 12.4%
Sad 8.3%
Angry 1.2%
Disgusted 1.1%
Confused 1.1%
Fear 1%
Surprised 0.7%

AWS Rekognition

Age 23-31
Gender Female, 98.5%
Calm 93%
Sad 4.6%
Happy 1.7%
Confused 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Male, 84.9%
Calm 46%
Sad 43.9%
Happy 3.3%
Fear 1.9%
Disgusted 1.6%
Angry 1.4%
Surprised 0.9%
Confused 0.9%

AWS Rekognition

Age 23-33
Gender Female, 86.8%
Calm 33.5%
Disgusted 27.8%
Happy 19%
Sad 10.3%
Angry 3.6%
Confused 2.5%
Surprised 2%
Fear 1.3%

AWS Rekognition

Age 29-39
Gender Female, 83.5%
Happy 72.4%
Sad 8.3%
Calm 8.2%
Fear 4.2%
Confused 2.8%
Surprised 1.7%
Angry 1.2%
Disgusted 1.2%

AWS Rekognition

Age 39-47
Gender Male, 62.1%
Happy 69.4%
Calm 22%
Sad 2.2%
Surprised 2.1%
Fear 1.6%
Disgusted 1.2%
Angry 0.9%
Confused 0.6%

AWS Rekognition

Age 26-36
Gender Male, 97.1%
Happy 97.2%
Calm 1.5%
Sad 0.7%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Happy 82%
Calm 11.5%
Sad 4%
Confused 0.9%
Angry 0.6%
Surprised 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Calm 95.4%
Sad 2.8%
Happy 0.4%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%
Surprised 0.2%
Confused 0.2%

AWS Rekognition

Age 34-42
Gender Male, 99.5%
Calm 96.2%
Happy 1.4%
Angry 0.8%
Fear 0.7%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 80.1%
Calm 58.5%
Happy 26.6%
Sad 5.2%
Angry 3.3%
Confused 2.6%
Fear 2.2%
Disgusted 1.2%
Surprised 0.5%

AWS Rekognition

Age 34-42
Gender Male, 73.2%
Calm 84.4%
Happy 11.1%
Angry 1.5%
Sad 1.5%
Fear 0.5%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 24-34
Gender Male, 95.1%
Calm 96%
Angry 2.2%
Sad 0.8%
Happy 0.4%
Confused 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Female, 50.5%
Calm 85.2%
Sad 3.8%
Happy 3.5%
Angry 2.7%
Surprised 2.2%
Fear 1.2%
Confused 0.9%
Disgusted 0.6%

AWS Rekognition

Age 23-33
Gender Male, 84.8%
Calm 96.8%
Happy 1%
Fear 0.5%
Sad 0.5%
Surprised 0.4%
Disgusted 0.3%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 97.8%
Calm 64%
Sad 13.5%
Happy 10.4%
Fear 6.1%
Disgusted 1.9%
Angry 1.9%
Surprised 1.4%
Confused 0.9%

AWS Rekognition

Age 45-53
Gender Male, 97.7%
Happy 74.8%
Calm 9%
Fear 8.5%
Sad 3.6%
Surprised 1.5%
Disgusted 1%
Angry 0.9%
Confused 0.7%

AWS Rekognition

Age 24-34
Gender Male, 91.6%
Happy 58.9%
Calm 21.1%
Sad 15.3%
Fear 1.8%
Confused 1.2%
Surprised 0.7%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 28-38
Gender Male, 68.3%
Calm 97.6%
Sad 2.1%
Happy 0.2%
Angry 0%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 93.8%
Calm 41.9%
Fear 24.2%
Happy 19%
Sad 8.4%
Disgusted 3.1%
Angry 1.6%
Surprised 1%
Confused 0.8%

AWS Rekognition

Age 30-40
Gender Male, 86.7%
Calm 77.3%
Sad 8.9%
Happy 5.8%
Surprised 3%
Fear 1.8%
Angry 1.4%
Disgusted 1%
Confused 0.7%

AWS Rekognition

Age 40-48
Gender Male, 61.9%
Calm 82.9%
Sad 11.9%
Happy 3.6%
Fear 0.7%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Female, 95.5%
Calm 99.2%
Sad 0.4%
Happy 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 98.4%
Calm 75.1%
Happy 12.6%
Sad 7.6%
Surprised 2%
Angry 0.9%
Disgusted 0.9%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 24-34
Gender Female, 95%
Happy 96.6%
Calm 2.3%
Fear 0.3%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Male, 92.1%
Calm 96.9%
Sad 1.9%
Confused 0.3%
Happy 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Female, 91.5%
Calm 91.5%
Sad 4.2%
Confused 1.2%
Fear 1%
Angry 0.8%
Surprised 0.5%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 16-24
Gender Male, 69.5%
Calm 48.8%
Happy 28.5%
Sad 12.3%
Fear 3.1%
Confused 2.6%
Surprised 1.7%
Angry 1.6%
Disgusted 1.3%

AWS Rekognition

Age 33-41
Gender Female, 67.7%
Happy 81.2%
Sad 12.4%
Calm 4.4%
Angry 0.5%
Confused 0.5%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Female, 67.9%
Sad 49.4%
Calm 39.1%
Happy 5.4%
Confused 2.1%
Surprised 1.2%
Disgusted 1%
Angry 1%
Fear 0.9%

AWS Rekognition

Age 23-33
Gender Male, 73.3%
Fear 34.7%
Sad 28.7%
Happy 16.5%
Calm 10.8%
Confused 4%
Disgusted 2%
Surprised 1.8%
Angry 1.4%

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Calm 90.1%
Sad 6.1%
Happy 1.6%
Confused 0.9%
Angry 0.5%
Disgusted 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 48-56
Gender Female, 59%
Calm 41.9%
Happy 17.8%
Sad 17.3%
Confused 9%
Disgusted 7.2%
Angry 3.4%
Surprised 2.6%
Fear 0.8%

AWS Rekognition

Age 23-33
Gender Male, 81.3%
Calm 92%
Happy 4.1%
Fear 1.2%
Confused 0.9%
Sad 0.7%
Angry 0.4%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Female, 50.1%
Calm 96.2%
Happy 1.7%
Sad 1%
Surprised 0.5%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Male, 68.6%
Happy 67.7%
Calm 20.9%
Sad 5.1%
Fear 2%
Confused 1.4%
Disgusted 1.2%
Surprised 1%
Angry 0.6%

AWS Rekognition

Age 34-42
Gender Male, 82.8%
Calm 92.7%
Happy 3.5%
Confused 2.3%
Sad 1%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 64.6%
Calm 44.5%
Sad 27.1%
Happy 20.8%
Angry 2.5%
Fear 1.8%
Confused 1.6%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 31-41
Gender Female, 76.1%
Sad 80.3%
Calm 18.1%
Confused 0.4%
Angry 0.3%
Happy 0.3%
Fear 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 34-42
Gender Male, 51.6%
Calm 54.9%
Happy 23.9%
Confused 10.6%
Sad 5.7%
Surprised 2.1%
Angry 1.3%
Fear 0.8%
Disgusted 0.7%

AWS Rekognition

Age 25-35
Gender Female, 98.3%
Happy 99.4%
Calm 0.4%
Sad 0.1%
Confused 0%
Fear 0%
Angry 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Female, 95.4%
Happy 86.8%
Calm 9.7%
Fear 1.2%
Sad 0.9%
Surprised 0.4%
Disgusted 0.4%
Angry 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.1%

Text analysis

Amazon

KOD