Human Generated Data

Title

Untitled (portrait of an extended family)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2209

Human Generated Data

Title

Untitled (portrait of an extended family)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.7
Person 98.7
Person 98.6
Person 97.6
Person 97.2
Person 97.1
Clothing 95.9
Apparel 95.9
Person 95.8
Person 93.9
Person 93.6
Person 93.4
People 92.7
Person 92.2
Person 90.3
Person 84.7
Person 84.5
Person 83.3
Person 79.6
Person 78.1
Person 76.1
Person 75
Shorts 74.2
Person 68.8
Person 68.3
Female 63.7
Girl 61.3
Boy 57.2
Family 57.1
Tie 56.6
Accessory 56.6
Accessories 56.6

Imagga
created on 2021-12-14

gymnasium 55.1
athletic facility 44.4
facility 34.8
graffito 31.4
decoration 24.1
man 18.8
sport 18.1
people 16.7
male 15.6
grunge 14.5
silhouette 14.1
black 13.8
person 13.3
city 12.5
run 11.6
urban 11.3
outdoors 11.2
team 10.7
ball 10.5
drawing 10.4
boy 10.4
play 10.3
men 10.3
motion 10.3
power 10.1
active 9.9
art 9.8
athlete 9.8
old 9.7
design 9
group 8.9
crowd 8.6
building 8.6
player 8.5
business 8.5
adult 8.4
dark 8.3
action 8.3
competition 8.2
exercise 8.2
symbol 8.1
game 8
businessman 7.9
women 7.9
dance 7.9
wall 7.7
goal 7.7
youth 7.7
sign 7.5
vacation 7.4
graphic 7.3
teenager 7.3
paint 7.2
dress 7.2
fitness 7.2
portrait 7.1
interior 7.1
travel 7
modern 7

Google
created on 2021-12-14

Motor vehicle 86.3
Suit 80.2
Player 75.6
Crew 75
Team 69.9
Vintage clothing 68
Team sport 67.7
Event 65.7
History 64.5
Font 59.5
Uniform 56.8
Monochrome 54.8
Window 54.8
Sitting 54.2
Family 51.5
Sports equipment 51
Room 50.4
Ball 50.2

Microsoft
created on 2021-12-14

outdoor 96.8
person 96.2
text 93.5
clothing 87.7
posing 85.4
group 77
man 59.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-37
Gender Female, 92.1%
Confused 79.3%
Calm 14.2%
Surprised 4.5%
Sad 0.8%
Happy 0.5%
Angry 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 40-58
Gender Male, 89.8%
Calm 98.3%
Disgusted 0.8%
Surprised 0.3%
Sad 0.2%
Angry 0.1%
Happy 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 30-46
Gender Female, 98.1%
Calm 87.2%
Confused 5.5%
Sad 4.5%
Surprised 1.6%
Angry 0.4%
Fear 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 28-44
Gender Female, 98.3%
Calm 88.7%
Sad 8.3%
Surprised 0.9%
Fear 0.7%
Confused 0.5%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 31-47
Gender Female, 94.6%
Calm 81.3%
Happy 8.6%
Sad 5.4%
Angry 1.5%
Confused 1.3%
Fear 0.9%
Surprised 0.8%
Disgusted 0.2%

AWS Rekognition

Age 34-50
Gender Female, 65.3%
Calm 89.4%
Surprised 3.8%
Angry 3%
Happy 1.2%
Disgusted 1%
Confused 0.9%
Sad 0.4%
Fear 0.2%

AWS Rekognition

Age 43-61
Gender Female, 56.7%
Calm 88.6%
Surprised 4.3%
Confused 3.3%
Angry 1.2%
Sad 1.2%
Happy 0.8%
Disgusted 0.5%
Fear 0.1%

AWS Rekognition

Age 15-27
Gender Female, 92.2%
Happy 65.6%
Calm 28.8%
Sad 1.8%
Surprised 1.3%
Confused 1.1%
Disgusted 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 47-65
Gender Male, 96%
Calm 92%
Sad 3.4%
Happy 1.9%
Surprised 1%
Angry 0.5%
Disgusted 0.5%
Confused 0.5%
Fear 0.1%

AWS Rekognition

Age 47-65
Gender Male, 87.1%
Happy 44.3%
Calm 31.1%
Disgusted 8.6%
Confused 6.4%
Sad 4.1%
Angry 3.4%
Surprised 1.8%
Fear 0.3%

AWS Rekognition

Age 25-39
Gender Female, 90.9%
Calm 88%
Sad 7.7%
Surprised 1.6%
Confused 0.9%
Fear 0.6%
Angry 0.4%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Female, 69.5%
Calm 92.9%
Disgusted 2.6%
Happy 1.7%
Surprised 1.5%
Angry 0.5%
Sad 0.4%
Confused 0.3%
Fear 0.1%

AWS Rekognition

Age 43-61
Gender Male, 84.9%
Calm 94%
Surprised 3.8%
Sad 1.3%
Happy 0.5%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Male, 55.4%
Happy 49.6%
Sad 15.7%
Calm 15.2%
Surprised 7.8%
Confused 6.3%
Fear 2.9%
Angry 1.7%
Disgusted 0.8%

AWS Rekognition

Age 39-57
Gender Male, 84.4%
Calm 85.7%
Happy 6.1%
Surprised 4.1%
Disgusted 2.4%
Angry 0.7%
Confused 0.5%
Sad 0.4%
Fear 0.1%

AWS Rekognition

Age 40-58
Gender Male, 70.5%
Calm 95.8%
Sad 1.5%
Surprised 1.2%
Happy 0.7%
Angry 0.4%
Confused 0.3%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 49-67
Gender Female, 60.5%
Calm 99.2%
Surprised 0.3%
Happy 0.2%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 42-60
Gender Male, 86.8%
Calm 82.1%
Surprised 8.8%
Sad 3.7%
Confused 1.8%
Happy 1.7%
Angry 1.2%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 47-65
Gender Male, 70.6%
Calm 87.7%
Surprised 7.1%
Sad 1.8%
Happy 1.8%
Confused 0.7%
Fear 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 45-63
Gender Male, 78.4%
Calm 93.2%
Surprised 5.6%
Happy 0.6%
Fear 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 40-58
Gender Male, 86.5%
Calm 50.5%
Confused 25.4%
Surprised 12.2%
Happy 10.2%
Sad 0.8%
Angry 0.4%
Disgusted 0.4%
Fear 0.1%

AWS Rekognition

Age 53-71
Gender Male, 50.8%
Calm 80.9%
Happy 10.4%
Sad 3.8%
Confused 2.3%
Surprised 1.9%
Fear 0.3%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 34-50
Gender Female, 98.7%
Calm 76.8%
Confused 9.4%
Sad 6.3%
Happy 3.5%
Surprised 2.6%
Angry 0.6%
Fear 0.5%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 56.6%

Captions

Microsoft

a group of people posing for a photo 94.5%
a group of people posing for a picture 94.4%
a group of people posing for the camera 94.3%