Human Generated Data

Title

Untitled (portrait of large family)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2689

Human Generated Data

Title

Untitled (portrait of large family)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Clothing 99.7
Apparel 99.7
Person 99.6
Human 99.6
Person 99.3
Shorts 99.2
Person 97.5
Person 96.2
Person 96
Person 95.4
Person 94.7
Person 90.8
Female 88.7
Person 87.8
Person 86
Person 80.7
Dress 78.4
Person 76.5
People 76
Suit 76
Coat 76
Overcoat 76
Person 71.2
Girl 70.7
Kid 69.1
Child 69.1
Face 65.4
Chair 64.4
Furniture 64.4
Woman 64.3
Portrait 64.2
Photography 64.2
Photo 64.2
Door 61.2
Person 59.1
Sailor Suit 56.1
Indoors 55.5
Person 45.6

Imagga
created on 2022-01-16

brass 98.5
wind instrument 75.2
musical instrument 49.8
cornet 48
people 29
group 27.4
silhouette 26.5
person 24.4
men 22.3
man 20.9
male 20.6
dancer 19.4
crowd 18.2
adult 17.2
business 16.4
team 16.1
women 15.8
human 15.7
performer 15.5
bugle 15.1
black 15
trombone 14.5
party 13.7
active 13.5
music 13.2
horn 12.7
businessman 12.3
device 12.2
art 12
exercise 10.9
fitness 10.8
sport 10.8
light 10.7
design 10.7
teamwork 10.2
dance 10.2
happy 10
concert 9.7
performance 9.6
entertainer 9.5
teenager 9.1
activity 8.9
musician 8.9
body 8.8
celebration 8.8
band 8.7
corporate 8.6
professional 8.3
fashion 8.3
competition 8.2
fun 8.2
style 8.2
graphic 8
posing 8
night 8
lifestyle 7.9
work 7.8
happiness 7.8
boy 7.8
play 7.7
dancing 7.7
motion 7.7
jump 7.7
musical 7.7
health 7.6
casual 7.6
dark 7.5
player 7.4
success 7.2
portrait 7.1
job 7.1
modern 7

Google
created on 2022-01-16

Dress 89.8
Black 89.6
Shorts 88.1
Style 83.8
Font 83.1
Team sport 79.3
Player 77.9
Sports uniform 72.1
Uniform 71.7
Event 71.5
Crew 70.4
Sports 68.6
Monochrome 67.1
Room 66.5
T-shirt 65.6
Child 63.5
Team 63.4
Monochrome photography 62.3
Vintage clothing 59.7
Toddler 57.6

Microsoft
created on 2022-01-16

text 95
clothing 93.2
person 92.2
posing 86.1
player 70.1
musical instrument 68.7
footwear 65.9
team 29.8

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 57.8%
Happy 53.5%
Calm 32.6%
Surprised 8.1%
Sad 3.3%
Fear 1.2%
Confused 0.8%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 90%
Calm 99%
Sad 0.7%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 98.7%
Sad 92.8%
Calm 2.8%
Happy 2.7%
Confused 0.6%
Surprised 0.6%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Female, 62.3%
Calm 94.4%
Happy 4.8%
Sad 0.4%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 89%
Calm 77.9%
Sad 20%
Surprised 0.8%
Confused 0.4%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 34-42
Gender Female, 99.9%
Happy 70.8%
Calm 23%
Sad 3.6%
Confused 0.8%
Surprised 0.6%
Fear 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 51-59
Gender Male, 90.8%
Happy 73.8%
Calm 13.9%
Sad 7.4%
Disgusted 2%
Confused 1%
Surprised 0.8%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 56.2%
Happy 26.3%
Surprised 5.6%
Disgusted 4.2%
Confused 3.2%
Angry 1.9%
Sad 1.4%
Fear 1.1%

AWS Rekognition

Age 40-48
Gender Male, 67.2%
Calm 90%
Sad 4.8%
Happy 4.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.1%
Happy 95.5%
Calm 3%
Sad 0.8%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 72.6%
Calm 57.2%
Sad 25.4%
Happy 14.2%
Surprised 1%
Disgusted 0.7%
Angry 0.6%
Fear 0.6%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Female, 78.8%
Happy 58%
Calm 35.4%
Surprised 4%
Confused 1.1%
Sad 0.6%
Disgusted 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Male, 93%
Calm 99.3%
Sad 0.2%
Happy 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Surprised 44.6%
Calm 36.8%
Happy 16%
Confused 1.4%
Disgusted 0.7%
Sad 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 98.9%
Calm 74.8%
Happy 23.5%
Sad 1.1%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 97.5%
Calm 99.5%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 94.1%
a group of people posing for the camera 94%
a group of people posing for a picture 93.9%