Human Generated Data

Title

Untitled (three daughters and fathers posing with Troop leader at Girl Scout Father and Daughter Banquet)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3171

Human Generated Data

Title

Untitled (three daughters and fathers posing with Troop leader at Girl Scout Father and Daughter Banquet)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99.5
Clothing 99.5
Apparel 99.5
Person 99.4
Person 99.2
Person 99
Person 99
Person 97.3
Helmet 95.7
Female 93.9
Helmet 92.2
Skirt 91.5
Helmet 86.7
Woman 80.1
Dress 79.1
Suit 66.1
Coat 66.1
Overcoat 66.1
Leisure Activities 61.6
Crowd 56.1

Imagga
created on 2022-01-22

brass 48.8
musical instrument 41
wind instrument 41
man 32.9
people 32.9
male 31.2
person 29.5
group 25.8
adult 21.9
teacher 20.8
businessman 20.3
business 20
men 19.7
happy 18.8
cornet 17.8
couple 17.4
trombone 16
women 15
together 14.9
home 14.3
indoors 14
percussion instrument 13.6
to 13.3
meeting 13.2
room 13
team 12.5
job 12.4
senior 12.2
education 12.1
professional 11.6
classroom 11.5
office 11.2
modern 11.2
teamwork 11.1
youth 11.1
black 10.9
smiling 10.8
dress 10.8
lifestyle 10.8
corporate 10.3
board 9.9
interior 9.7
portrait 9.7
performer 9.6
standing 9.5
executive 9.4
two 9.3
school 9.1
businesswoman 9.1
new 8.9
musician 8.7
dance 8.7
boy 8.7
hands 8.7
chair 8.6
30s 8.6
student 8.6
sitting 8.6
mature 8.4
blackboard 8.1
singer 8.1
happiness 7.8
class 7.7
bride 7.7
educator 7.6
hand 7.6
fashion 7.5
human 7.5
fun 7.5
study 7.5
silhouette 7.4
manager 7.4
holding 7.4
marimba 7.4
active 7.4
device 7.3
indoor 7.3
worker 7.3
golfer 7.1
smile 7.1
family 7.1
kid 7.1
player 7

Google
created on 2022-01-22

Photograph 94.2
Black 89.6
Dress 84.7
Style 83.8
Snapshot 74.3
Folk instrument 74.2
Event 72.8
Vintage clothing 72.7
Monochrome 71.8
Monochrome photography 71.2
Racquet sport 70.3
Crew 69.7
Team 69.1
Uniform 68.9
Stock photography 66.2
Room 65.2
Hat 64.6
Suit 62.5
Chair 60
Strings 57.7

Microsoft
created on 2022-01-22

person 99.7
man 90.4
indoor 87.2
clothing 87
text 84.8
standing 84.6
musical instrument 83.5
music 82.8
drum 71.1
posing 42

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Female, 80.5%
Calm 47.6%
Happy 41.4%
Sad 3.5%
Confused 2.3%
Surprised 1.5%
Disgusted 1.4%
Angry 1.4%
Fear 0.9%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 96.1%
Surprised 1.5%
Sad 0.8%
Confused 0.4%
Happy 0.4%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 48-56
Gender Male, 82.8%
Surprised 74.8%
Happy 9.2%
Calm 7.6%
Confused 3.2%
Fear 2.6%
Disgusted 1.4%
Sad 0.7%
Angry 0.5%

AWS Rekognition

Age 34-42
Gender Female, 73.7%
Happy 97.1%
Surprised 1.1%
Fear 0.6%
Calm 0.4%
Angry 0.2%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 41-49
Gender Male, 97%
Happy 46.1%
Calm 43.3%
Sad 3.5%
Surprised 3.4%
Angry 2%
Disgusted 0.9%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Female, 99.3%
Happy 93.5%
Sad 4.1%
Calm 1.1%
Surprised 0.5%
Fear 0.4%
Disgusted 0.2%
Confused 0.2%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Sad 28.6%
Calm 18.5%
Angry 14.8%
Happy 11.5%
Fear 8.3%
Surprised 7.4%
Confused 6.1%
Disgusted 4.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Helmet 95.7%
Suit 66.1%

Captions

Microsoft

a group of people standing in front of a cake 83.7%
a group of people standing in a room 83.6%
a group of people posing for the camera 83.5%

Text analysis

Amazon

DON