Human Generated Data

Title

Untitled (portrait of eleven female grandchildren seated on and around couch)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2987

Human Generated Data

Title

Untitled (portrait of eleven female grandchildren seated on and around couch)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.4
Human 99.4
Apparel 98.7
Clothing 98.7
Person 98.5
Person 98.4
Person 98.3
Person 97.5
Person 96.4
Shorts 96.1
Person 96.1
Stage 95.5
Person 94.9
Person 94.5
Dress 88.4
Helmet 87.8
Female 84.5
Kid 81.4
Child 81.4
Helmet 81.1
Person 80.2
Helmet 77.4
Person 75.4
Girl 74.1
Face 70.4
People 68.1
Indoors 66.7
Leisure Activities 63.4
Play 59.9
Room 59.8
Dance Pose 59.4
Coat 57.6
Overcoat 57.6
Suit 57.6
Floor 56.6
Skirt 56.4

Imagga
created on 2022-01-21

person 30.2
sport 29.3
man 27.6
people 26.8
athlete 26.3
male 25.5
player 24.1
adult 21.2
ball 19.8
football helmet 17.8
contestant 17.3
helmet 16.1
exercise 15.4
soccer ball 15.2
silhouette 14.1
clothing 14
world 13.9
boy 13.9
lifestyle 13.7
body 13.6
ballplayer 13.1
portrait 12.9
men 12.9
fun 12.7
headdress 12.2
training 12
child 12
human 12
active 11.8
team 11.6
sky 11.5
happy 11.3
action 11.1
youth 11.1
summer 10.9
joy 10.8
fitness 10.8
equipment 10.7
beach 10.1
competition 10.1
teenager 10
outdoor 9.9
attractive 9.8
businessman 9.7
group 9.7
reflection 9.5
game equipment 9.5
back 9.5
smiling 9.4
happiness 9.4
fashion 9
outdoors 8.9
success 8.8
women 8.7
run 8.7
education 8.7
teacher 8.6
play 8.6
athletic 8.6
blackboard 8.6
motion 8.6
business 8.5
dance 8.4
black 8.4
head 8.4
field 8.4
event 8.3
freedom 8.2
recreation 8.1
art 8.1
activity 8.1
runner 8
school 7.9
smile 7.8
hands 7.8
drawing 7.7
match 7.7
skill 7.7
pretty 7.7
jump 7.7
health 7.6
muscular 7.6
casual 7.6
energy 7.6
healthy 7.6
power 7.6
park 7.5
vacation 7.4
water 7.3
design 7.3
pose 7.2
student 7.2
golfer 7.2
looking 7.2
sunset 7.2
handsome 7.1
cool 7.1
stadium 7.1
together 7

Google
created on 2022-01-21

Font 81.3
People 77.9
Art 76.9
Event 72
Rectangle 69.3
Pattern 67.8
Visual arts 66.2
Monochrome 63.8
Photo caption 62.4
Stock photography 62.2
Toddler 61.6
Vintage clothing 61.4
Room 59.4
Display device 59.4
Team 58.7
Entertainment 55.6
Monochrome photography 55.3
Circle 51.6

Microsoft
created on 2022-01-21

text 99.4
person 94.2
dance 94.1
clothing 92.1
player 85.7
footwear 84.2
old 49.8
posing 44.6

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 60.3%
Happy 98.2%
Surprised 0.9%
Calm 0.4%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.5%
Calm 49.7%
Happy 29.7%
Sad 10.9%
Fear 2.8%
Disgusted 1.8%
Confused 1.8%
Angry 1.6%
Surprised 1.6%

AWS Rekognition

Age 38-46
Gender Male, 92%
Happy 63.3%
Surprised 23.2%
Calm 7.9%
Sad 1.9%
Fear 1.6%
Disgusted 0.8%
Angry 0.7%
Confused 0.6%

AWS Rekognition

Age 28-38
Gender Male, 98%
Calm 97.7%
Sad 1%
Happy 0.4%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 94.4%
Calm 48.4%
Happy 24.9%
Surprised 17.6%
Fear 4.6%
Sad 1.6%
Confused 1%
Disgusted 1%
Angry 0.9%

AWS Rekognition

Age 43-51
Gender Female, 59.8%
Calm 85.1%
Happy 11.6%
Sad 2.3%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Surprised 94.6%
Angry 2.3%
Happy 1.2%
Calm 1%
Fear 0.5%
Sad 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 19-27
Gender Male, 96.7%
Surprised 96.5%
Calm 2%
Fear 0.8%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 25-35
Gender Male, 72.8%
Sad 93.1%
Happy 4.2%
Calm 1%
Surprised 0.5%
Confused 0.3%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Happy 47%
Calm 41.7%
Sad 5.4%
Confused 1.8%
Angry 1.4%
Disgusted 1.2%
Surprised 1.1%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Calm 75.4%
Surprised 17.5%
Sad 5.4%
Angry 0.5%
Fear 0.3%
Disgusted 0.3%
Confused 0.3%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 87.8%

Captions

Microsoft

a group of people posing for a photo 82.5%
a group of people posing for the camera 82.4%
a group of people posing for a picture 82.3%

Text analysis

Amazon

a
bod
12