Human Generated Data

Title

Untitled (group of women in dance costumes seated around man in tux)

Date

1951

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18407

Human Generated Data

Title

Untitled (group of women in dance costumes seated around man in tux)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Clothing 99.9
Helmet 99.9
Apparel 99.9
Helmet 99.6
Human 99.6
Person 99.6
Helmet 99.5
Helmet 99.4
Person 99.3
Helmet 98.5
Person 98.3
Helmet 97.4
Shorts 97.2
Helmet 96.5
Helmet 96.4
Person 92.2
People 89.1
Face 86.9
Person 86
Person 85.3
Suit 84.9
Overcoat 84.9
Coat 84.9
Person 83.6
Helmet 82.5
Person 81
Chair 80.8
Furniture 80.8
Helmet 79.2
Dress 78
Female 72.4
Plant 70.9
Grass 70.9
Sailor Suit 67.3
Portrait 64.5
Photo 64.5
Photography 64.5
Girl 60
Costume 58.1

Imagga
created on 2022-03-04

ballplayer 56
athlete 52.6
player 52.1
soccer ball 44.7
ball 43.1
contestant 35.7
person 32.9
game equipment 27.7
sport 26.8
equipment 22.6
man 21.5
people 21.2
male 19.3
helmet 17
football helmet 16.9
men 14.6
play 13.8
adult 13.7
run 12.5
outdoor 12.2
active 11.7
team 11.6
silhouette 11.6
clothing 10.9
black 10.8
sunset 10.8
child 10.7
fun 10.5
couple 10.4
boy 10.4
dalmatian 10.2
headdress 10.2
lifestyle 10.1
power 10.1
exercise 10
game 9.8
outdoors 9.7
summer 9.6
motion 9.4
dark 9.2
leisure 9.1
dress 9
dog 8.9
mask 8.6
performance 8.6
portrait 8.4
head 8.4
fashion 8.3
dance 8.2
teenager 8.2
style 8.2
trainer 8.2
happy 8.1
grass 7.9
athletic 7.7
field 7.5
human 7.5
guy 7.3
teen 7.3
girls 7.3
protection 7.3
fitness 7.2
suit 7.2
body 7.2
day 7.1
canine 7
sky 7
together 7

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

outdoor 99.2
player 96.4
text 95.8
drawing 88.3
person 87.8
clothing 82.2
sketch 72.4
footwear 61.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.1%
Sad 73.4%
Fear 7.8%
Happy 5.2%
Surprised 4.9%
Confused 4%
Calm 2.2%
Angry 1.5%
Disgusted 1%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Surprised 90.6%
Confused 6.1%
Happy 2.6%
Disgusted 0.2%
Calm 0.2%
Sad 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 75.4%
Surprised 9.3%
Sad 6.4%
Happy 3.7%
Confused 2.5%
Disgusted 1.2%
Angry 0.8%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 98.7%
Calm 92%
Surprised 3.7%
Confused 1.4%
Happy 1.3%
Disgusted 0.7%
Sad 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 45-51
Gender Male, 97.4%
Happy 92%
Surprised 5.2%
Calm 0.8%
Disgusted 0.6%
Confused 0.6%
Angry 0.4%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Surprised 62.7%
Happy 16.4%
Calm 8.2%
Confused 3.2%
Disgusted 2.9%
Fear 2.8%
Sad 2.3%
Angry 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Helmet 99.9%
Person 99.6%

Captions

Microsoft

a group of baseball players standing on top of a field 80.2%
a group of baseball players on a field 80.1%
a group of baseball players standing on top of a grass covered field 71.5%

Text analysis

Amazon

NAGOR
YT39A8

Google

NAGON
YT39A8 NAGON hel
YT39A8
hel