Human Generated Data

Title

Untitled (Artificial Limb Factory ad, Philadelphia, Pennsylvania)
Date

1937, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.247
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Artificial Limb Factory ad, Philadelphia, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.8
Human 99.8
Person 99.8
Person 99.4
Shorts 98.1
Clothing 98.1
Apparel 98.1
People 84.8
Sport 66.6
Sports 66.6
Field 61.2
Outdoors 59.7
Leisure Activities 57.3
Shoe 56.9
Footwear 56.9

Imagga
created on 2022-01-08

sport 33.5
man 28.2
active 26.6
silhouette 24.8
people 24
player 23.7
male 22.7
sky 21.7
outdoors 21.6
person 21.3
fun 20.2
grass 19
summer 18.6
ball 18
exercise 17.2
play 17.2
sunset 17.1
outdoor 16.8
lifestyle 16.6
boy 16.5
athlete 16.4
happy 16.3
adult 16.1
action 14.8
outside 14.5
fitness 14.5
activity 14.3
weapon 14.3
field 14.2
leisure 14.1
run 13.5
game 13.4
playing 12.8
beach 12.8
recreation 12.6
sword 12.3
body 12
helmet 11.9
stick 11.9
joy 11.7
team 11.6
jump 11.5
black 11.4
healthy 11.3
couple 11.3
free 11.3
men 11.2
competition 11
happiness 11
football 10.6
sports 10.2
child 9.7
jumping 9.7
sun 9.7
together 9.6
athletic 9.6
motion 9.4
day 9.4
youth 9.4
ballplayer 9.4
two 9.3
equipment 9.3
freedom 9.1
autumn 8.8
smiling 8.7
soccer 8.7
running 8.6
sand 8.4
park 8.2
teenager 8.2
girls 8.2
women 7.9
kick 7.8
attractive 7.7
clouds 7.6
dancer 7.6
relax 7.6
enjoying 7.6
movement 7.5
training 7.4
vacation 7.4
fit 7.4
cheerful 7.3
contestant 7.3
pose 7.2
suit 7.2
portrait 7.1
mountain 7.1
sports equipment 7.1
spring 7.1

Google
created on 2022-01-08

Photograph 94.2
Smile 90.6
Flash photography 88
People in nature 87.6
Sky 86.4
Gesture 85.3
Happy 84.5
Adaptation 79.2
People 78
Snapshot 74.3
Event 67.7
Stock photography 65.2
Landscape 64.7
Formal wear 64.1
Rectangle 63.5
Monochrome photography 60.4
Holding hands 59
Vintage clothing 56.4
Font 56.2
Fun 55.9

Microsoft
created on 2022-01-08

outdoor 98.8
person 94.4
cartoon 86.6
man 85.9
clothing 84
text 83
drawing 77.1
sketch 71.9
smile 55.8
posing 48.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 60.9%
Confused 20%
Sad 9.1%
Fear 3%
Angry 2.2%
Surprised 1.8%
Happy 1.8%
Disgusted 1.1%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Sad 76.5%
Angry 12.7%
Calm 6%
Fear 3.1%
Confused 1%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 49.5%
Sad 21.9%
Disgusted 14.4%
Angry 5.9%
Calm 3.3%
Confused 2.5%
Surprised 1.3%
Fear 1.2%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 56.9%

Captions

Microsoft

a group of people posing for a photo 89.5%
a group of people posing for the camera 89.4%
a group of people posing for a picture 89.3%

Text analysis

Amazon

ignore
GROX

Google

Geon
Geon