Human Generated Data

Title

Untitled (young boys boxing in ring)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7022

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young boys boxing in ring)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.5
Person 99.1
Person 98.9
Person 98.3
Person 98.1
Person 98.1
Person 91.3
Sport 91
Sports 91
Person 90.6
Judo 70.4
Martial Arts 70.4
Outdoors 62.2
Duel 61.7
Photography 61.1
Portrait 61.1
Face 61.1
Photo 61.1
Apparel 59.4
Shoe 59.4
Clothing 59.4
Footwear 59.4
Leisure Activities 58.5
Fencing 57.8

Imagga
created on 2021-12-15

sport 39.6
dancer 36.7
person 33.9
sword 33.8
athlete 31.5
people 27.9
man 26.9
weapon 26.9
active 24.3
fitness 22.6
lifestyle 22.4
action 22.3
performer 22.2
player 21.9
exercise 21.8
male 21.3
skateboard 20.9
sports equipment 19.5
skate 19.2
jump 19.2
adult 18.3
happiness 18
fun 18
outdoor 17.6
outdoors 17.2
wheeled vehicle 16.8
motion 16.3
board 16.2
happy 15.7
equipment 15.6
teenager 15.5
jumping 15.5
entertainer 15.3
leisure 15
summer 14.8
competition 14.6
freedom 14.6
dance 14.6
ball 14.3
vehicle 13.8
one 13.4
training 12.9
sky 12.8
grass 12.7
activity 12.5
body 12
playing 11.9
field 11.7
joy 11.7
ballplayer 11.2
play 11.2
attractive 11.2
youth 11.1
air 11
against 11
healthy 10.7
vacation 10.6
fashion 10.6
boy 10.4
park 9.9
stadium 9.7
health 9.7
fight 9.7
match 9.7
skill 9.6
cricket bat 9.5
men 9.5
legs 9.4
fly 9.3
relaxation 9.2
human 9
cheerful 8.9
style 8.9
posing 8.9
cool 8.9
flag 8.7
contestant 8.7
muscular 8.6
model 8.6
cricket equipment 8.5
enjoyment 8.4
conveyance 8.4
event 8.3
pose 8.2
recreation 8.1
punch 7.9
day 7.8
couple 7.8
cheering 7.8
shorts 7.8
nighttime 7.8
life 7.8
black 7.8
audience 7.8
gloves 7.8
run 7.7
dancing 7.7
outside 7.7
crowd 7.7
patriotic 7.7
athletic 7.7
block 7.6
casual 7.6
dangerous 7.6
balance 7.6
nation 7.6
energy 7.6
gymnastic apparatus 7.5
movement 7.5
basketball 7.5
trampoline 7.5
guy 7.5
silhouette 7.5
lights 7.4
street 7.4
teen 7.4
alone 7.3
sun 7.2
success 7.2
color 7.2
game 7.1
icon 7.1
portrait 7.1
face 7.1
love 7.1
spring 7.1

Google
created on 2021-12-15

Trousers 96.3
Black 89.7
Tree 87.9
Window 87
Black-and-white 85.6
Gesture 85.3
Style 84
Plant 79.5
Adaptation 79.4
Tints and shades 77
Monochrome photography 75.2
Art 75.1
Monochrome 74.9
Suit 72.5
Event 72.3
Happy 72.1
Room 71
Vintage clothing 68.8
Font 67.2
Fun 66.2

Microsoft
created on 2021-12-15

outdoor 92.5
text 88.6
sport 79.5
wedding 79.2
dance 75.6
dancer 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Female, 93.2%
Calm 79.3%
Happy 19.3%
Sad 1.3%
Angry 0.1%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 37-55
Gender Male, 68.8%
Calm 92.5%
Happy 4%
Angry 1.5%
Disgusted 1.4%
Sad 0.3%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 46-64
Gender Female, 69.8%
Calm 88.9%
Sad 6.7%
Happy 2.4%
Fear 0.9%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 50-68
Gender Female, 82.4%
Calm 87.2%
Surprised 4.1%
Sad 3.8%
Happy 2.2%
Angry 1.3%
Confused 0.7%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 39-57
Gender Female, 80.5%
Calm 63.4%
Sad 30.2%
Fear 2.7%
Happy 1.7%
Angry 0.8%
Surprised 0.6%
Confused 0.4%
Disgusted 0.2%

AWS Rekognition

Age 32-48
Gender Male, 92.7%
Calm 76.3%
Fear 7.9%
Happy 5.4%
Sad 3.8%
Angry 2.8%
Surprised 2.4%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 23-37
Gender Male, 76.1%
Calm 42.9%
Sad 41.7%
Surprised 9.2%
Angry 1.9%
Confused 1.8%
Fear 1.4%
Disgusted 0.6%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 59.4%

Captions

Microsoft

a group of baseball players standing on top of a field 39.3%
a group of people on a baseball field 39.2%
a group of baseball players on a field 39.1%

Text analysis

Amazon

22413
ACE
NY
:OTHER

Google

22413 GAP RER ACE
22413
ACE
GAP
RER