Human Generated Data

Title

Untitled (Lions baseball team, portrait with coach and dog)

Date

c. 1965

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11234

Human Generated Data

Title

Untitled (Lions baseball team, portrait with coach and dog)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1965

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Person 99.4
Person 99.3
Person 99.2
Person 99.2
Person 98.9
Person 98.8
Person 98.5
Person 98.3
People 98.2
Person 98
Person 97.9
Athlete 97.8
Sport 97.8
Sports 97.8
Person 97.8
Person 97.5
Person 97.4
Person 97.1
Clothing 93.3
Apparel 93.3
Team 91.6
Ballplayer 91.6
Team Sport 91.6
Baseball 91.6
Softball 91.6
Person 90.6
Boy 77.3
Hat 62.2
Baseball Cap 62.2
Cap 62.2
Face 57.4
Person 49.6

Imagga
created on 2022-01-23

athlete 100
ballplayer 100
player 100
contestant 77.3
person 47
ball 29.1
man 27.5
sport 27.2
male 23.5
people 20
soccer ball 17.8
adult 16.8
boy 15.6
equipment 15.6
men 15.4
competition 14.6
active 14.4
team 13.4
game 13.4
child 13.3
black 13.2
fun 12.7
exercise 12.7
fitness 12.6
game equipment 12.2
play 12
portrait 11.6
holding 11.5
outdoors 11.2
action 11.1
business 10.9
lifestyle 10.8
outdoor 10.7
businessman 10.6
soccer 10.6
goal 10.6
football 10.6
uniform 10.4
success 9.6
run 9.6
grass 9.5
healthy 9.4
happy 9.4
youth 9.4
face 9.2
dark 9.2
backboard 9.1
body 8.8
kick 8.8
athletic 8.6
professional 8.4
attractive 8.4
field 8.4
sports 8.3
guy 8.3
playing 8.2
activity 8
drawing 7.7
grunge 7.7
power 7.5
head 7.5
human 7.5
teamwork 7.4
dress 7.2
music 7.2
day 7

Microsoft
created on 2022-01-23

person 99.9
posing 99.3
tree 99.2
outdoor 98.9
baseball 98.4
grass 98
clothing 95.6
team 89.2
group 88.3
text 84.6
boy 79.2
man 74.1
player 65.3
sports uniform 62.1
old 51.6
crowd 1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-18
Gender Male, 76%
Calm 99.9%
Sad 0%
Angry 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 4-12
Gender Male, 87.6%
Calm 98.6%
Happy 1%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 99.9%
Happy 99.7%
Confused 0.1%
Calm 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 9-17
Gender Male, 99.9%
Angry 61.4%
Confused 16.1%
Calm 10.8%
Sad 8.2%
Disgusted 1.6%
Surprised 1.1%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 9-17
Gender Male, 97.1%
Calm 100%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Happy 98.9%
Calm 0.6%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 7-17
Gender Male, 69.9%
Calm 52%
Happy 24.6%
Sad 15%
Surprised 2.6%
Angry 2.3%
Confused 1.9%
Fear 0.9%
Disgusted 0.7%

AWS Rekognition

Age 9-17
Gender Female, 98.1%
Calm 47.5%
Happy 46.1%
Surprised 1.8%
Sad 1.6%
Fear 0.8%
Confused 0.8%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 13-21
Gender Female, 75.8%
Calm 81.2%
Sad 13%
Angry 3.8%
Confused 1.4%
Happy 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99%
Calm 94.8%
Angry 2.8%
Confused 1.7%
Surprised 0.3%
Sad 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 99.4%
Happy 84.4%
Calm 9.4%
Angry 2.4%
Confused 2.3%
Disgusted 0.5%
Sad 0.4%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 99.8%
Angry 53.9%
Sad 26.4%
Calm 6%
Confused 5.9%
Disgusted 3.9%
Happy 1.7%
Fear 1.2%
Surprised 1.1%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Happy 99.4%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Calm 0.1%
Fear 0%

AWS Rekognition

Age 9-17
Gender Male, 100%
Happy 98.6%
Calm 0.7%
Confused 0.5%
Surprised 0.1%
Disgusted 0.1%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 100%
Calm 98%
Happy 1.4%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

Nick Venet et al. posing for a photo 97.7%
a group of baseball players posing for a photo 92.1%
a group of baseball players that are posing for a photo 87.4%

Text analysis

Amazon

NS
N
7
Ns
LI
0
ONS
0 Ns
0 N
N S
1
S
O N
ي
ر
S n
n
L1
O
s
,
N2

Google

ONS
YOAS ONS O Ns
O
YOAS
Ns