Human Generated Data

Title

Untitled (portrait of basketball team in front of mural)
Date

1947
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13306

Human Generated Data

Title

Untitled (portrait of basketball team in front of mural)

People

Artist: Harry Annas, American 1897 - 1980

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99.4
Person 99.3
Person 98.6
Person 98.3
Person 97.6
Person 95.5
Person 95.3
Apparel 94.8
Clothing 94.8
People 93.8
Person 91.9
Person 91.8
Person 90.7
Shorts 89.4
Person 88.8
Person 86.8
Accessories 86.2
Accessory 86.2
Tie 86.2
Person 84.2
Sports 79.5
Sport 79.5
Person 78.9
Face 78.5
Boy 77.2
Team 72.5
Person 71.4
Costume 70.4
Person 70
Person 69.9
Team Sport 65.3
Female 64.4
Crowd 61.2
Volleyball 59.8
Food 58.2
Meal 58.2
Person 53.1

Imagga
created on 2022-01-23

ball 66.5
basketball 57
basketball equipment 40.4
player 36.3
game equipment 36.1
equipment 33.2
sport 33.1
sports equipment 32
person 32
man 31.7
athlete 29.3
male 29.1
people 27.8
adult 25.4
black 19.8
team 19.7
ballplayer 19
fitness 18.9
competition 18.3
fun 17.9
game 17.8
men 17.1
group 16.9
active 16.6
hand 15.9
exercise 15.4
backboard 15.1
boy 14.8
play 14.6
playing 14.6
lifestyle 14.4
football 14.4
action 13.9
portrait 13.6
contestant 13.4
leisure 12.4
clothing 12.4
couple 12.2
soccer 11.5
healthy 11.3
happy 11.3
attractive 11.2
youth 11.1
smiling 10.8
human 10.5
outdoors 10.4
gymnasium 10.4
casual 10.2
dark 10
health 9.7
businessman 9.7
one 9.7
goal 9.6
athletic 9.6
athletic facility 9.3
recreation 8.9
student 8.9
tennis 8.8
women 8.7
education 8.6
face 8.5
two 8.5
event 8.3
silhouette 8.3
girls 8.2
pose 8.1
posing 8
grass 7.9
business 7.9
together 7.9
nightlife 7.8
standing 7.8
court 7.8
model 7.8
kin 7.6
energy 7.6
field 7.5
holding 7.4
sports 7.4
training 7.4
teen 7.3
20s 7.3
body 7.2
world 7.1
facility 7
modern 7

Google
created on 2022-01-23

Sports uniform 96.3
Style 83.9
Jersey 80.1
Player 79.7
Font 78.5
Crew 76.5
Team sport 74
Team 74
Musical instrument 73.7
Monochrome photography 73.2
Monochrome 73.1
T-shirt 72.3
Suit 70.9
Sports 67.9
Uniform 67.7
Event 67.1
Guitar 65.5
Tournament 64.8
Music 62
Room 61.4

Microsoft
created on 2022-01-23

posing 100
person 99.5
group 99.3
wall 96.8
text 96.5
clothing 94.4
hockey 93.4
indoor 90.4
team 89.6
standing 84
sports uniform 83.5
sports equipment 81.3
man 76.1
bunch 40.6
lined 23

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 72.2%
Angry 10%
Calm 8.9%
Confused 3.2%
Disgusted 2.7%
Fear 1.1%
Sad 1%
Surprised 0.9%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 98.2%
Angry 0.7%
Happy 0.4%
Confused 0.2%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 95.8%
Happy 1.4%
Confused 1%
Angry 0.5%
Sad 0.5%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 97.7%
Angry 0.8%
Confused 0.6%
Sad 0.4%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Happy 96.8%
Angry 1.2%
Calm 0.6%
Disgusted 0.4%
Surprised 0.4%
Confused 0.2%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 19-27
Gender Male, 91.3%
Calm 99.9%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%
Sad 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.4%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 64.4%
Angry 26.4%
Happy 5.1%
Disgusted 1.5%
Confused 1.1%
Surprised 0.9%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 52.6%
Confused 19.7%
Surprised 12.6%
Happy 9.7%
Fear 2.6%
Angry 1.5%
Disgusted 0.9%
Sad 0.5%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 92.4%
Angry 2.2%
Confused 2.2%
Sad 0.9%
Happy 0.8%
Disgusted 0.6%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 78.2%
Happy 6.8%
Angry 5.5%
Surprised 3.9%
Disgusted 3.6%
Confused 1%
Sad 0.6%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 53.4%
Calm 41.8%
Surprised 1.6%
Fear 0.7%
Angry 0.7%
Confused 0.7%
Disgusted 0.6%
Sad 0.5%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 99.1%
Happy 0.3%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 98.3%
Calm 58.2%
Sad 34.4%
Fear 1.9%
Happy 1.6%
Confused 1.4%
Angry 1.4%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 16-22
Gender Male, 99.8%
Calm 44.8%
Surprised 23.4%
Happy 13.9%
Confused 5.8%
Fear 4.1%
Angry 3.6%
Disgusted 2.4%
Sad 1.9%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 89.1%
Confused 3.6%
Sad 2.1%
Angry 2%
Fear 1.2%
Happy 0.8%
Surprised 0.7%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Angry 49.6%
Calm 13.4%
Surprised 12.6%
Fear 11.3%
Confused 5.6%
Happy 5.6%
Disgusted 1.1%
Sad 0.9%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 80.3%
Angry 7.6%
Disgusted 5.1%
Happy 3.7%
Confused 1.2%
Sad 0.9%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Male, 97.8%
Calm 71.2%
Fear 14.9%
Happy 4.1%
Surprised 3.3%
Disgusted 3%
Sad 1.4%
Angry 1.3%
Confused 0.7%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 26
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 24
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 86.2%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people posing for the camera 98.2%
a group of people posing for a picture 98.1%

Text analysis

Amazon

10
9
5
12
6
7
11
4
13
8
Б
3

Google

1310
11
1310 1i 4 11 10 7 3 6 12 ....... ...... 00 LA
4
12
10
7
00
1i
3
6
.......
......
LA