Human Generated Data

Title

Untitled (boys basketball team)

Date

c. 1975

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1389

Human Generated Data

Title

Untitled (boys basketball team)

People

Artist: Ken Whitmire Associates, American

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 99.5
Person 99.2
Person 99.1
Person 99
Person 99
Person 99
Person 99
Person 98.1
Person 98.1
Person 98
Person 97.6
Person 96.9
Clothing 96.2
Apparel 96.2
Shorts 95.4
Person 94.6
People 92.2
Person 92
Person 90.9
Person 85.9
Boy 84
Overcoat 79.5
Coat 79.5
Suit 79.5
Person 67.9
Team 67.7
Team Sport 60.8
Sport 60.8
Sports 60.8
Child 60
Kid 60
Indoors 58.7
Room 58.3
Person 46.2

Imagga
created on 2022-01-22

basketball 100
basketball equipment 100
ball 100
game equipment 81.7
sports equipment 76.8
equipment 59.3
man 38.3
male 28.4
people 27.9
team 27.7
sport 24.8
adult 22.7
group 22.5
backboard 21.8
person 21.4
player 20.9
athlete 19.8
competition 18.3
business 18.2
happy 18.2
smiling 18.1
businessman 17.6
men 17.2
fitness 17.2
exercise 16.3
active 16.2
lifestyle 15.9
professional 15.4
fun 15
boy 14.8
standing 14.8
game 14.3
net 14.2
action 13.9
health 13.9
student 13.9
tennis 13.6
smile 13.5
healthy 13.2
classroom 12.8
court 12.7
school 12.6
recreation 12.5
leisure 12.4
education 12.1
teamwork 12
outdoors 11.9
child 11.9
businesswoman 11.8
play 11.2
nurse 11.1
youth 11.1
holding 10.7
hand 10.6
room 10.6
together 10.5
uniform 10.4
portrait 10.3
women 10.3
playing 10
confident 10
success 9.6
jump 9.6
outside 9.4
friends 9.4
20s 9.2
worker 8.9
couple 8.7
winner 8.6
work 8.6
athletic 8.6
confidence 8.6
occupation 8.2
girls 8.2
teacher 8.1
office 8
home 8
medicine 7.9
indoors 7.9
tournament 7.8
match 7.7
diversity 7.7
two 7.6
meeting 7.5
doctor 7.5
training 7.4
positive 7.4
fit 7.4
inside 7.4
indoor 7.3
volleyball 7.2
building 7.2
looking 7.2
family 7.1
job 7.1
working 7.1
medical 7.1
happiness 7

Google
created on 2022-01-22

Shorts 92.8
Window 88
Style 83.9
Black-and-white 83.7
Sports uniform 78.2
Monochrome 78.2
Crew 77.7
Monochrome photography 74.8
Vintage clothing 73.6
Player 73.5
Font 73.4
T-shirt 72.7
Event 71.5
Picture frame 69.4
Team 68.6
Fun 68.3
Room 66.9
Ball 66.3
Uniform 65.8
Team sport 65

Microsoft
created on 2022-01-22

posing 99.1
basketball 96.1
clothing 92.4
text 91.5
group 91
person 86.3
footwear 81.3
black 80.2
boy 79.9
man 74.1
black and white 74

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Male, 91.2%
Calm 99.4%
Confused 0.4%
Surprised 0.1%
Sad 0%
Fear 0%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 99.6%
Happy 71.3%
Calm 19%
Confused 3%
Surprised 2%
Fear 1.7%
Angry 1.5%
Sad 1%
Disgusted 0.5%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Happy 99.4%
Calm 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 100%
Happy 99.6%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Calm 0%
Sad 0%

AWS Rekognition

Age 16-22
Gender Male, 89.4%
Calm 99.8%
Confused 0.1%
Angry 0%
Surprised 0%
Sad 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 99.1%
Confused 0.4%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 13-21
Gender Male, 99.9%
Happy 94.9%
Calm 2.3%
Surprised 1%
Angry 0.5%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Sad 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 99.6%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Happy 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Happy 91.9%
Confused 3.1%
Surprised 2.8%
Calm 0.7%
Disgusted 0.6%
Fear 0.4%
Angry 0.3%
Sad 0.1%

AWS Rekognition

Age 18-26
Gender Male, 62.2%
Happy 74.5%
Angry 12.3%
Calm 4.8%
Sad 3.3%
Confused 2.2%
Fear 1.3%
Surprised 0.9%
Disgusted 0.6%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.9%
Surprised 0%
Calm 0%
Angry 0%
Fear 0%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 16-22
Gender Male, 61%
Calm 99.3%
Sad 0.5%
Confused 0.2%
Angry 0%
Fear 0%
Happy 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 16-24
Gender Male, 88%
Calm 68.4%
Happy 24.1%
Confused 3.9%
Surprised 1.2%
Disgusted 1%
Fear 0.7%
Sad 0.4%
Angry 0.3%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Calm 100%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%
Sad 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 99.2%
Happy 93%
Confused 3.5%
Fear 1.3%
Disgusted 0.6%
Calm 0.6%
Surprised 0.4%
Sad 0.3%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Male, 86.7%
Fear 35.5%
Calm 33.8%
Sad 21.6%
Happy 2.5%
Surprised 2.4%
Confused 2.2%
Angry 1%
Disgusted 1%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Suit 79.5%

Captions

Microsoft

a group of people posing for a photo 98.3%
a group of people posing for a picture 98.2%
a group of people posing for the camera 98.1%

Text analysis

Amazon

32
50
52
42
34
10
40
12
22
20
44
30

Google

22
50
40
34
40 52 22 34 50 12
52
12