Human Generated Data

Title

Untitled (group portrait of boys basketball team and coach in gymnasium)

Date

1961

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11047

Human Generated Data

Title

Untitled (group portrait of boys basketball team and coach in gymnasium)

People

Artist: Claseman Studio, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Clothing 100
Shorts 100
Apparel 100
Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.5
Person 99.5
Person 99.4
Person 99.3
Person 98.3
Shoe 94.3
Footwear 94.3
Person 92.9
Female 91.8
Accessories 91.1
Accessory 91.1
Tie 91.1
People 86.5
Person 82.1
Shoe 81.4
Shoe 77.3
Girl 74.6
Boy 74.2
Person 71.3
Child 68.8
Kid 68.8
Person 68.7
Woman 68.1
Crowd 65.6
Shoe 65.4
Person 64.4
Shoe 62.7
Sports 59.4
Sport 59.4
Face 58.4
Team 55.2
Skirt 55
Shoe 50.9

Clarifai
created on 2019-03-25

people 99.8
group together 99.2
man 97.2
many 96.4
adult 93.5
several 91.2
five 90.9
group 89.7
woman 85.4
athlete 83.8
monochrome 83.3
crowd 81.3
wear 80.6
four 77.1
school 76.9
indoors 76.4
retro 75.3
education 75.1
sports equipment 73.2
child 72.8

Imagga
created on 2019-03-25

sport 38.7
people 37.3
group 37
swimsuit 32.6
person 30.6
man 27.5
bathing cap 27.4
clothing 27.1
male 25.5
maillot 24.7
garment 24.1
men 24
silhouette 22.3
cap 21.1
crowd 20.1
women 19.8
team 19.7
player 19.1
adult 18.9
golfer 18.9
businessman 18.5
athlete 18.3
together 17.5
lifestyle 16.6
contestant 16.4
headdress 16.4
business 16.4
teamwork 14.8
couple 14.8
active 14.5
body 14.4
covering 14.1
swimming trunks 14
consumer goods 13.9
boy 13.9
happy 13.1
fun 12.7
exercise 12.7
fitness 12.6
art 12
sea 11.7
runner 11.5
vacation 11.4
water 11.3
friends 11.3
human 11.2
friendship 11.2
brass 11.2
outdoors 11.2
portrait 11
work 11
competition 11
beach 10.9
black 10.8
ball 10.6
professional 10.5
attractive 10.5
company 10.2
model 10.1
pose 10
dress 9.9
recreation 9.8
silhouettes 9.7
success 9.6
running 9.6
happiness 9.4
pretty 9.1
fashion 9
health 9
summer 9
sky 8.9
sexy 8.8
healthy 8.8
graphic 8.7
run 8.7
wind instrument 8.6
walking 8.5
outline 8.5
youth 8.5
ocean 8.4
action 8.3
leisure 8.3
teenager 8.2
girls 8.2
style 8.1
family 8
job 8
smiling 8
party 7.7
casual 7.6
trombone 7.6
meeting 7.5
design 7.3
businesswoman 7.3
worker 7.2
dance 7.2
suit 7.2
sunset 7.2
shadow 7.2
activity 7.2
smile 7.1
modern 7

Google
created on 2019-03-25

Team 95.9
Team sport 82
Sports 61.9

Microsoft
created on 2019-03-25

posing 97.5
person 93.3
standing 81.5
group 74
white 71.4
player 61.7
old 61.1
team 55.7
basketball 55.7
boy 21.5
girl 9.6

Face analysis

Amazon

AWS Rekognition

Age 19-36
Gender Male, 54.7%
Happy 45.2%
Sad 45.9%
Surprised 45.2%
Disgusted 45.1%
Angry 45.2%
Calm 53.3%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Happy 45.7%
Calm 50.4%
Confused 45.3%
Sad 47.1%
Disgusted 45.2%
Surprised 45.4%
Angry 45.8%

AWS Rekognition

Age 35-53
Gender Male, 54.6%
Surprised 45.3%
Confused 45.1%
Calm 50.8%
Disgusted 46.1%
Angry 45.3%
Happy 46.4%
Sad 45.9%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Sad 48.8%
Confused 45.1%
Disgusted 45.2%
Calm 50.1%
Happy 45.4%
Angry 45.2%
Surprised 45.2%

AWS Rekognition

Age 16-27
Gender Male, 53.8%
Surprised 45.1%
Angry 45.1%
Disgusted 45.1%
Happy 45.1%
Sad 46.4%
Confused 45.1%
Calm 53.1%

AWS Rekognition

Age 20-38
Gender Male, 54.8%
Sad 46.8%
Surprised 45.1%
Calm 52.7%
Confused 45.1%
Happy 45.1%
Disgusted 45%
Angry 45.2%

AWS Rekognition

Age 20-38
Gender Male, 54.8%
Sad 50.6%
Happy 45.7%
Confused 45.3%
Surprised 45.3%
Disgusted 45.3%
Calm 47.4%
Angry 45.6%

AWS Rekognition

Age 27-44
Gender Male, 54.9%
Happy 45.3%
Sad 45.3%
Confused 45.2%
Angry 45.2%
Disgusted 45.1%
Calm 53.5%
Surprised 45.4%

AWS Rekognition

Age 26-43
Gender Male, 55%
Angry 45.6%
Sad 48%
Surprised 45.5%
Confused 45.4%
Calm 49.7%
Happy 45.5%
Disgusted 45.3%

AWS Rekognition

Age 12-22
Gender Male, 52.7%
Happy 45.2%
Disgusted 45.1%
Confused 45.3%
Surprised 45.2%
Calm 50.6%
Sad 48.3%
Angry 45.2%

AWS Rekognition

Age 19-36
Gender Male, 54.1%
Surprised 45.1%
Angry 45.1%
Disgusted 45%
Calm 45.9%
Sad 53.7%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 26-43
Gender Male, 54.9%
Calm 53%
Sad 45.4%
Surprised 45.1%
Confused 45.1%
Happy 46%
Angry 45.2%
Disgusted 45.1%

AWS Rekognition

Age 12-22
Gender Female, 50.4%
Happy 45.4%
Calm 45.7%
Angry 45.2%
Disgusted 45.1%
Confused 45.2%
Surprised 45.2%
Sad 53.3%

Feature analysis

Amazon

Person 99.8%
Shoe 94.3%
Tie 91.1%

Captions

Microsoft

a group of people posing for a photo 96%
a group of people posing for a picture 95.9%
a group of people posing for the camera 95.8%

Text analysis

Amazon

32
34
40
S2 40
S2
4
SO 32
S
D
SO

Google

SO32
S3
40
34 SO32 S3 40
34