Human Generated Data

Title

Untitled (members of "Browns" team in locker room)

Date

1947

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14296

Human Generated Data

Title

Untitled (members of "Browns" team in locker room)

People

Artist: Jack Gould, American

Date

1947

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.7
Human 99.7
Person 99.6
Person 99.5
Person 99.1
Person 99.1
Person 99.1
Apparel 98.4
Clothing 98.4
Person 95.4
Person 95.3
Shorts 95.1
Person 92.2
Female 88.9
People 88
Face 86
Crowd 82.9
Outdoors 80.6
Sailor Suit 72.8
Girl 70.2
Nature 69.5
Audience 67.8
Cap 65.6
Hat 65.6
Woman 63.1
Child 62.1
Kid 62.1
Photography 58.9
Portrait 58.9
Photo 58.9
Countryside 57.9
Sphere 57.9
Boy 57.7
Sports 57.2
Sport 57.2
Jaw 55.6
Team 55.5

Imagga
created on 2022-01-29

bathing cap 84.8
cap 67.3
headdress 55.1
clothing 40.8
brass 38.9
trombone 30.8
wind instrument 29.5
people 26.7
man 24.2
person 24
male 22
covering 20.1
musical instrument 19.7
consumer goods 19.6
adult 18.2
lifestyle 18
portrait 16.8
fashion 16.6
black 16.2
sexy 15.2
model 14.8
attractive 14
men 13.7
group 13.7
body 13.6
women 13.4
silhouette 13.2
together 12.3
couple 12.2
human 12
fun 12
sport 11.8
happiness 11.7
dress 11.7
crowd 11.5
happy 11.3
pretty 11.2
face 9.9
outdoor 9.9
friendship 9.4
stage 9.3
dark 9.2
athlete 9.1
music 8.9
dance 8.8
nightclub 8.8
looking 8.8
smiling 8.7
love 8.7
art 8.6
club 8.5
hand 8.3
joy 8.3
event 8.3
sensual 8.2
team 8.1
cool 8
nightlife 7.8
party 7.7
dancing 7.7
outside 7.7
ball 7.6
show 7.6
healthy 7.5
outdoors 7.5
style 7.4
design 7.3
active 7.3
exercise 7.3
gorgeous 7.2
summer 7.1
planner 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 100
posing 99.3
text 99.2
clothing 94
group 93.3
standing 93.3
man 89.6
sports uniform 75.5
player 71.8
team 70.1
baseball 65.9
basketball 61.1
sports equipment 58.8
old 44.5
female 33.6

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Sad 30.6%
Happy 20.6%
Surprised 20.1%
Confused 12.4%
Calm 7.9%
Angry 3.6%
Disgusted 3.2%
Fear 1.7%

AWS Rekognition

Age 52-60
Gender Male, 97.6%
Sad 53.4%
Happy 22.6%
Confused 9.4%
Surprised 6.3%
Calm 3.2%
Fear 2.3%
Angry 1.5%
Disgusted 1.3%

AWS Rekognition

Age 50-58
Gender Male, 97.7%
Confused 47.8%
Happy 27.5%
Calm 7.5%
Surprised 6.5%
Sad 4.1%
Disgusted 3.1%
Angry 3%
Fear 0.6%

AWS Rekognition

Age 47-53
Gender Male, 98.9%
Sad 59.7%
Happy 16%
Surprised 6.3%
Angry 5.3%
Fear 4.6%
Confused 3.7%
Disgusted 3.1%
Calm 1.3%

AWS Rekognition

Age 47-53
Gender Male, 96.3%
Happy 39.3%
Surprised 24.9%
Angry 15%
Calm 9.9%
Fear 5.4%
Disgusted 2.2%
Confused 1.7%
Sad 1.5%

AWS Rekognition

Age 43-51
Gender Male, 99.2%
Sad 43.4%
Disgusted 32.6%
Angry 10.1%
Surprised 7.1%
Fear 2.6%
Happy 2.4%
Confused 0.9%
Calm 0.9%

AWS Rekognition

Age 34-42
Gender Male, 88.7%
Happy 59.9%
Surprised 14.3%
Sad 8.8%
Calm 5.3%
Confused 4.7%
Angry 2.4%
Fear 2.4%
Disgusted 2.3%

AWS Rekognition

Age 43-51
Gender Female, 74.4%
Calm 64.7%
Sad 23.6%
Happy 5.7%
Confused 2.2%
Disgusted 1.2%
Surprised 1%
Angry 1%
Fear 0.6%

AWS Rekognition

Age 31-41
Gender Male, 95.2%
Confused 64.8%
Calm 13.7%
Sad 13.1%
Happy 3%
Disgusted 2.5%
Angry 1.3%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 45-53
Gender Male, 95.6%
Happy 88.4%
Calm 5.3%
Surprised 3.6%
Angry 1.3%
Sad 0.6%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 59.3%
Sad 48.8%
Happy 18.2%
Calm 11.3%
Surprised 8.2%
Confused 6.9%
Disgusted 3%
Angry 2.2%
Fear 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 97.9%
a group of people posing for the camera 97.8%
a group of people posing for a picture 97.7%

Text analysis

Amazon

BRO
BRO WNS
WNS
e
RO WNS
MJIR
RO
B
SNM
adidas
YT37A2
MJIR YT37A2 AREA
AREA

Google

RO
WNS
MJ17
YT33A2
NS
BRO
ARA
WNS RO RO WNS NS BRO MJ17 YT33A2 ARA