Human Generated Data

Title

Untitled (Cardinal's baseball player Stan Musial in baseball uniform, choosing bat)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15994.3

Human Generated Data

Title

Untitled (Cardinal's baseball player Stan Musial in baseball uniform, choosing bat)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.3
Human 99.3
Clothing 99.1
Apparel 99.1
Person 98.9
Person 98.2
Person 95.3
People 90.7
Person 90.6
Person 88.7
Musical Instrument 75.7
Musician 75.7
Pants 69.4
Outdoors 68.6
Shoe 65.2
Footwear 65.2
Leisure Activities 63.6
Team 63.1
Team Sport 63.1
Sport 63.1
Sports 63.1
Advertisement 61
Sitting 58.5
Nature 58.5
Poster 58.2
Text 58.1
Skin 57.7
Door 56
Collage 55.4

Imagga
created on 2022-02-05

blackboard 23.9
man 18.1
silhouette 17.4
shop 16.7
male 16.3
people 15.6
newspaper 14.8
black 13.8
person 13.4
hand 12.9
business 12.1
equipment 11.8
party 11.2
mercantile establishment 11
product 10.7
adult 10.4
film 10.3
event 10.2
symbol 10.1
window 10
barbershop 9.7
creation 9.5
grunge 9.4
finance 9.3
salon 9.2
design 9
human 9
financial 8.9
art 8.7
men 8.6
negative 8.5
music 8.1
night 8
drawing 7.9
travel 7.7
modern 7.7
billboard 7.7
daily 7.7
house 7.5
world 7.5
map 7.5
place of business 7.3
light 7.3
letter 7.3
global 7.3
working 7.1
businessman 7.1
conceptual 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

person 99.8
text 99.1
clothing 95.1
outdoor 92.5
book 90.4
window 89
man 84.8
group 70.3
baseball 63.6
people 62.4
hockey 59.1
clothes 15.7

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 74.7%
Calm 99.4%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 92.3%
Sad 82.6%
Calm 11.1%
Disgusted 2.6%
Confused 2.4%
Happy 0.5%
Angry 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 27-37
Gender Male, 95.7%
Calm 99%
Sad 0.4%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people posing for a photo 83.2%
a group of people sitting posing for the camera 83.1%
a group of people posing for the camera 83%

Text analysis

Amazon

inal
Canats
Ventimate
PAK

Google

inals
in
inals inal var in
var
inal