Human Generated Data

Title

Untitled (family playing pool)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16089

Human Generated Data

Title

Untitled (family playing pool)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Furniture 99.9
Room 99.7
Indoors 99.7
Human 99.7
Person 99.7
Person 99.6
Table 99.5
Person 99.5
Person 99.4
Person 99.1
Pool Table 95.9
Billiard Room 95.9
Sphere 68.8

Imagga
created on 2022-02-05

table 100
pool table 100
game equipment 100
furniture 87.8
equipment 85
furnishing 59.3
ball 40.5
sport 39.7
game 34.7
play 33.6
fun 31.4
competition 29.2
recreation 28.6
golf 22.9
man 22.8
playing 22.8
club 22.6
hobby 20.8
course 20
male 19.1
people 18.9
entertainment 18.4
player 18.3
leisure 18.2
grass 17.4
adult 16.8
pool 16.3
black 15.6
action 14.8
cue 14.8
golfing 14.6
challenge 14.5
activity 14.3
golfer 14
billiard 13.8
active 13.7
person 13.5
one 13.4
outdoors 13.4
number 13
success 12.9
eight 12.8
contest 12.8
happy 12.5
men 12
outside 12
snooker 11.8
gamble 11.7
outdoor 11.4
colorful 11.4
couple 11.3
group 11.3
sphere 11
putt 10.8
tee 10.7
gambling 10.7
concentration 10.6
recreational 10.6
balls 10.5
hole 10.5
friends 10.3
lifestyle 10.1
exercise 10
fairway 9.8
arrangement 9.6
round 9.5
senior 9.4
striped 9.4
set 9.3
pool balls 8.9
billiard balls 8.9
eleven 8.9
nine 8.8
seven 8.8
orb 8.8
beginning 8.8
gradient 8.5
summer 8.3
healthy 8.2
object 8
graphic 8
smiling 7.9
billiards 7.9
shiny 7.9
putter 7.9
drive 7.6
lawn 7.5
relaxation 7.5
enjoyment 7.5
park 7.4
business 7.3
color 7.2
team 7.2
smile 7.1
to 7.1
happiness 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

indoor 97
person 96.2
man 55.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-24
Gender Female, 93%
Sad 99.1%
Calm 0.7%
Confused 0.1%
Angry 0%
Fear 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Female, 100%
Happy 54%
Confused 32.1%
Sad 4.9%
Calm 3.5%
Angry 2.6%
Surprised 1.4%
Fear 1.1%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 57.9%
Sad 39.4%
Angry 1.6%
Confused 0.6%
Happy 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Calm 60.4%
Sad 22.4%
Confused 5.8%
Angry 3.6%
Disgusted 2.3%
Happy 2.3%
Surprised 2%
Fear 1.3%

AWS Rekognition

Age 21-29
Gender Male, 96.1%
Calm 97.2%
Fear 0.7%
Confused 0.6%
Surprised 0.5%
Disgusted 0.4%
Sad 0.4%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Fear 94.6%
Sad 3.8%
Calm 0.6%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people sitting on a stage 89.9%
a group of people on a stage 89.8%
a group of people standing on a stage 89.7%

Text analysis

Amazon

2
11