Human Generated Data

Title

Untitled (Richard E. Leakey and his father, Louis Leakey, studying the fossil skull of a monkey, Koobi Fora Camp, Lake Rudolf, Kenya)
Date

1970, printed later
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3805

Human Generated Data

Title

Untitled (Richard E. Leakey and his father, Louis Leakey, studying the fossil skull of a monkey, Koobi Fora Camp, Lake Rudolf, Kenya)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1970, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3805

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Person 99
Human 99
Senior Citizen 86.6
Finger 83.5
Glasses 82.5
Accessories 82.5
Accessory 82.5
Sitting 74.9
Man 60.6
Face 58.8

Clarifai
created on 2023-10-30

people 99.7
portrait 99.4
man 99
adult 98.8
elderly 98.7
one 95.2
street 93.6
two 90
elder 90
old 89.4
cigar 87.3
woman 86.2
smile 83.8
sit 81.4
facial expression 81
photojournalism 80.8
face 78.8
tattoo 78.4
guy 77.7
actor 76.2

Imagga
created on 2022-06-25

man 53.3
senior 49.7
male 42.6
grandfather 40.4
person 39.7
elderly 33.5
old 33.5
people 29.6
portrait 28.5
retired 28.1
grandma 26.4
mature 26
adult 24.8
retirement 22.1
home 20.8
face 20.6
sitting 19.8
glasses 17.6
happy 17.6
businessman 16.8
cadaver 15.9
indoors 15.8
couple 15.7
pensioner 15.7
smiling 15.2
hands 14.8
older 14.6
love 13.4
age 13.3
looking 12.8
business 12.8
grandmother 12.7
computer 12.1
expression 12
laptop 11.9
handsome 11.6
lifestyle 11.6
hand 11.4
father 11.2
work 11
aged 10.9
gray 10.8
husband 10.5
teacher 10.4
alone 10
worker 9.9
professional 9.7
working 9.7
wisdom 9.7
patient 9.7
office 9.6
reading 9.5
wife 9.5
one person 9.4
casual 9.3
smile 9.3
leisure 9.1
one 9
beard 8.9
executive 8.9
elder 8.9
70s 8.9
middle aged 8.8
men 8.6
serious 8.6
relaxed 8.5
holding 8.3
medical 8
together 7.9
pension 7.9
gavel 7.8
enjoying 7.6
shirt 7.5
occupation 7.3
lady 7.3
relaxing 7.3
color 7.2
active 7.2
hair 7.1
job 7.1
to 7.1

Google
created on 2022-06-25

Watch 98.3
Glasses 97.1
Hand 95.7
Arm 94.3
Flash photography 88.2
Vision care 87.2
Gesture 85.3
Eyewear 82
Adaptation 79.3
Clock 75.2
Event 73.9
Wrinkle 73.3
Happy 72.9
Fun 72.4
Wrist 71.2
Leisure 62.7
Stock photography 62
Photo caption 61.8
Thumb 60.4
Jewellery 56.2

Microsoft
created on 2022-06-25

person 99.8
man 98.2
watch 93.2
human face 89.9
glasses 60.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 63-73
Gender Male, 99.9%
Confused 51.8%
Calm 35.8%
Surprised 10.5%
Fear 6.4%
Sad 2.3%
Angry 2.3%
Disgusted 1.1%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Confused 41.9%
Fear 21.3%
Angry 11.9%
Sad 10.1%
Surprised 9.4%
Disgusted 3.9%
Calm 3.3%
Happy 0.6%

Microsoft Cognitive Services

Age 69
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Glasses 82.5%

Categories

Imagga

events parties 97.2%
people portraits 2.8%

Captions

Microsoft
created on 2022-06-25

a man smoking a cigarette 77.7%
a man taking a selfie 71.6%
a man talking on a cell phone 49.2%