Human Generated Data

Title

Untitled (Jean Pearson at CBS Studios)

Date

1949

People

Artist: W. Eugene Smith, American 1918 - 1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, P2002.52

Human Generated Data

Title

Untitled (Jean Pearson at CBS Studios)

People

Artist: W. Eugene Smith, American 1918 - 1978

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Neal and Susan Yanofsky, P2002.52

Machine Generated Data

Tags

Amazon
created on 2022-05-27

Person 99.5
Human 99.5
Person 99.1
Tripod 98.7
Person 98.1
Person 92.8
Lighting 90.1
Studio 58.8
Interior Design 57.6
Indoors 57.6

Clarifai
created on 2023-10-30

people 99.9
group 98.8
adult 98.3
movie 97.9
two 96.9
group together 96.6
music 96.6
three 96.2
man 96
woman 94.2
musician 93.9
five 91.3
singer 91.2
stage 90.7
four 90.4
portrait 90.1
instrument 89.4
band 88.9
theater 87.8
microphone 87.7

Imagga
created on 2022-05-27

building 21
world 20.7
architecture 18.7
city 18.3
hall 15.4
man 14.8
equipment 14.6
people 14.5
silhouette 14.1
urban 14
industry 13.7
light 13.4
television camera 12.9
construction 12.8
industrial 12.7
factory 11.6
sky 11.5
old 11.1
stage 11.1
black 10.8
night 10.6
television equipment 10.3
music 9.9
business 9.7
metal 9.6
work 9.4
person 9.4
male 9.2
dark 9.2
travel 9.1
musician 9.1
shadow 9
passenger 8.9
room 8.7
high 8.7
entertainment 8.3
inside 8.3
street 8.3
to 8
lamp 7.9
structure 7.8
ancient 7.8
center 7.8
electronic equipment 7.7
men 7.7
energy 7.6
club 7.5
adult 7.5
smoke 7.4
lighting 7.4
window 7.3

Google
created on 2022-05-27

Microsoft
created on 2022-05-27

person 98.6
clothing 98.3
man 96
human face 94.7
black and white 85.5
people 64.7
group 55.5
old 43.2
posing 39.1
crowd 1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Female, 99.9%
Calm 91.5%
Surprised 6.7%
Fear 6%
Happy 5.3%
Sad 2.2%
Confused 1.4%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 39.6%
Confused 17.9%
Happy 16.3%
Surprised 8.4%
Disgusted 7.8%
Fear 6.9%
Sad 6.5%
Angry 4.1%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 41-49
Gender Male, 97.6%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Happy 0%
Angry 0%
Confused 0%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Text analysis

Amazon

CBS

Google

11 CBS CBS
11
CBS