Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries and Presidential palace)

Date

c. 1955, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12251

Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries and Presidential palace)

People

Artist: Lester Cole, American

Date

c. 1955, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12251

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Collage 99.3
Advertisement 99.3
Person 99.2
Human 99.2
Person 98
Person 96.8
Person 96.5
Person 96.5
Person 96
Person 95.7
Person 92.9
Person 92.5
Person 92.4
Person 91.6
Person 89.9
Person 89.4
Person 86.6
Person 83.8
Person 80.9
Shelf 80.3
Machine 78.7
Person 76.7
Person 63.6
Head 60
Text 56
Poster 54.7
Person 48

Clarifai
created on 2023-10-22

people 98.9
stock 97.7
shelf 97.3
street 96.7
wear 96.3
fashion 95.3
monochrome 94.3
commerce 93.8
cabinet 93.2
man 92.7
group 92.6
portrait 92.1
graffiti 91.4
shopping 91.3
woman 91
many 89.3
indoors 88.9
city 88.8
travel 88.6
music 88.6

Imagga
created on 2022-02-25

case 89.8
locker 73.9
fastener 59.2
restraint 44.5
device 29.4
architecture 27.3
door 25.4
old 23
building 21.7
window 17.6
religion 16.1
history 15.2
house 14.2
city 14.1
texture 13.9
ancient 13.8
wall 13.7
art 13.7
urban 13.1
church 12.9
entrance 12.5
religious 12.2
detail 12.1
shop 11.8
glass 11.7
interior 11.5
design 11.2
culture 11.1
vintage 10.7
cathedral 10.6
travel 10.5
antique 10.4
pattern 10.2
historic 10.1
wood 10
business 9.7
colorful 9.3
style 8.9
market 8.9
decoration 8.7
construction 8.5
traditional 8.3
metal 8
structure 8
wooden 7.9
architectural 7.7
historical 7.5
sign 7.5
china 7.5
security 7.3
aged 7.2
home 7.2
indoors 7
modern 7

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

poster 94.8
cartoon 94
person 88.4
text 85.1
clothing 84
furniture 83.1
bunch 79.5
art 77.3
different 63.9
drawing 53.3
several 23.3
line 19.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 98.3%
Calm 94.5%
Happy 3%
Angry 0.7%
Surprised 0.7%
Confused 0.4%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Male, 94.4%
Calm 98.2%
Sad 0.8%
Angry 0.2%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Calm 97.5%
Sad 1.3%
Confused 0.7%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 41.2%
Surprised 18.4%
Angry 14.8%
Disgusted 9.2%
Confused 7.3%
Sad 4.3%
Fear 3.8%
Happy 1.1%

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Calm 81.1%
Sad 7%
Happy 3.7%
Disgusted 2.9%
Confused 1.9%
Angry 1.6%
Surprised 1.1%
Fear 0.7%

AWS Rekognition

Age 31-41
Gender Male, 75.5%
Happy 80.7%
Calm 14.3%
Sad 1.8%
Fear 1%
Angry 0.8%
Surprised 0.6%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 96.7%
Confused 1.4%
Sad 0.9%
Disgusted 0.5%
Angry 0.3%
Surprised 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 70.5%
Sad 13.9%
Confused 7.5%
Angry 3.5%
Disgusted 2.3%
Surprised 1.2%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 29.7%
Angry 28%
Happy 15.4%
Sad 15%
Fear 5.8%
Disgusted 2.5%
Surprised 2.3%
Confused 1.3%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 66.6%
Angry 7.5%
Sad 7.3%
Confused 4.9%
Disgusted 4.6%
Fear 4.5%
Surprised 3.4%
Happy 1.3%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 82.6%
Sad 5.8%
Confused 3.9%
Surprised 2.4%
Angry 1.8%
Disgusted 1.4%
Fear 1.2%
Happy 0.9%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 94.9%
Angry 3.1%
Happy 0.7%
Confused 0.4%
Sad 0.3%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 87.4%
Confused 9.6%
Sad 1.6%
Fear 0.6%
Angry 0.4%
Surprised 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 16-24
Gender Female, 53.9%
Confused 57.8%
Calm 21.6%
Sad 14.9%
Angry 3.1%
Disgusted 1.2%
Surprised 0.9%
Fear 0.3%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98.9%
Calm 86.1%
Confused 7.3%
Surprised 3.6%
Sad 1.4%
Angry 0.5%
Fear 0.5%
Happy 0.3%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 42.6%
Sad 28.9%
Fear 19.2%
Angry 3%
Confused 2.2%
Disgusted 1.7%
Surprised 1.2%
Happy 1.2%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Calm 89.9%
Sad 1.8%
Fear 1.7%
Confused 1.6%
Surprised 1.6%
Angry 1.5%
Happy 1.1%
Disgusted 0.9%

AWS Rekognition

Age 6-14
Gender Male, 59.4%
Sad 49.9%
Calm 45.6%
Angry 1.2%
Happy 0.9%
Disgusted 0.8%
Confused 0.6%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 98.4%
Calm 99.6%
Sad 0.2%
Angry 0%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Person 99.2%
Person 98%
Person 96.8%
Person 96.5%
Person 96.5%
Person 96%
Person 95.7%
Person 92.9%
Person 92.5%
Person 92.4%
Person 91.6%
Person 89.9%
Person 89.4%
Person 86.6%
Person 83.8%
Person 80.9%
Person 76.7%
Person 63.6%
Person 48%
Poster 54.7%

Categories

Text analysis

Amazon

KODAK
FILM
SAFETY
KODAK SAFETY FILM
SAFETY FILM
KODAK SAFETY
12
LA
7E
KETY
SWFETY FILM
9
SWFETY
ARTEAN
1

Google

KRAAAOORTER KA (10 KODAK SAFETY FILM KODAK SAFETY FILM
KRAAAOORTER
KA
(10
KODAK
SAFETY
FILM