Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries)

Date

c. 1950, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12252

Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries)

People

Artist: Lester Cole, American

Date

c. 1950, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12252

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Collage 100
Advertisement 100
Person 98.4
Human 98.4
Person 97.8
Person 95.6
Person 95
Person 94.8
Poster 93.7
Person 90.9
Person 90.8
Person 89.5
Person 85
Shelf 75.2
Person 73.3
Person 71.7
Clock Tower 61.9
Building 61.9
Architecture 61.9
Tower 61.9
Person 60.7
Person 47.2

Clarifai
created on 2023-10-22

shelf 97.5
stock 96.9
people 96.9
commerce 96.6
shopping 95.4
art 95.4
collage 95
collection 94.4
fashion 94.4
no person 94
street 94
interior design 92.9
market 92.8
nature 90.9
travel 90.6
painting 89.2
architecture 88.6
woman 88.5
urban 88.4
merchandise 88.3

Imagga
created on 2022-02-25

door 40.7
sliding door 40.6
window 26.7
screen 26.4
movable barrier 24.4
old 22.3
case 20.2
covering 18.3
vintage 18.2
design 16.4
collection 16.2
barrier 16.2
money 15.3
paper 14.1
shop 14.1
frame 13.4
architecture 13.4
art 13
card 12.9
grunge 12.8
antique 12.6
religion 12.5
history 12.5
retro 12.3
business 12.1
symbol 12.1
cash 11.9
set 11.9
glass 11.8
currency 11.6
pattern 11.6
texture 11.1
black 10.8
traditional 10.8
framework 10.3
church 10.2
finance 10.1
historic 10.1
communication 10.1
china cabinet 10.1
bank 9.8
decoration 9.5
ancient 9.5
building 9.1
element 9.1
stamp 9.1
furniture 9.1
office 8.9
style 8.9
icon 8.7
religious 8.4
house 8.3
letter 8.2
mercantile establishment 8.2
obstruction 8.2
cabinet 8.1
wealth 8.1
light 8
postmark 7.9
holiday 7.9
postage 7.9
comic book 7.8
supporting structure 7.8
dollars 7.7
modern 7.7
stained 7.7
cathedral 7.7
mail 7.6
post 7.6
bill 7.6
rich 7.4
dollar 7.4
gold 7.4
banking 7.3
banner 7.3
new 7.3
home 7.2
celebration 7.2
colorful 7.2
interior 7.1

Google
created on 2022-02-25

Photograph 94.2
Product 90.7
Window 87.7
Font 84.8
Art 84.1
Line 81.9
Building 74.7
Snapshot 74.3
Rectangle 72.6
Room 68.9
Design 68.4
Visual arts 67.7
Illustration 64.7
Facade 64.5
Stock photography 62.7
Door 62
Paper 60.4
Tree 60
Publication 59.9
Plant 59.4

Microsoft
created on 2022-02-25

art 94.5
drawing 87.1
bunch 84.3
cartoon 82.4
poster 79.8
text 65.1
handwriting 58.6
different 52.9
various 45
several 15.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 93.9%
Confused 3.7%
Disgusted 0.9%
Surprised 0.7%
Sad 0.3%
Happy 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 24-34
Gender Female, 100%
Calm 99.3%
Happy 0.3%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 99.8%
Disgusted 57.4%
Surprised 15.8%
Happy 10.5%
Calm 6.8%
Angry 2.9%
Confused 2.9%
Fear 2.6%
Sad 1.2%

AWS Rekognition

Age 38-46
Gender Female, 98.3%
Happy 94.3%
Calm 4.4%
Surprised 0.3%
Sad 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.1%
Disgusted 62.9%
Sad 20.6%
Happy 7.4%
Calm 3.9%
Fear 1.6%
Confused 1.4%
Angry 1.3%
Surprised 0.9%

AWS Rekognition

Age 54-64
Gender Male, 99.8%
Calm 98.8%
Happy 0.3%
Sad 0.3%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 96.1%
Disgusted 1.2%
Sad 0.9%
Angry 0.7%
Confused 0.3%
Happy 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 92.5%
Angry 2.8%
Confused 1.4%
Happy 1.2%
Sad 0.8%
Surprised 0.7%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Male, 91.2%
Calm 85.4%
Disgusted 3.9%
Angry 3.4%
Surprised 2.8%
Sad 1.4%
Fear 1.2%
Confused 1%
Happy 0.9%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Surprised 29.6%
Fear 24.6%
Calm 23.8%
Happy 10.8%
Disgusted 4.6%
Angry 2.5%
Sad 2.2%
Confused 1.9%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99.1%
Sad 0.3%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 60%
Angry 14.3%
Disgusted 9.2%
Fear 4.7%
Confused 3.5%
Happy 3.1%
Surprised 3.1%
Sad 2.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 88.4%
Surprised 6.1%
Confused 2.5%
Disgusted 0.8%
Angry 0.7%
Fear 0.5%
Sad 0.5%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Fear 56.9%
Calm 23.3%
Surprised 7.7%
Disgusted 4.8%
Angry 3.1%
Sad 3%
Confused 0.6%
Happy 0.6%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 96.3%
Sad 1.5%
Confused 1.1%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 60.2%
Calm 83.7%
Fear 7.4%
Sad 4.8%
Surprised 1.2%
Angry 1.1%
Confused 0.9%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 27-37
Gender Male, 84.4%
Sad 85.6%
Calm 5.8%
Happy 5.2%
Angry 0.9%
Fear 0.7%
Confused 0.7%
Disgusted 0.7%
Surprised 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99%
Calm 87.8%
Sad 3%
Surprised 2.7%
Happy 2.2%
Fear 1.4%
Disgusted 1%
Confused 0.9%
Angry 0.9%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Calm 89.1%
Sad 4.8%
Surprised 2.2%
Angry 1.7%
Fear 0.9%
Confused 0.5%
Happy 0.5%
Disgusted 0.4%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 99.2%
Happy 0.3%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 92.5%
Calm 97.2%
Sad 1%
Angry 0.6%
Happy 0.4%
Fear 0.2%
Disgusted 0.2%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 89.1%
Calm 95.5%
Confused 1.5%
Happy 0.9%
Angry 0.6%
Surprised 0.6%
Disgusted 0.5%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Male, 86.9%
Calm 29.3%
Disgusted 22.1%
Happy 16.1%
Angry 11.1%
Sad 9.6%
Confused 5.6%
Fear 3.7%
Surprised 2.5%

AWS Rekognition

Age 23-31
Gender Female, 86.6%
Surprised 81.5%
Happy 5.6%
Calm 4%
Angry 4%
Fear 2%
Disgusted 1.5%
Sad 0.8%
Confused 0.6%

AWS Rekognition

Age 31-41
Gender Male, 99.6%
Calm 95.1%
Happy 2%
Sad 0.8%
Disgusted 0.6%
Confused 0.5%
Angry 0.5%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Male, 98.9%
Calm 99.1%
Sad 0.6%
Angry 0.1%
Fear 0%
Confused 0%
Surprised 0%
Disgusted 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Clock Tower
Person 98.4%
Person 97.8%
Person 95.6%
Person 95%
Person 94.8%
Person 90.9%
Person 90.8%
Person 89.5%
Person 85%
Person 73.3%
Person 71.7%
Person 60.7%
Person 47.2%
Poster 93.7%
Clock Tower 61.9%

Categories

Imagga

paintings art 99.5%

Text analysis

Amazon

FILM
KODAK
SAFETY
SAFETY FILM
KODAK SAFETY
7E
5
LM
G10
KODAK SAFETY FILM
12
r1LM
ODAK
S
KODAH
W
SALETY
11
175 11
175

Google

KODAK SAFETY LM KODAK 5AFETY FILM RODAK SAFETY FILM KODAK S'AFETY FILM KODAK SAFETY FILM KODAK S'AFETY FILM KODAK SAFETY F ILM KODAK S'AFETY KODAKSALLLY EILM KODAK S'AFETY FILM KODAK SAFETY FILM KODAK S'AFETY FILM KODAK SAFETY FILM
KODAK
SAFETY
LM
5AFETY
FILM
RODAK
S'AFETY
F
ILM
KODAKSALLLY
EILM