Human Generated Data

Title

Untitled (thirteen photographs: portraits of Cuban revolutionaries)

Date

c. 1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14153

Human Generated Data

Title

Untitled (thirteen photographs: portraits of Cuban revolutionaries)

People

Artist: Lester Cole, American

Date

c. 1959, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14153

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Collage 100
Advertisement 100
Person 98.7
Human 98.7
Person 98.4
Person 98.4
Person 98.2
Person 98.2
Person 98.2
Person 97.3
Person 97.1
Person 96.2
Person 96.2
Person 95.9
Person 95.3
Person 95.2
Person 94.8
Person 94.4
Person 94.2
Person 93.6
Person 92.5
Person 88.6
Person 85.2
Person 84.6
Person 80.6
Poster 77.8
Person 68.9

Clarifai
created on 2023-10-22

people 99.9
street 99.8
group 99.2
many 99
monochrome 98.5
woman 98.1
man 97.3
crowd 96.5
stock 95.9
adult 95.4
commerce 94.9
portrait 94.7
music 94.5
city 94.2
department store 93.6
wear 92.8
child 92.6
art 92.1
exhibition 91.9
fashion 91

Imagga
created on 2022-02-25

case 79.6
window 27.1
shop 27.1
old 23
mercantile establishment 19.2
glass 18.7
vintage 17.2
black 16.9
architecture 16.4
comic book 16
design 15.2
art 14.9
religion 14.3
church 13.9
door 13.2
place of business 12.8
texture 12.5
interior 12.4
antique 12.1
stained 11.5
cathedral 11.5
building 11.3
china cabinet 11.2
ancient 10.4
furniture 10.3
pattern 10.2
culture 10.2
decoration 10.1
city 10
history 9.8
retro 9.8
cabinet 9.5
religious 9.4
grunge 9.4
historic 9.2
people 8.9
style 8.9
home 8.8
urban 8.7
light 8.7
detail 8
night 8
barbershop 7.8
bookshop 7.5
fashion 7.5
house 7.5
frame 7.5
tobacco shop 7.3
sliding door 7.3
person 7.1
indoors 7

Google
created on 2022-02-25

Head 97.3
Photograph 94.2
Facial expression 93.3
White 92.2
Black 89.9
Human 88.9
Black-and-white 86.8
Art 85.7
Style 84.1
Monochrome 76.1
Monochrome photography 75.6
Collage 75.1
Snapshot 74.3
Hat 69.3
Room 68.7
Font 68.6
Picture frame 67
Rectangle 66.8
Stock photography 66.7
Visual arts 66.5

Microsoft
created on 2022-02-25

person 95.5
text 92
poster 90.3
clothing 90.2
black and white 85.3
man 82.2
group 74.3
gallery 73.9
bunch 73.1
posing 71.2
line 18.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 95.9%
Sad 2.2%
Angry 0.5%
Confused 0.4%
Fear 0.3%
Surprised 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 98.5%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Female, 100%
Calm 69.8%
Sad 12.2%
Angry 7.1%
Confused 4.2%
Fear 3.1%
Surprised 1.7%
Disgusted 1.3%
Happy 0.8%

AWS Rekognition

Age 49-57
Gender Female, 99.9%
Calm 82.2%
Happy 12.8%
Surprised 1.7%
Sad 1.2%
Angry 0.9%
Confused 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 98.6%
Sad 0.4%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Confused 92.6%
Angry 2.2%
Sad 2%
Calm 1.7%
Surprised 0.8%
Disgusted 0.4%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 95.2%
Sad 96.1%
Angry 0.9%
Fear 0.8%
Confused 0.7%
Calm 0.6%
Disgusted 0.4%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 43-51
Gender Female, 99.9%
Sad 95.2%
Confused 3.2%
Calm 0.7%
Fear 0.4%
Angry 0.3%
Disgusted 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Disgusted 19.7%
Angry 19.7%
Sad 17.8%
Confused 17.5%
Calm 16.6%
Surprised 5.8%
Fear 1.8%
Happy 1.1%

AWS Rekognition

Age 41-49
Gender Male, 95.3%
Calm 99.8%
Happy 0.1%
Sad 0.1%
Disgusted 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 95.8%
Happy 66.9%
Fear 22%
Confused 3.8%
Calm 2.9%
Sad 1.4%
Surprised 1.3%
Angry 0.9%
Disgusted 0.7%

AWS Rekognition

Age 33-41
Gender Male, 93.4%
Disgusted 96.1%
Calm 1.3%
Angry 0.8%
Happy 0.6%
Confused 0.5%
Surprised 0.4%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 94.7%
Confused 2%
Surprised 1.3%
Fear 1%
Disgusted 0.4%
Angry 0.2%
Happy 0.2%
Sad 0.2%

AWS Rekognition

Age 33-41
Gender Male, 96.8%
Calm 50.2%
Sad 39.2%
Angry 4.5%
Confused 2.7%
Disgusted 1.4%
Surprised 0.9%
Fear 0.8%
Happy 0.4%

AWS Rekognition

Age 50-58
Gender Female, 94.6%
Sad 33.7%
Angry 15.9%
Confused 15.6%
Fear 14.3%
Calm 10%
Surprised 5.5%
Disgusted 3.8%
Happy 1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 97%
Confused 1.2%
Angry 0.8%
Sad 0.3%
Happy 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Female, 94%
Sad 83.3%
Calm 9.7%
Fear 3.9%
Surprised 0.8%
Disgusted 0.8%
Confused 0.6%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Sad 98.1%
Calm 1.6%
Confused 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Confused 54.9%
Calm 27.6%
Sad 14.9%
Disgusted 0.9%
Surprised 0.7%
Fear 0.7%
Angry 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Person 98.7%
Person 98.4%
Person 98.4%
Person 98.2%
Person 98.2%
Person 98.2%
Person 97.3%
Person 97.1%
Person 96.2%
Person 96.2%
Person 95.9%
Person 95.3%
Person 95.2%
Person 94.8%
Person 94.4%
Person 94.2%
Person 93.6%
Person 92.5%
Person 88.6%
Person 85.2%
Person 84.6%
Person 80.6%
Person 68.9%
Poster 77.8%

Categories

Text analysis

Amazon

FILM
SAFETY FILM
KODAK
10
SAFETY
3
9
2
4
KODAK SAFETY FILM
KODAK SMFETY FILM
SMFETY
u
SKFETY
КОПАН
منت
PILA
13
PILK
TEFETY

Google

10
10