Human Generated Data

Title

Untitled (ten photographs: Cuban revolutionaries, with guns and drinking)

Date

c. 1950, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12247

Human Generated Data

Title

Untitled (ten photographs: Cuban revolutionaries, with guns and drinking)

People

Artist: Lester Cole, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Advertisement 100
Collage 100
Person 98.6
Human 98.6
Person 95.6
Person 94.6
Person 93.6
Person 93.3
Person 91.1
Person 90.7
Person 90.4
Person 89.5
Person 87.4
Person 70.6
Person 68
Person 67.7
Person 61.4
Cake 56.9
Dessert 56.9
Icing 56.9
Food 56.9
Cream 56.9
Creme 56.9
Apparel 56.5
Clothing 56.5
Poster 52.9
Person 42.4
Person 41.5

Imagga
created on 2022-02-25

window 47.6
furniture 44
china cabinet 36.3
case 36.1
cabinet 29.9
furnishing 28.7
glass 22.6
religion 17.9
church 17.6
interior 16.8
old 16.7
stained 15.4
framework 15
design 14.8
shop 14.7
style 14.1
architecture 14
black 13.9
art 13.6
cathedral 13.4
light 13.3
shelf 13.1
screen 12.4
religious 12.2
faith 11.5
covering 11.4
supporting structure 11.3
ancient 11.2
door 11
fashion 10.5
indoors 10.5
decoration 10.4
inside 10.1
colorful 10
house 10
color 10
building 9.6
home 9.6
pattern 9.6
retro 9
history 8.9
decor 8.8
catholic 8.7
antique 8.6
room 8.6
wall 8.5
vintage 8.3
city 8.3
sliding door 8.2
man 8.1
detail 8
bookcase 7.9
stained glass 7.9
catholicism 7.9
urban 7.9
people 7.8
modern 7.7
holy 7.7
store 7.5
decorative 7.5
historic 7.3
business 7.3
dress 7.2
table 7.1

Google
created on 2022-02-25

Microsoft
created on 2022-02-25

text 79.4
person 73.9
bunch 65.4
different 44.4
several 18.5

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Happy 65.2%
Calm 25.6%
Fear 3.8%
Surprised 1.9%
Sad 1.2%
Disgusted 0.9%
Angry 0.9%
Confused 0.5%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 93.1%
Surprised 4.1%
Fear 0.8%
Sad 0.7%
Confused 0.4%
Disgusted 0.3%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Surprised 48.6%
Confused 32.3%
Fear 7.7%
Calm 5.5%
Disgusted 3%
Happy 1.3%
Angry 0.9%
Sad 0.7%

AWS Rekognition

Age 35-43
Gender Male, 98.3%
Calm 99.5%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%
Sad 0%
Angry 0%

AWS Rekognition

Age 21-29
Gender Male, 94%
Sad 58.5%
Calm 25.8%
Fear 12.6%
Angry 2.1%
Disgusted 0.3%
Surprised 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 1-7
Gender Male, 68.2%
Fear 40.9%
Surprised 37.4%
Calm 6.6%
Angry 6.4%
Happy 3.8%
Sad 2.7%
Confused 1.5%
Disgusted 0.8%

AWS Rekognition

Age 2-10
Gender Female, 100%
Calm 92.7%
Surprised 2.5%
Fear 2.2%
Happy 1.2%
Sad 0.5%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Fear 79.6%
Calm 7%
Happy 4%
Confused 3.7%
Surprised 3.3%
Angry 1.1%
Sad 0.9%
Disgusted 0.4%

AWS Rekognition

Age 16-22
Gender Male, 56.6%
Calm 73.3%
Sad 13.4%
Disgusted 6.6%
Confused 2.3%
Happy 1.8%
Fear 1.2%
Angry 0.9%
Surprised 0.4%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Fear 79.2%
Calm 13.8%
Sad 1.8%
Surprised 1.7%
Happy 1.1%
Disgusted 1%
Angry 0.8%
Confused 0.6%

AWS Rekognition

Age 19-27
Gender Male, 91.3%
Calm 68.6%
Angry 17.6%
Happy 9.2%
Sad 2.8%
Confused 0.6%
Fear 0.5%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 16-24
Gender Male, 95.6%
Calm 39.7%
Sad 13%
Surprised 12.4%
Confused 10.8%
Happy 7.2%
Disgusted 7.1%
Angry 5.5%
Fear 4.3%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 58.6%
Fear 14.8%
Angry 7.8%
Sad 7.2%
Surprised 6%
Disgusted 3.7%
Happy 1.1%
Confused 0.8%

AWS Rekognition

Age 36-44
Gender Male, 91%
Happy 39.8%
Confused 20.3%
Calm 14.9%
Disgusted 13.9%
Angry 3.6%
Surprised 3.2%
Sad 2.2%
Fear 2.2%

AWS Rekognition

Age 6-14
Gender Male, 89.8%
Fear 93.3%
Sad 2.5%
Surprised 1.4%
Calm 1.3%
Angry 1%
Happy 0.2%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-30
Gender Female, 95.7%
Sad 50.9%
Calm 36.5%
Angry 3.3%
Confused 3.2%
Fear 1.9%
Happy 1.9%
Surprised 1.5%
Disgusted 0.8%

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Calm 96.3%
Sad 1.3%
Angry 1.1%
Happy 0.5%
Surprised 0.4%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Angry 72.8%
Calm 16.4%
Sad 4.6%
Disgusted 2.1%
Confused 1.5%
Fear 1.2%
Happy 0.8%
Surprised 0.6%

AWS Rekognition

Age 23-31
Gender Female, 53.6%
Calm 72.2%
Happy 11.9%
Angry 5.1%
Disgusted 4.1%
Surprised 2.6%
Sad 1.9%
Fear 1.3%
Confused 0.9%

AWS Rekognition

Age 14-22
Gender Male, 99.8%
Calm 99.8%
Fear 0.1%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 26-36
Gender Male, 87.2%
Fear 95.4%
Calm 1.7%
Happy 1.7%
Angry 0.4%
Sad 0.3%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 10-18
Gender Male, 95.5%
Disgusted 48.1%
Calm 29.7%
Surprised 8.6%
Fear 6.3%
Sad 2.4%
Happy 2.3%
Angry 1.3%
Confused 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.6%
Poster 52.9%

Captions

Microsoft

a bunch of graffiti on a wall 37.8%

Text analysis

Amazon

2
9
5
3
TLM
ALEJAS
VOGY