Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries, wounded man with sling)
Date

c. 1950, printed later
People

Artist: Lester Cole, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12250

Human Generated Data

Title

Untitled (twelve photographs: Cuban revolutionaries, wounded man with sling)

People

Artist: Lester Cole, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Collage 98.2
Advertisement 98.2
Person 97.7
Human 97.7
Person 97.4
Poster 96.6
Person 95.1
Person 94.6
Person 92.9
Person 92.6
Person 90.7
Person 87.5
Person 86.6
Person 85.5
Person 85.3
Person 84.5
Shelf 80.7
Person 79.3
Person 78.5
Person 78.1
Furniture 73
Machine 71.5
Person 65.5
Electronics 64.1
Screen 64.1
Person 63.8
Person 60.4
Person 57.7
Display 57.2
Monitor 57.2
Cabinet 56.6

Imagga
created on 2022-02-25

case 100
locker 37.5
fastener 29.8
window 23.4
restraint 22.4
old 20.2
door 19.9
architecture 18.7
furniture 18.2
religion 17.9
device 15.3
art 14.9
church 14.8
history 14.3
interior 14.1
design 14
glass 14
religious 13.1
building 12.7
house 12.5
texture 12.5
cabinet 12.5
cathedral 12.5
china cabinet 12.2
wood 11.7
decoration 11.6
antique 11.2
style 11.1
wall 11.1
vintage 10.7
furnishing 10.5
indoors 10.5
shop 10.4
culture 10.2
colorful 10
detail 9.6
pattern 9.6
ancient 9.5
frame 9.1
city 9.1
home 8.8
entrance 8.7
stained 8.6
historical 8.5
china 8.4
traditional 8.3
retro 8.2
brown 8.1
man 8
light 8
decor 7.9
wooden 7.9
faith 7.6
gold 7.4
people 7.2
market 7.1

Google
created on 2022-02-25

Automotive design 83.7
Font 83.6
Art 83
Hat 82
Wall 81.3
Display case 71.2
Visual arts 69.5
Room 69.1
Fedora 67.8
Collage 64.6
Graphics 63.9
Eyewear 63.8
Collection 62.8
Picture frame 61.5
Graphic design 59.1
Exhibition 58.2
Machine 54.1
Advertising 51.5

Microsoft
created on 2022-02-25

text 93.4
person 90.4
clothing 82.4
furniture 82
poster 74.5
cartoon 69.8
bunch 64.1
several 19.7

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 84%
Happy 10.5%
Angry 1.9%
Disgusted 1.1%
Confused 0.9%
Sad 0.6%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 95.9%
Sad 1.9%
Angry 0.6%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Happy 0.3%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.7%
Sad 0.1%
Angry 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 96.4%
Surprised 0.8%
Sad 0.7%
Happy 0.6%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 24-34
Gender Male, 95.8%
Calm 98%
Sad 1.5%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 23-33
Gender Male, 99.6%
Calm 96.5%
Sad 1.3%
Confused 0.6%
Surprised 0.5%
Angry 0.3%
Fear 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 69.4%
Sad 82.8%
Confused 6%
Calm 5.1%
Angry 2%
Disgusted 1.4%
Surprised 1.1%
Happy 0.9%
Fear 0.7%

AWS Rekognition

Age 27-37
Gender Female, 96.7%
Sad 35.4%
Disgusted 25.9%
Angry 15.5%
Calm 10.4%
Confused 8.9%
Surprised 1.5%
Fear 1.4%
Happy 1%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Happy 0%
Fear 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 45-51
Gender Male, 95.4%
Calm 96.3%
Surprised 1.3%
Disgusted 1.3%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Female, 54.1%
Calm 99.1%
Sad 0.4%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 95%
Calm 98.6%
Sad 0.6%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Calm 63.7%
Disgusted 22.1%
Confused 4.5%
Angry 4%
Fear 1.9%
Sad 1.8%
Surprised 1.3%
Happy 0.8%

AWS Rekognition

Age 45-51
Gender Male, 99.4%
Calm 85.9%
Sad 6.6%
Angry 2.2%
Fear 2.1%
Disgusted 1.2%
Surprised 1.1%
Confused 0.6%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 93.8%
Calm 47.7%
Confused 28.4%
Surprised 10.8%
Disgusted 4.5%
Angry 4%
Sad 2.9%
Fear 1.4%
Happy 0.5%

AWS Rekognition

Age 16-24
Gender Male, 99%
Calm 98.9%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%
Sad 0.2%
Happy 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 93.9%
Sad 3.7%
Surprised 1%
Angry 0.4%
Fear 0.3%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 75.6%
Sad 15.7%
Confused 2.3%
Happy 2.1%
Angry 1.4%
Surprised 1.3%
Fear 1%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 80.2%
Surprised 8.6%
Sad 3.9%
Happy 2.4%
Fear 1.5%
Disgusted 1.2%
Confused 1.1%
Angry 1.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Sad 95%
Calm 2.9%
Confused 0.7%
Angry 0.4%
Surprised 0.3%
Fear 0.3%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 51.5%
Angry 28.8%
Happy 6.7%
Disgusted 4.5%
Surprised 4.4%
Sad 2.5%
Fear 1%
Confused 0.7%

AWS Rekognition

Age 19-27
Gender Female, 70.5%
Calm 70.2%
Happy 11.2%
Fear 10.7%
Surprised 3%
Disgusted 2.7%
Sad 0.8%
Confused 0.8%
Angry 0.7%

AWS Rekognition

Age 18-26
Gender Male, 92.9%
Calm 50.5%
Confused 27.3%
Disgusted 7.2%
Sad 5.3%
Angry 2.9%
Happy 2.5%
Fear 2.2%
Surprised 2%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Calm 35.9%
Sad 15.4%
Angry 14.5%
Fear 13.9%
Confused 8.2%
Happy 5.2%
Disgusted 4.4%
Surprised 2.5%

AWS Rekognition

Age 23-31
Gender Male, 62.5%
Calm 95%
Sad 1.6%
Surprised 1.1%
Fear 0.7%
Happy 0.4%
Disgusted 0.4%
Angry 0.4%
Confused 0.4%

AWS Rekognition

Age 16-24
Gender Female, 96.3%
Sad 31.5%
Calm 29.6%
Fear 20.2%
Surprised 13.7%
Angry 1.9%
Disgusted 1.3%
Confused 0.9%
Happy 0.9%

AWS Rekognition

Age 24-34
Gender Female, 85.9%
Calm 71.8%
Sad 15.3%
Fear 3.8%
Confused 2.4%
Surprised 2.2%
Angry 2%
Happy 1.6%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Poster 96.6%

Captions

Microsoft

a group of people posing for a photo 42.6%
a group of people posing for the camera 42.5%
a group of people posing for a picture 42.4%

Text analysis

Amazon

FILM
KODAK
KODAK SAFETY FILM
SAFETY
G10
8
7
10
2
D
SAFETY FILM
RODAR SAFETY FILM
KODAK SAFETY
STEETY FILM
RODAR
STEETY
SNEETY
SUFETY

Google

KODAK SAFETY KODAR SAFETY FILM FILM KODAK SAFETY FILM AFETY FILM KODAR KODAK KODAK SAFETY FILM KODAK SAFETY FILM STL FILM KODAK
KODAR
FILM
KODAK
SAFETY
AFETY
STL