Human Generated Data

Title

Untitled (eight photographs: portraits of Cuban politicians in library)
Date

c. 1950, printed later
People

Artist: Lester Cole, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12264

Human Generated Data

Title

Untitled (eight photographs: portraits of Cuban politicians in library)

People

Artist: Lester Cole, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 99.1
Person 99.1
Person 98.5
Person 98.5
Person 98.4
Person 97.9
Person 97.8
Person 97.5
Person 97.4
Person 97.4
Person 96.2
Person 96.1
Collage 95.5
Advertisement 95.5
Poster 95.5
Furniture 87.7
Interior Design 86.4
Indoors 86.4
Shelf 86.3
Face 80.6
Monitor 78.9
Display 78.9
Screen 78.9
Electronics 78.9
Coat 78.4
Apparel 78.4
Clothing 78.4
Overcoat 78.4
Table 67.1
Suit 61.9
LCD Screen 61.2
Photo Booth 57.1

Imagga
created on 2022-02-25

shop 94.4
mercantile establishment 69.6
bookshop 68
place of business 46.4
establishment 23.2
barbershop 23.1
interior 19.4
man 18.8
building 16.3
architecture 15.6
urban 14.8
people 14.5
male 14.2
city 14.1
business 13.9
old 13.9
black 13.2
window 12.2
vintage 11.6
case 11.2
portrait 11
glass 10.9
history 10.7
person 10.7
tobacco shop 10.6
one 10.4
culture 10.2
work 10.2
inside 10.1
office 9.9
adult 9.7
industry 9.4
light 9.3
safety 9.2
stall 9.2
religion 8.9
indoors 8.8
sitting 8.6
art 8.4
fashion 8.3
security 8.2
historic 8.2
room 8.2
transportation 8.1
worker 8
restaurant 7.8
antique 7.8
travel 7.7
men 7.7
center 7.7
communications 7.6
fire 7.5
chair 7
vehicle 7

Google
created on 2022-02-25

Outerwear 95.6
Photograph 94.4
White 92.2
Black 90.2
Coat 88.1
Black-and-white 86
Style 84
Fixture 80.7
Suit 78.9
People 78.4
Art 76.9
Snapshot 74.3
Shelving 74.3
Monochrome 73.4
Shelf 73.4
Monochrome photography 71.6
Font 70.9
Room 66
Street 60.4
Hat 58.9

Microsoft
created on 2022-02-25

text 99.5
clothing 98.5
person 95.6
man 95.1
black and white 91.3
book 79.6
human face 78.7
group 62.2
suit 54.7
posing 45.4
same 19.5

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 91.8%
Calm 93.2%
Sad 5.9%
Confused 0.2%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Confused 96.6%
Calm 2.5%
Sad 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 80.4%
Confused 7.9%
Fear 5.9%
Sad 2.4%
Angry 1.4%
Surprised 0.8%
Disgusted 0.6%
Happy 0.6%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Surprised 40.1%
Calm 26.5%
Disgusted 17.5%
Happy 7.5%
Angry 2.8%
Sad 2.6%
Confused 1.6%
Fear 1.4%

AWS Rekognition

Age 37-45
Gender Female, 95.6%
Calm 48.2%
Disgusted 32.9%
Sad 5.6%
Angry 4.7%
Happy 3.1%
Surprised 2.5%
Fear 2.1%
Confused 0.8%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 97.4%
Angry 0.7%
Confused 0.5%
Sad 0.5%
Disgusted 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 49.1%
Angry 30.7%
Disgusted 7.7%
Confused 7.2%
Surprised 2.6%
Sad 1.6%
Fear 0.7%
Happy 0.5%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 94.3%
Disgusted 1.3%
Sad 1.2%
Angry 1%
Surprised 0.9%
Confused 0.5%
Happy 0.4%
Fear 0.4%

AWS Rekognition

Age 16-22
Gender Male, 68.9%
Calm 63.2%
Happy 8.7%
Sad 7.9%
Confused 6.9%
Angry 5.5%
Surprised 3.1%
Disgusted 2.9%
Fear 1.9%

AWS Rekognition

Age 54-64
Gender Male, 52.8%
Sad 95.2%
Angry 1.7%
Fear 1.5%
Calm 1.1%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 61.9%

Captions

Microsoft

a group of people posing for a photo 84%
a group of people posing for the camera 83.9%
a group of people in a room 83.8%

Text analysis

Amazon

KODAK
FILM
SAFETY FILM
SAFETY
2
MJIN
LIFW
MJIN УТЗ3АВ
LITW
MAGOM
MJIN ٢٢٥٦кв
ZULELA LIFW
MAGOX
MAGON
YT33K2
ZULELA
25
11
YT318C
УТЗ3АВ
ЛАООЛ
٢٢٥٦кв
WEEN
LAW

Google

KODAK S'AFETYF I LM KORAK SAEETY LM KODVV KODVV LEIA EITW 2NLELA LITW KODVK 2LEIA LITW KODVK 2LEIA LITW Lirw THN
I
SAEETY
2LEIA
KODAK
LITW
THN
KORAK
Lirw
LM
KODVV
EITW
KODVK
S'AFETYF
LEIA
2NLELA